mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-12-31 09:13:53 +00:00
a5827f7cb3
This wires up the openai_completion and openai_chat_completion API methods for the remote Nvidia inference provider, and adds it to the chat completions part of the OpenAI test suite. The hosted Nvidia service doesn't actually host any Llama models with functioning completions and chat completions endpoints, so for now the test suite only activates the nvidia provider for chat completions. Signed-off-by: Ben Browning <bbrownin@redhat.com> |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| config.py | ||
| models.py | ||
| nvidia.py | ||
| openai_utils.py | ||
| utils.py | ||