phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-13 19:02:37 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

docs: Documentation update for NVIDIA Inference Provider

Browse source
This commit is contained in:
Jiayi 2025-10-17 17:34:49 -07:00
parent 943558af36
commit d46f552ab9
2 changed files with 34 additions and 47 deletions
Download patch file Download diff file Expand all files Collapse all files

9
llama_stack/providers/remote/inference/nvidia/nvidia.py
View file

@ -19,15 +19,6 @@ class NVIDIAInferenceAdapter(OpenAIMixin):
"""
NVIDIA Inference Adapter for Llama Stack.
Note: The inheritance order is important here. OpenAIMixin must come before
ModelRegistryHelper to ensure that OpenAIMixin.check_model_availability()
is used instead of ModelRegistryHelper.check_model_availability(). It also
must come before Inference to ensure that OpenAIMixin methods are available
in the Inference interface.
- OpenAIMixin.check_model_availability() queries the NVIDIA API to check if a model exists
- ModelRegistryHelper.check_model_availability() just returns False and shows a warning
"""
# source: https://docs.nvidia.com/nim/nemo-retriever/text-embedding/latest/support-matrix.html