mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-07-04 05:12:35 +00:00
c9a49a80e8
# What does this PR do? Simple approach to get some provider pages in the docs. Add or update description fields in the provider configuration class using Pydantic’s Field, ensuring these descriptions are clear and complete, as they will be used to auto-generate provider documentation via ./scripts/distro_codegen.py instead of editing the docs manually. Signed-off-by: Sébastien Han <seb@redhat.com>
886 B
886 B
remote::nvidia
Description
NVIDIA inference provider for accessing NVIDIA NIM models and AI services.
Configuration
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
url |
<class 'str'> |
No | https://integrate.api.nvidia.com | A base url for accessing the NVIDIA NIM |
api_key |
pydantic.types.SecretStr | None |
No | The NVIDIA API key, only needed of using the hosted service | |
timeout |
<class 'int'> |
No | 60 | Timeout for the HTTP requests |
append_api_version |
<class 'bool'> |
No | True | When set to false, the API version will not be appended to the base_url. By default, it is true. |
Sample Configuration
url: ${env.NVIDIA_BASE_URL:=https://integrate.api.nvidia.com}
api_key: ${env.NVIDIA_API_KEY:+}
append_api_version: ${env.NVIDIA_APPEND_API_VERSION:=True}