mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-07-26 22:19:49 +00:00
545 B
545 B
remote::sambanova
Description
SambaNova inference provider for running models on SambaNova's dataflow architecture.
Configuration
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
url |
<class 'str'> |
No | https://api.sambanova.ai/v1 | The URL for the SambaNova AI server |
api_key |
pydantic.types.SecretStr | None |
No | The SambaNova cloud API Key |
Sample Configuration
url: https://api.sambanova.ai/v1
api_key: ${env.SAMBANOVA_API_KEY:=}