mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-12-27 18:52:03 +00:00
568 B
568 B
remote::together-openai-compat
Description
Together AI OpenAI-compatible provider for using Together models with OpenAI API format.
Configuration
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
api_key |
str | None |
No | The Together API key | |
openai_compat_api_base |
<class 'str'> |
No | https://api.together.xyz/v1 | The URL for the Together API server |
Sample Configuration
openai_compat_api_base: https://api.together.xyz/v1
api_key: ${env.TOGETHER_API_KEY}