mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-12-27 09:01:59 +00:00
e11c7595d3
Simple approach to get some provider pages in the docs. Add or update description fields in the provider configuration class using Pydantic’s Field, ensuring these descriptions are clear and complete, as they will be used to auto-generate provider documentation via ./scripts/distro_codegen.py instead of editing the docs manually. Signed-off-by: Sébastien Han <seb@redhat.com>
21 lines
547 B
Markdown
21 lines
547 B
Markdown
# remote::groq-openai-compat
|
|
|
|
## Description
|
|
|
|
Groq OpenAI-compatible provider for using Groq models with OpenAI API format.
|
|
|
|
## Configuration
|
|
|
|
| Field | Type | Required | Default | Description |
|
|
|-------|------|----------|---------|-------------|
|
|
| `api_key` | `str \| None` | No | | The Groq API key |
|
|
| `openai_compat_api_base` | `<class 'str'>` | No | https://api.groq.com/openai/v1 | The URL for the Groq API server |
|
|
|
|
## Sample Configuration
|
|
|
|
```yaml
|
|
openai_compat_api_base: https://api.groq.com/openai/v1
|
|
api_key: ${env.GROQ_API_KEY}
|
|
|
|
```
|
|
|