mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-07-26 22:19:49 +00:00
476 B
476 B
remote::groq
Description
Groq inference provider for ultra-fast inference using Groq's LPU technology.
Configuration
Field | Type | Required | Default | Description |
---|---|---|---|---|
api_key |
str | None |
No | The Groq API key | |
url |
<class 'str'> |
No | https://api.groq.com | The URL for the Groq AI server |
Sample Configuration
url: https://api.groq.com
api_key: ${env.GROQ_API_KEY:=}