llama-stack-mirror/docs/source/providers/inference/remote_groq.md

476 B

remote::groq

Description

Groq inference provider for ultra-fast inference using Groq's LPU technology.

Configuration

Field Type Required Default Description
api_key str | None No The Groq API key
url <class 'str'> No https://api.groq.com The URL for the Groq AI server

Sample Configuration

url: https://api.groq.com
api_key: ${env.GROQ_API_KEY:=}