llama-stack-mirror/docs/source/providers/inference/remote_groq.md
Francisco Javier Arceo c8d41d45ec chore: Enabling Milvus for VectorIO CI
Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
2025-06-30 11:55:49 -04:00

474 B

remote::groq

Description

Groq inference provider for ultra-fast inference using Groq's LPU technology.

Configuration

Field Type Required Default Description
api_key str | None No The Groq API key
url <class 'str'> No https://api.groq.com The URL for the Groq AI server

Sample Configuration

url: https://api.groq.com
api_key: ${env.GROQ_API_KEY}