phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-04 21:25:23 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/docs/source/providers/inference/remote_groq.md
Sébastien Han c9a49a80e8
docs: auto generated documentation for providers (#2543) 
# What does this PR do?

Simple approach to get some provider pages in the docs.

Add or update description fields in the provider configuration class
using Pydantic’s Field, ensuring these descriptions are clear and
complete, as they will be used to auto-generate provider documentation
via ./scripts/distro_codegen.py instead of editing the docs manually.

Signed-off-by: Sébastien Han <seb@redhat.com>
2025-06-30 15:13:20 +02:00

474 B
Raw Blame History

remote::groq

Description

Groq inference provider for ultra-fast inference using Groq's LPU technology.

Configuration

Field Type Required Default Description
api_key str | None No The Groq API key
url <class 'str'> No https://api.groq.com The URL for the Groq AI server

Sample Configuration

url: https://api.groq.com
api_key: ${env.GROQ_API_KEY}