llama-stack-mirror/docs/source/providers/inference/remote_llama-openai-compat.md

orphan
true

remote::llama-openai-compat

Description

Llama OpenAI-compatible provider for using Llama models with OpenAI API format.

Configuration

Field	Type	Required	Default	Description
api_key	str | None	No		The Llama API key
openai_compat_api_base	<class 'str'>	No	https://api.llama.com/compat/v1/	The URL for the Llama API server

Sample Configuration

openai_compat_api_base: https://api.llama.com/compat/v1/
api_key: ${env.LLAMA_API_KEY}