phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-26 22:19:49 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/docs/source/providers/inference/remote_sambanova-openai-compat.md

573 B
Raw Blame History

remote::sambanova-openai-compat

Description

SambaNova OpenAI-compatible provider for using SambaNova models with OpenAI API format.

Configuration

Field Type Required Default Description
api_key str | None No The SambaNova API key
openai_compat_api_base <class 'str'> No https://api.sambanova.ai/v1 The URL for the SambaNova API server

Sample Configuration

openai_compat_api_base: https://api.sambanova.ai/v1
api_key: ${env.SAMBANOVA_API_KEY:=}