phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-04 04:04:14 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/docs/source/providers/inference/remote_cerebras.md
Matthew Farrellee 1f7e87c647 feat: update Cerebras inference provider to support dynamic model listing 
- update Cerebras to use OpenAIMixin
- enable openai completions tests
- enable openai chat completions tests
- disable with n > 1 tests
- add recording for --setup cerebras --subdirs inference --pattern openai

test with: `./scripts/integration-tests.sh --stack-config server:ci-tests --setup cerebras --subdirs inference --pattern openai`
2025-09-18 06:54:05 -04:00

519 B
Raw Blame History

remote::cerebras

Description

Cerebras inference provider for running models on Cerebras Cloud platform.

Configuration

Field Type Required Default Description
base_url <class 'str'> No https://api.cerebras.ai Base URL for the Cerebras API
api_key <class 'pydantic.types.SecretStr'> No Cerebras API Key

Sample Configuration

base_url: https://api.cerebras.ai
api_key: ${env.CEREBRAS_API_KEY:=}