llama-stack-mirror/docs/source/providers/inference/remote_together.md

691 B

remote::together

Description

Together AI inference provider for open-source models and collaborative AI development.

Configuration

Field Type Required Default Description
allowed_models list[str | None No List of models that should be registered with the model registry. If None, all models are allowed.
url <class 'str'> No https://api.together.xyz/v1 The URL for the Together AI server
api_key pydantic.types.SecretStr | None No The Together AI API Key

Sample Configuration

url: https://api.together.xyz/v1
api_key: ${env.TOGETHER_API_KEY:=}