llama-stack-mirror/docs/source/providers/inference/remote_passthrough.md
Francisco Javier Arceo c8d41d45ec chore: Enabling Milvus for VectorIO CI
Signed-off-by: Francisco Javier Arceo <farceo@redhat.com>
2025-06-30 11:55:49 -04:00

543 B

remote::passthrough

Description

Passthrough inference provider for connecting to any external inference service not directly supported.

Configuration

Field Type Required Default Description
url <class 'str'> No The URL for the passthrough endpoint
api_key pydantic.types.SecretStr | None No API Key for the passthrouth endpoint

Sample Configuration

url: ${env.PASSTHROUGH_URL}
api_key: ${env.PASSTHROUGH_API_KEY}