mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-07-26 22:19:49 +00:00
380 B
380 B
remote::tgi
Description
Text Generation Inference (TGI) provider for HuggingFace model serving.
Configuration
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
url |
<class 'str'> |
No | PydanticUndefined | The URL for the TGI serving endpoint |
Sample Configuration
url: ${env.TGI_URL:=}