mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-10-04 04:04:14 +00:00
363 B
363 B
remote::tgi
Description
Text Generation Inference (TGI) provider for HuggingFace model serving.
Configuration
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
url |
<class 'str'> |
No | The URL for the TGI serving endpoint |
Sample Configuration
url: ${env.TGI_URL:=}