llama-stack-mirror/docs/source/providers/inference/remote_tgi.md

orphan
true

remote::tgi

Description

Text Generation Inference (TGI) provider for HuggingFace model serving.

Configuration

Field	Type	Required	Default	Description
url	<class 'str'>	No	PydanticUndefined	The URL for the TGI serving endpoint

Sample Configuration

url: ${env.TGI_URL}