llama-stack-mirror/llama_toolchain/configs/distributions/distribution_registry/local-plus-tgi-inference.yaml
2024-09-16 10:12:45 -07:00

7 lines
319 B
YAML

description: Use TGI (local or with Hugging Face Inference Endpoints for running LLM inference. When using HF Inference Endpoints, you must provide the name of the endpoint).
docker_image: null
providers:
inference: remote::tgi
safety: meta-reference
agentic_system: meta-reference
memory: meta-reference-faiss