llama-stack/llama_stack/templates/tgi/build.yaml at cfcc0a871c1e2a19075b8ef2fdca50e32f49fa96 - phoenix-oss/llama-stack - Git for basel.kvant.cloud

phoenix-oss/llama-stack

forked from phoenix-oss/llama-stack-mirror

Xi Yan 07f9bf723f

fix broken --list-templates with adding build.yaml files for packaging (#327 )

* add build files to templates

* fix templates

* manifest

* symlink

* symlink

* precommit

* change everything to docker build.yaml

* remove image_type in templates

* fix build from templates CLI

* fix readmes

2024-10-25 12:51:22 -07:00

12 lines

281 B

YAML

Raw Blame History

 name: tgi
 distribution_spec:
   description: Use TGI for running LLM inference
   providers:
     inference: remote::tgi
     memory:
     - meta-reference
     - remote::chromadb
     - remote::pgvector
     safety: meta-reference
     agents: meta-reference
     telemetry: meta-reference