llama-stack-mirror/llama_stack/templates/together/build.yaml
Xi Yan a70a4706fc
update distributions compose/readme (#338)
* readme updates

* quantied compose

* dell tgi

* config update
2024-10-28 16:34:43 -07:00

11 lines
278 B
YAML

name: together
distribution_spec:
description: Use Together.ai for running LLM inference
providers:
inference: remote::together
memory:
- meta-reference
- remote::weaviate
safety: remote::together
agents: meta-reference
telemetry: meta-reference