llama-stack-mirror/llama_stack/distribution/templates/conda/local-together-conda-template-build.yaml
2024-09-18 13:17:18 -07:00

10 lines
281 B
YAML

name: local-tgi-conda-template
distribution_spec:
description: Use Together.ai for running LLM inference
providers:
inference: remote::together
memory: meta-reference
safety: meta-reference
agents: meta-reference
telemetry: meta-reference
image_type: conda