feat: Add Groq distribution template (#1173)

# What does this PR do?

Create a distribution template using Groq as inference provider.
Link to issue: https://github.com/meta-llama/llama-stack/issues/958


## Test Plan
Run `python llama_stack/scripts/distro_codegen.py` to generate run.yaml
and build.yaml
Test the newly created template by running
`llama stack build --template <template-name>`
`llama stack run <template-name>`
This commit is contained in:
Vladislav Bronzov 2025-02-25 23:16:56 +01:00 committed by GitHub
parent 99c1d4c456
commit 967cff4533
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
10 changed files with 521 additions and 36 deletions

View file

@ -0,0 +1,29 @@
version: '2'
distribution_spec:
description: Use Groq for running LLM inference
providers:
inference:
- remote::groq
vector_io:
- inline::faiss
safety:
- inline::llama-guard
agents:
- inline::meta-reference
telemetry:
- inline::meta-reference
eval:
- inline::meta-reference
datasetio:
- remote::huggingface
- inline::localfs
scoring:
- inline::basic
- inline::llm-as-judge
- inline::braintrust
tool_runtime:
- remote::brave-search
- remote::tavily-search
- inline::code-interpreter
- inline::rag-runtime
image_type: conda