phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-16 06:53:47 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Update provider_type -> inline::llama-guard in templates, update run.yaml

Browse source
This commit is contained in:
Ashwin Bharambe 2024-11-11 09:12:17 -08:00
parent 15ffceb533
commit 4971113f92
24 changed files with 121 additions and 98 deletions
Download patch file Download diff file Expand all files Collapse all files

4
llama_stack/templates/hf-serverless/build.yaml
View file

@ -3,7 +3,7 @@ distribution_spec:
description: "Like local, but use Hugging Face Inference API (serverless) for running LLM inference.\nSee https://hf.co/docs/api-inference."
providers:
inference: remote::hf::serverless
memory: meta-reference
safety: meta-reference
memory: inline::faiss
safety: inline::llama-guard
agents: meta-reference
telemetry: meta-reference