Update doc templates for running safety on self-hosted templates (#874)

This commit is contained in:
Hardik Shah 2025-01-24 11:28:20 -08:00 committed by GitHub
parent eaba6a550a
commit 2cebb24d3a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
12 changed files with 140 additions and 37 deletions

View file

@ -74,11 +74,15 @@ docker run \
If you are using Llama Stack Safety / Shield APIs, use:
```bash
# You need a local checkout of llama-stack to run this, get it using
# git clone https://github.com/meta-llama/llama-stack.git
cd /path/to/llama-stack
docker run \
-it \
-p $LLAMA_STACK_PORT:$LLAMA_STACK_PORT \
-v ~/.llama:/root/.llama \
-v ./run-with-safety.yaml:/root/my-run.yaml \
-v ./llama_stack/templates/ollama/run-with-safety.yaml:/root/my-run.yaml \
llamastack/distribution-{{ name }} \
--yaml-config /root/my-run.yaml \
--port $LLAMA_STACK_PORT \