phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-28 06:58:53 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge f009c0b534 into abade761e0

Browse source
This commit is contained in:
IAN MILLER 2025-07-24 22:13:15 +02:00 • committed by GitHub
commit 5ef6ae4978
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
10 changed files with 41 additions and 26 deletions
Download patch file Download diff file Expand all files Collapse all files

4
llama_stack/templates/meta-reference-gpu/doc_template.md
View file

@ -71,7 +71,7 @@ docker run \
--pull always \
--gpu all \
-p $LLAMA_STACK_PORT:$LLAMA_STACK_PORT \
-v ~/.llama:/root/.llama \
-v ~/.llama:/.llama \
llamastack/distribution-{{ name }} \
--port $LLAMA_STACK_PORT \
--env INFERENCE_MODEL=meta-llama/Llama-3.2-3B-Instruct
@ -85,7 +85,7 @@ docker run \
--pull always \
--gpu all \
-p $LLAMA_STACK_PORT:$LLAMA_STACK_PORT \
-v ~/.llama:/root/.llama \
-v ~/.llama:/.llama \
llamastack/distribution-{{ name }} \
--port $LLAMA_STACK_PORT \
--env INFERENCE_MODEL=meta-llama/Llama-3.2-3B-Instruct \

4
llama_stack/templates/nvidia/doc_template.md
View file

@ -117,9 +117,9 @@ docker run \
-it \
--pull always \
-p $LLAMA_STACK_PORT:$LLAMA_STACK_PORT \
-v ./run.yaml:/root/my-run.yaml \
-v ./run.yaml:/.llama/my-run.yaml \
llamastack/distribution-{{ name }} \
--config /root/my-run.yaml \
--config /.llama/my-run.yaml \
--port $LLAMA_STACK_PORT \
--env NVIDIA_API_KEY=$NVIDIA_API_KEY
```