Updated template and build container issues for docker run

This commit is contained in:
Sajikumar JS 2025-03-24 22:19:09 +05:30
parent dc8a72f864
commit f0740f3ccd
4 changed files with 46 additions and 41 deletions

View file

@ -42,7 +42,7 @@ Make sure you have access to a WatsonX API Key. You can get one by referring [wa
## Running Llama Stack with WatsonX
You can do this via Conda (build code) or Docker which has a pre-built image.
You can do this via Conda (build code), venv or Docker which has a pre-built image.
### Via Docker
@ -53,9 +53,13 @@ LLAMA_STACK_PORT=5001
docker run \
-it \
-p $LLAMA_STACK_PORT:$LLAMA_STACK_PORT \
-v ./run.yaml:/root/my-run.yaml \
llamastack/distribution-{{ name }} \
--yaml-config /root/my-run.yaml \
--port $LLAMA_STACK_PORT \
--env WATSONX_API_KEY=$WATSONX_API_KEY --env WATSONX_PROJECT_ID=$WATSONX_PROJECT_ID
--env WATSONX_API_KEY=$WATSONX_API_KEY \
--env WATSONX_PROJECT_ID=$WATSONX_PROJECT_ID \
--env WATSONX_BASE_URL=$WATSONX_BASE_URL
```
### Via Conda
@ -64,5 +68,6 @@ docker run \
llama stack build --template watsonx --image-type conda
llama stack run ./run.yaml \
--port $LLAMA_STACK_PORT \
--env WATSONX_API_KEY=$WATSONX_API_KEY --env WATSONX_PROJECT_ID=$WATSONX_PROJECT_ID
--env WATSONX_API_KEY=$WATSONX_API_KEY \
--env WATSONX_PROJECT_ID=$WATSONX_PROJECT_ID
```