phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-23 03:52:26 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

refactor: remove Conda support from Llama Stack

Browse source
This commit is contained in:
r3v5 2025-07-17 13:55:56 +01:00
parent 140ee7d337
commit 4a483977f9
No known key found for this signature in database
GPG key ID: 7758B9F272DE67D9
44 changed files with 159 additions and 311 deletions
Download patch file Download diff file Expand all files Collapse all files

13
docs/source/distributions/self_hosted_distro/nvidia.md
View file

@ -133,7 +133,7 @@ curl -X DELETE "$NEMO_URL/v1/deployment/model-deployments/meta/llama-3.1-8b-inst
## Running Llama Stack with NVIDIA
You can do this via Conda or venv (build code), or Docker which has a pre-built image.
You can do this via venv (build code), or Docker which has a pre-built image.
### Via Docker
@ -152,17 +152,6 @@ docker run \
--env NVIDIA_API_KEY=$NVIDIA_API_KEY
```
### Via Conda
```bash
INFERENCE_MODEL=meta-llama/Llama-3.1-8b-Instruct
llama stack build --template nvidia --image-type conda
llama stack run ./run.yaml \
--port 8321 \
--env NVIDIA_API_KEY=$NVIDIA_API_KEY \
--env INFERENCE_MODEL=$INFERENCE_MODEL
```
### Via venv
If you've set up your local development environment, you can also build the image using your local virtual environment.