fix: use OLLAMA_URL to activate Ollama provider in starter

This commit is contained in:
Ashwin Bharambe 2025-07-30 09:52:19 -07:00
parent b69bafba30
commit c1151e8d81
6 changed files with 23 additions and 41 deletions

View file

@ -16,10 +16,13 @@ as the inference [provider](../providers/inference/index) for a Llama Model.
```bash
ollama run llama3.2:3b --keepalive 60m
```
#### Step 2: Run the Llama Stack server
We will use `uv` to run the Llama Stack server.
```bash
uv run --with llama-stack llama stack build --template starter --image-type venv --run
OLLAMA_URL=http://localhost:11434 \
uv run --with llama-stack llama stack build --template starter --image-type venv --run
```
#### Step 3: Run the demo
Now open up a new terminal and copy the following script into a file named `demo_script.py`.