mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-12-23 23:13:56 +00:00
fix: use OLLAMA_URL to activate Ollama provider in starter
This commit is contained in:
parent
b69bafba30
commit
c1151e8d81
6 changed files with 23 additions and 41 deletions
|
|
@ -16,10 +16,13 @@ as the inference [provider](../providers/inference/index) for a Llama Model.
|
|||
```bash
|
||||
ollama run llama3.2:3b --keepalive 60m
|
||||
```
|
||||
|
||||
#### Step 2: Run the Llama Stack server
|
||||
|
||||
We will use `uv` to run the Llama Stack server.
|
||||
```bash
|
||||
uv run --with llama-stack llama stack build --template starter --image-type venv --run
|
||||
OLLAMA_URL=http://localhost:11434 \
|
||||
uv run --with llama-stack llama stack build --template starter --image-type venv --run
|
||||
```
|
||||
#### Step 3: Run the demo
|
||||
Now open up a new terminal and copy the following script into a file named `demo_script.py`.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue