phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-17 18:02:40 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Allow setting environment variables from llama stack run and fix ollama

Browse source
This commit is contained in:
Ashwin Bharambe 2024-11-17 19:33:48 -08:00
parent a061f3f8c1
commit b1d119466e
19 changed files with 129 additions and 55 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/source/getting_started/distributions/self_hosted_distro/ollama.md
View file

@ -20,7 +20,7 @@ The following environment variables can be configured:
- `LLAMASTACK_PORT`: Port for the Llama Stack distribution server (default: `5001`)
- `INFERENCE_MODEL`: Inference model loaded into the TGI server (default: `meta-llama/Llama-3.2-3B-Instruct`)
- `OLLAMA_PORT`: Port of the Ollama server (default: `14343`)
- `OLLAMA_URL`: URL of the Ollama server (default: `http://host.docker.internal:11434`)
- `SAFETY_MODEL`: Name of the safety (Llama-Guard) model to use (default: `meta-llama/Llama-Guard-3-1B`)
### Models