This commit is contained in:
Sébastien Han 2025-07-24 22:45:41 +02:00 committed by GitHub
commit 0edcb5cfff
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
11 changed files with 603 additions and 287 deletions

View file

@ -186,6 +186,35 @@ docker run \
--port $LLAMA_STACK_PORT
```
To run the distribution with a Postgres store, you can use the following command to override the entrypoint:
```bash
docker run \
-it \
--pull always \
-p $LLAMA_STACK_PORT:$LLAMA_STACK_PORT \
-e OPENAI_API_KEY=your_openai_key \
-e FIREWORKS_API_KEY=your_fireworks_key \
-e TOGETHER_API_KEY=your_together_key \
-e POSTGRES_HOST=your_postgres_host \
-e POSTGRES_PORT=your_postgres_port \
-e POSTGRES_DB=your_postgres_db \
-e POSTGRES_USER=your_postgres_user \
-e POSTGRES_PASSWORD=your_postgres_password \
--entrypoint python \
llamastack/distribution-starter \
-m llama_stack.distribution.server.server \
--config run-with-postgres-store.yaml
```
Postgres environment variables:
- `POSTGRES_HOST`: Postgres host (default: `localhost`)
- `POSTGRES_PORT`: Postgres port (default: `5432`)
- `POSTGRES_DB`: Postgres database name (default: `llamastack`)
- `POSTGRES_USER`: Postgres username (default: `llamastack`)
- `POSTGRES_PASSWORD`: Postgres password (default: `llamastack`)
### Via Conda or venv
Ensure you have configured the starter distribution using the environment variables explained above.