remote vllm distro

This commit is contained in:
Ashwin Bharambe 2024-11-08 11:32:06 -08:00
parent ba82021d4b
commit 02c66b49fc
13 changed files with 188 additions and 18 deletions

View file

@ -144,7 +144,11 @@ docker compose down
:::{tab-item} ollama
```
$ cd llama-stack/distributions/ollama/cpu && docker compose up
$ cd llama-stack/distributions/ollama && docker compose up
# OR
$ cd llama-stack/distributions/ollama-gpu && docker compose up
```
You will see outputs similar to following ---