mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-10-16 06:53:47 +00:00
remote vllm distro
This commit is contained in:
parent
ba82021d4b
commit
02c66b49fc
13 changed files with 188 additions and 18 deletions
|
@ -144,7 +144,11 @@ docker compose down
|
|||
|
||||
:::{tab-item} ollama
|
||||
```
|
||||
$ cd llama-stack/distributions/ollama/cpu && docker compose up
|
||||
$ cd llama-stack/distributions/ollama && docker compose up
|
||||
|
||||
# OR
|
||||
|
||||
$ cd llama-stack/distributions/ollama-gpu && docker compose up
|
||||
```
|
||||
|
||||
You will see outputs similar to following ---
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue