phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-29 15:23:51 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

tab format

Browse source
This commit is contained in:
Xi Yan 2024-10-29 19:44:00 -07:00
parent 7b4004c0b1
commit a096622166
1 changed files with 52 additions and 25 deletions
Download patch file Download diff file Expand all files Collapse all files

77
docs/source/getting_started/index.md
View file

@ -58,61 +58,88 @@ If so, we suggest:
### Quick Start Commands
#### Docker
#### Single-Node GPU (Local Inference)
##### Docker
````{tab-set-code}
```{code-block} distribution-meta-reference-gpu
```{code-block} meta-reference-gpu
$ cd distributions/meta-reference-gpu && docker compose up
```
```{code-block} distribution-tgi
```{code-block} tgi
$ cd distributions/tgi && docker compose up
```
```{code-block} distribution-ollama
$ cd distributions/ollama && docker compose up
````
##### Conda
````{tab-set-code}
```{code-block} meta-reference-gpu
$ llama stack build --template meta-reference-gpu --image-type conda
$ cd distributions/meta-reference-gpu && llama stack run ./run.yaml
```
```{code-block} distribution-together
```{code-block} tgi
$ llama stack build --template tgi --image-type conda
$ cd distributions/tgi && llama stack run ./run.yaml
```
````
#### Single-Node CPU/GPU (Local Inference)
##### Docker
````{tab-set-code}
```{code-block} ollama
$ cd distributions/ollama/cpu && docker compose up
```
````
##### Conda
````{tab-set-code}
```{code-block} ollama
$ llama stack build --template ollama --image-type conda
$ cd distributions/ollama && llama stack run ./run.yaml
```
````
#### Single-Node CPU (Remote Inference)
##### Docker
````{tab-set-code}
```{code-block} together
$ cd distributions/together && docker compose up
```
```{code-block} distribution-fireworks
```{code-block} fireworks
$ cd distributions/fireworks && docker compose up
```
````
#### Conda
##### Conda
````{tab-set-code}
```{code-block} distribution-meta-reference-gpu
$ llama stack build --template meta-reference-gpu --image-type conda
$ cd distributions/meta-reference-gpu && llama stack run ./run.yaml
```
```{code-block} distribution-tgi
$ llama stack build --template tgi --image-type conda
$ cd distributions/tgi && llama stack run ./run.yaml
```
```{code-block} distribution-ollama
$ llama stack build --template ollama --image-type conda
$ cd distributions/ollama && llama stack run ./run.yaml
```
```{code-block} distribution-together
```{code-block} together
$ llama stack build --template together --image-type conda
$ cd distributions/together && llama stack run ./run.yaml
```
```{code-block} distribution-fireworks
```{code-block} fireworks
$ llama stack build --template fireworks --image-type conda
$ cd distributions/fireworks && llama stack run ./run.yaml
```
````
## Build Your Llama Stack App
### chat_completion sanity test