phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-30 07:39:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

update

Browse source
This commit is contained in:
Xi Yan 2024-10-29 19:48:11 -07:00
parent a096622166
commit e60793af11
1 changed files with 9 additions and 10 deletions
Download patch file Download diff file Expand all files Collapse all files

19
docs/source/getting_started/index.md
View file

@ -58,9 +58,9 @@ If so, we suggest:
### Quick Start Commands ### Quick Start Commands
#### Single-Node GPU (Local Inference) #### Single-Node GPU
##### Docker **Docker**
````{tab-set-code} ````{tab-set-code}
```{code-block} meta-reference-gpu ```{code-block} meta-reference-gpu
@ -72,7 +72,7 @@ $ cd distributions/tgi && docker compose up
``` ```
```` ````
##### Conda **Conda**
````{tab-set-code} ````{tab-set-code}
@ -88,8 +88,8 @@ $ cd distributions/tgi && llama stack run ./run.yaml
```` ````
#### Single-Node CPU/GPU (Local Inference) #### Single-Node CPU
##### Docker **Docker**
````{tab-set-code} ````{tab-set-code}
```{code-block} ollama ```{code-block} ollama
@ -98,7 +98,7 @@ $ cd distributions/ollama/cpu && docker compose up
```` ````
##### Conda **Conda**
````{tab-set-code} ````{tab-set-code}
```{code-block} ollama ```{code-block} ollama
@ -108,10 +108,9 @@ $ cd distributions/ollama && llama stack run ./run.yaml
```` ````
#### Single-Node CPU (Remote Inference) #### Single-Node CPU + Hosted Endpoint
##### Docker
**Docker**
````{tab-set-code} ````{tab-set-code}
```{code-block} together ```{code-block} together
@ -124,7 +123,7 @@ $ cd distributions/fireworks && docker compose up
```` ````
##### Conda **Conda**
````{tab-set-code} ````{tab-set-code}
```{code-block} together ```{code-block} together