phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-30 07:39:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

content

Browse source
This commit is contained in:
Xi Yan 2024-10-29 14:19:49 -07:00
parent 4d8bfcea1b
commit e4c503d8f4
1 changed files with 9 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

12
docs/source/getting_started/index.md
View file

@ -8,7 +8,12 @@ To see more example apps built using Llama Stack, see [llama-stack-apps](https:/
## Starting Up Llama Stack Server ## Starting Up Llama Stack Server
### Decide your ```{toctree}
:maxdepth: 2
distributions/index
```
### Decide Your Build Type
There are two ways to start a Llama Stack: There are two ways to start a Llama Stack:
- **Docker**: we provide a number of pre-built Docker containers allowing you to get started instantly. If you are focused on application development, we recommend this option. - **Docker**: we provide a number of pre-built Docker containers allowing you to get started instantly. If you are focused on application development, we recommend this option.
@ -43,6 +48,7 @@ If so, we suggest:
- [Docker]() - [Docker]()
- [Conda]() - [Conda]()
## Testing with client ## Testing with client
Once the server is setup, we can test it with a client to see the example outputs by . This will run the chat completion client and query the distribution’s `/inference/chat_completion` API. Send a POST request to the server: Once the server is setup, we can test it with a client to see the example outputs by . This will run the chat completion client and query the distribution’s `/inference/chat_completion` API. Send a POST request to the server:
@ -73,8 +79,8 @@ You can find more example scripts with client SDKs to talk with the Llama Stack
```{toctree} ```{toctree}
:maxdepth: 2 :hidden:
:maxdepth: 1
developer_cookbook developer_cookbook
distributions/index
``` ```