phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-16 14:57:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

tabs

Browse source
This commit is contained in:
Xi Yan 2024-10-30 11:13:01 -07:00
parent c2195a0b5c
commit c94fae5ab1
3 changed files with 224 additions and 20 deletions
Download patch file Download diff file Expand all files Collapse all files

9
docs/source/getting_started/distributions/fireworks.md
View file

@ -12,15 +12,12 @@ The `llamastack/distribution-fireworks` distribution consists of the following p
### Step 1. Start the Distribution (Single Node CPU)
#### (Option 1) Start Distribution Via Conda
#### (Option 1) Start Distribution Via Docker
> [!NOTE]
> This assumes you have an hosted endpoint at Fireworks with API Key.
```
$ cd distributions/fireworks
$ ls
compose.yaml run.yaml
$ docker compose up
$ cd distributions/fireworks && docker compose up
```
Make sure in you `run.yaml` file, you inference provider is pointing to the correct Fireworks URL server endpoint. E.g.
@ -44,7 +41,7 @@ llama stack run ./run.yaml
### (Optional) Model Serving
Use `llama-stack-client models list` to chekc the available models served by Fireworks.
Use `llama-stack-client models list` to check the available models served by Fireworks.
```
$ llama-stack-client models list
+------------------------------+------------------------------+---------------+------------+