phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-16 14:57:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

docs

Browse source
This commit is contained in:
Xi Yan 2024-10-30 10:45:23 -07:00
parent a8dc87b00b
commit 18d175e703
3 changed files with 38 additions and 105 deletions
Download patch file Download diff file Expand all files Collapse all files

15
docs/source/getting_started/distributions/fireworks.md
View file

@ -1,15 +1,18 @@
# Fireworks Distribution
The `llamastack/distribution-` distribution consists of the following provider configurations.
The `llamastack/distribution-fireworks` distribution consists of the following provider configurations.
| **API** | **Inference** | **Agents** | **Memory** | **Safety** | **Telemetry** |
|----------------- |--------------- |---------------- |-------------------------------------------------- |---------------- |---------------- |
| **Provider(s)** | remote::fireworks | meta-reference | meta-reference | meta-reference | meta-reference |
### Step 0. Prerequisite
- Make sure you have access to a fireworks API Key. You can get one by visiting [fireworks.ai](https://fireworks.ai/)
### Docker: Start the Distribution (Single Node CPU)
### Step 1. Start the Distribution (Single Node CPU)
#### (Option 1) Start Distribution Via Conda
> [!NOTE]
> This assumes you have an hosted endpoint at Fireworks with API Key.
@ -26,13 +29,11 @@ inference:
- provider_id: fireworks
provider_type: remote::fireworks
config:
url: https://api.fireworks.ai/inferenc
url: https://api.fireworks.ai/inference
api_key: <optional api key>
```
### Conda: llama stack run (Single Node CPU)
**Via Conda**
#### (Option 2) Start Distribution Via Conda
```bash
llama stack build --template fireworks --image-type conda
@ -41,7 +42,7 @@ llama stack run ./run.yaml
```
### Model Serving
### (Optional) Model Serving
Use `llama-stack-client models list` to chekc the available models served by Fireworks.
```