phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

docs

Browse source
This commit is contained in:
ishaan-jaff 2023-09-19 11:05:48 -07:00
parent 85862c1066
commit 5b2f952035
1 changed files with 10 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

16
docs/my-website/docs/providers/petals.md
View file

@ -1,6 +1,12 @@
# Petals
Petals: https://github.com/bigscience-workshop/petals
## Pre-Requisites
Ensure you have `petals` installed
```shell
pip install git+https://github.com/bigscience-workshop/petals
```
## Usage
Ensure you add `petals/` as a prefix for all petals LLMs. This sets the custom_llm_provider to petals
@ -16,12 +22,10 @@ print(response)
```
### Model Details
| Model Name | Function Call |
|------------------|--------------------------------------------|
| StableBeluga | ```python
| completion(
| model="petals/petals-team/StableBeluga2",
| messages=messages
| )
| ``` |
| StableBeluga | `completion('petals/petals-team/StableBeluga2', messages)` |