diff --git a/docs/my-website/docs/providers/petals.md b/docs/my-website/docs/providers/petals.md index cd1b3075c..e7563319e 100644 --- a/docs/my-website/docs/providers/petals.md +++ b/docs/my-website/docs/providers/petals.md @@ -1,6 +1,12 @@ # Petals Petals: https://github.com/bigscience-workshop/petals +## Pre-Requisites +Ensure you have `petals` installed +```shell +pip install git+https://github.com/bigscience-workshop/petals +``` + ## Usage Ensure you add `petals/` as a prefix for all petals LLMs. This sets the custom_llm_provider to petals @@ -16,12 +22,10 @@ print(response) ``` ### Model Details + | Model Name | Function Call | |------------------|--------------------------------------------| -| StableBeluga | ```python - | completion( - | model="petals/petals-team/StableBeluga2", - | messages=messages - | ) - | ``` | +| StableBeluga | `completion('petals/petals-team/StableBeluga2', messages)` | + +