phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-28 04:04:31 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(docs) replicate deployments

Browse source
This commit is contained in:
ishaan-jaff 2023-11-09 18:08:59 -08:00
parent c2b263e66d
commit ff9233879e
1 changed files with 11 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

13
docs/my-website/docs/providers/replicate.md
View file

@ -8,11 +8,9 @@ import os
os.environ["REPLICATE_API_KEY"] = "" os.environ["REPLICATE_API_KEY"] = ""
``` ```
### Example Call ### Example Call
```python ```python
# !pip install litellm
from litellm import completion from litellm import completion
import os import os
## set ENV variables ## set ENV variables
@ -25,6 +23,17 @@ response = completion(
) )
``` ```
### Example - Calling Replicate Deployments
Calling a [deployed replicate LLM](https://replicate.com/deployments)
Add the `replicate/deployments/` prefix to your model, so litellm will call the `deployments` endpoint. This will call `ishaan-jaff/ishaan-mistral` deployment on replicate
```python
response = completion(
model="replicate/deployments/ishaan-jaff/ishaan-mistral",
messages= [{ "content": "Hello, how are you?","role": "user"}]
)
```
### Replicate Models ### Replicate Models
liteLLM supports all replicate LLMs liteLLM supports all replicate LLMs