phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

(docs) perplexity ai provider

Browse source
This commit is contained in:
ishaan-jaff 2023-10-19 10:02:39 -07:00
parent ba0fa553b4
commit 8f13f376e4
2 changed files with 57 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

56
docs/my-website/docs/providers/perplexity.md Normal file
View file

@ -0,0 +1,56 @@
# Perplexity AI (pplx-api)
https://www.perplexity.ai
## API Key
```python
# env variable
os.environ['PERPLEXITYAI_API_KEY']
```
## Sample Usage
```python
from litellm import completion
import os
os.environ['PERPLEXITYAI_API_KEY'] = ""
response = completion(
model="mistral-7b-instruct",
messages=messages,
api_base="https://api.perplexity.ai"
)
print(response)
```
## Sample Usage - Streaming
```python
from litellm import completion
import os
os.environ['PERPLEXITYAI_API_KEY'] = ""
response = completion(
model="mistral-7b-instruct",
messages=messages,
api_base="https://api.perplexity.ai",
stream=True
)
for chunk in response:
print(chunk)
```
## Supported Models
All models listed here https://docs.perplexity.ai/docs/model-cards are supported
| Model Name | Function Call |
|--------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| codellama-34b-instruct | `completion(model="codellama-34b-instruct", messages, api_base="https://api.perplexity.ai")` |
| llama-2-13b-chat | `completion(model="llama-2-13b-chat", messages, api_base="https://api.perplexity.ai")` |
| llama-2-70b-chat | `completion(model="llama-2-70b-chat", messages, api_base="https://api.perplexity.ai")` |
| mistral-7b-instruct | `completion(model="mistral-7b-instruct", messages, api_base="https://api.perplexity.ai")` |
| replit-code-v1.5-3b | `completion(model="replit-code-v1.5-3b", messages, api_base="https://api.perplexity.ai")` |

1
docs/my-website/sidebars.js
View file

@ -66,6 +66,7 @@ const sidebars = {
"providers/anthropic", "providers/anthropic",
"providers/aws_sagemaker", "providers/aws_sagemaker",
"providers/bedrock", "providers/bedrock",
"providers/perplexity",
"providers/vllm", "providers/vllm",
"providers/deepinfra", "providers/deepinfra",
"providers/ai21", "providers/ai21",