phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

add proxy key details to docs

Browse source
This commit is contained in:
Krrish Dholakia 2023-09-20 08:49:52 -07:00
parent 8094301424
commit 102fd83ea6
5 changed files with 23 additions and 14 deletions
Download patch file Download diff file Expand all files Collapse all files

8
docs/my-website/docs/providers/ai21.md
View file

@ -11,6 +11,10 @@ We provide a free $10 community-key for testing all providers on LiteLLM. You ca
import os
os.environ["AI21_API_KEY"] = "sk-litellm-7_NPZhMGxY2GoHC59LgbDw" # [OPTIONAL] replace with your ai21 key
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
### Sample Usage
@ -24,10 +28,6 @@ messages = [{"role": "user", "content": "Write me a poem about the blue sky"}]
completion(model="j2-light", messages=messages)
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
### AI21 Models

5
docs/my-website/docs/providers/anthropic.md
View file

@ -9,6 +9,11 @@ import os
os.environ["ANTHROPIC_API_KEY"] = "sk-litellm-7_NPZhMGxY2GoHC59LgbDw" # [OPTIONAL] replace with your anthropic key
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
## Supported Models for LiteLLM Key
These are the models that currently work with the "sk-litellm-.." keys.
## Sample Usage

4
docs/my-website/docs/providers/nlp_cloud.md
View file

@ -10,6 +10,10 @@ import os
os.environ["NLP_CLOUD_API_KEY"] = "sk-litellm-7_NPZhMGxY2GoHC59LgbDw" # [OPTIONAL] replace with your nlp cloud key
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
## Sample Usage

9
docs/my-website/docs/providers/openai.md
View file

@ -9,6 +9,10 @@ import os
os.environ["OPENAI_API_KEY"] = "sk-litellm-7_NPZhMGxY2GoHC59LgbDw" # [OPTIONAL] replace with your openai key
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
### Usage
```python
@ -24,11 +28,6 @@ messages = [{ "content": "Hello, how are you?","role": "user"}]
response = completion("gpt-3.5-turbo", messages)
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
### OpenAI Chat Completion Models
| Model Name | Function Call | Required OS Variables |

11
docs/my-website/docs/providers/togetherai.md
View file

@ -9,6 +9,12 @@ import os
os.environ["TOGETHERAI_API_KEY"] = "sk-litellm-7_NPZhMGxY2GoHC59LgbDw" # [OPTIONAL] replace with your together ai key
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
## Sample Usage
```python
@ -22,11 +28,6 @@ messages = [{"role": "user", "content": "Write me a poem about the blue sky"}]
completion(model="together_ai/togethercomputer/Llama-2-7B-32K-Instruct", messages=messages)
```
**Need a dedicated key?**
Email us @ krrish@berri.ai
[**See all supported models by the litellm api key**](../proxy_api.md#supported-models-for-litellm-key)
## Together AI Models
liteLLM supports `non-streaming` and `streaming` requests to all models on https://api.together.xyz/