forked from phoenix/litellm-mirror
55 lines
No EOL
3.3 KiB
Markdown
55 lines
No EOL
3.3 KiB
Markdown
# OpenRouter
|
|
LiteLLM supports all the text / chat / vision models from [OpenRouter](https://openrouter.ai/docs)
|
|
|
|
<a target="_blank" href="https://colab.research.google.com/github/BerriAI/litellm/blob/main/cookbook/LiteLLM_OpenRouter.ipynb">
|
|
<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
|
|
</a>
|
|
|
|
## Usage
|
|
```python
|
|
import os
|
|
from litellm import completion
|
|
os.environ["OPENROUTER_API_KEY"] = ""
|
|
|
|
os.environ["OR_SITE_URL"] = "" # optional
|
|
os.environ["OR_APP_NAME"] = "" # optional
|
|
|
|
response = completion(
|
|
model="openrouter/google/palm-2-chat-bison",
|
|
messages=messages,
|
|
)
|
|
```
|
|
|
|
## OpenRouter Completion Models
|
|
|
|
🚨 LiteLLM supports ALL OpenRouter models, send `model=openrouter/<your-openrouter-model>` to send it to open router. See all openrouter models [here](https://openrouter.ai/models)
|
|
|
|
| Model Name | Function Call |
|
|
|---------------------------|-----------------------------------------------------|
|
|
| openrouter/openai/gpt-3.5-turbo | `completion('openrouter/openai/gpt-3.5-turbo', messages)` | `os.environ['OR_SITE_URL']`,`os.environ['OR_APP_NAME']`,`os.environ['OPENROUTER_API_KEY']` |
|
|
| openrouter/openai/gpt-3.5-turbo-16k | `completion('openrouter/openai/gpt-3.5-turbo-16k', messages)` | `os.environ['OR_SITE_URL']`,`os.environ['OR_APP_NAME']`,`os.environ['OPENROUTER_API_KEY']` |
|
|
| openrouter/openai/gpt-4 | `completion('openrouter/openai/gpt-4', messages)` | `os.environ['OR_SITE_URL']`,`os.environ['OR_APP_NAME']`,`os.environ['OPENROUTER_API_KEY']` |
|
|
| openrouter/openai/gpt-4-32k | `completion('openrouter/openai/gpt-4-32k', messages)` | `os.environ['OR_SITE_URL']`,`os.environ['OR_APP_NAME']`,`os.environ['OPENROUTER_API_KEY']` |
|
|
| openrouter/anthropic/claude-2 | `completion('openrouter/anthropic/claude-2', messages)` | `os.environ['OR_SITE_URL']`,`os.environ['OR_APP_NAME']`,`os.environ['OPENROUTER_API_KEY']` |
|
|
| openrouter/anthropic/claude-instant-v1 | `completion('openrouter/anthropic/claude-instant-v1', messages)` | `os.environ['OR_SITE_URL']`,`os.environ['OR_APP_NAME']`,`os.environ['OPENROUTER_API_KEY']` |
|
|
| openrouter/google/palm-2-chat-bison | `completion('openrouter/google/palm-2-chat-bison', messages)` | `os.environ['OR_SITE_URL']`,`os.environ['OR_APP_NAME']`,`os.environ['OPENROUTER_API_KEY']` |
|
|
| openrouter/google/palm-2-codechat-bison | `completion('openrouter/google/palm-2-codechat-bison', messages)` | `os.environ['OR_SITE_URL']`,`os.environ['OR_APP_NAME']`,`os.environ['OPENROUTER_API_KEY']` |
|
|
| openrouter/meta-llama/llama-2-13b-chat | `completion('openrouter/meta-llama/llama-2-13b-chat', messages)` | `os.environ['OR_SITE_URL']`,`os.environ['OR_APP_NAME']`,`os.environ['OPENROUTER_API_KEY']` |
|
|
| openrouter/meta-llama/llama-2-70b-chat | `completion('openrouter/meta-llama/llama-2-70b-chat', messages)` | `os.environ['OR_SITE_URL']`,`os.environ['OR_APP_NAME']`,`os.environ['OPENROUTER_API_KEY']` |
|
|
|
|
## Passing OpenRouter Params - transforms, models, route
|
|
|
|
Pass `transforms`, `models`, `route`as arguments to `litellm.completion()`
|
|
|
|
```python
|
|
import os
|
|
from litellm import completion
|
|
os.environ["OPENROUTER_API_KEY"] = ""
|
|
|
|
response = completion(
|
|
model="openrouter/google/palm-2-chat-bison",
|
|
messages=messages,
|
|
transforms = [""],
|
|
route= ""
|
|
)
|
|
``` |