phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-24 18:24:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

doc update

Browse source
This commit is contained in:
Krrish Dholakia 2023-09-18 14:27:07 -07:00
parent e6a022ea9e
commit f2695b9085
1 changed files with 27 additions and 24 deletions
Download patch file Download diff file Expand all files Collapse all files

51
docs/my-website/docs/proxy_api.md
View file

@ -3,6 +3,33 @@ import TokenGen from '../src/components/TokenGen.js'
# 🚨 LITELLM API (Access Claude-2/Llama2-70b/etc.)
Use this if you're trying to add support for new LLMs and need access for testing:
Here's how to call it:
## Step 1: Save your LiteLLM API Key
This is your unique LiteLLM API Key. Save this for later use.
<TokenGen/>
## Step 2: Test a new LLM
Now let's test if claude-2 is working in our code
```
from litellm import completion
import os
# set env var
os.environ["ANTHROPIC_API_KEY"] = "sk-litellm-1234" # 👈 replace with your unique key
messages = [{"role": "user", "content": "Hey, how's it going?"}]
response = completion(model="claude-2", messages=messages)
print(response)
```
## Supported Models
* OpenAI models
* gpt-4
* gpt-3.5-turbo
@ -31,30 +58,6 @@ Use this if you're trying to add support for new LLMs and need access for testin
* claude-instant-v1
Here's how to call it:
## Step 1: Save your LiteLLM API Key
This is your unique LiteLLM API Key. Save this for later use.
<TokenGen/>
## Step 2: Test a new LLM
Now let's test if claude-2 is working in our code
```
from litellm import completion
import os
# set env var
os.environ["ANTHROPIC_API_KEY"] = "sk-litellm-1234" # 👈 replace with your unique key
messages = [{"role": "user", "content": "Hey, how's it going?"}]
response = completion(model="claude-2", messages=messages)
print(response)
```
## For OpenInterpreter
This was initially built for the Open Interpreter community. If you're trying to use this feature in there, here's how you can do it:
**Note**: You will need to clone and modify the Github repo, until [this PR is merged.](https://github.com/KillianLucas/open-interpreter/pull/288)