forked from phoenix/litellm-mirror
add open interpreter community api to docs
This commit is contained in:
parent
09fd39d80f
commit
68e683e7ff
2 changed files with 53 additions and 0 deletions
52
docs/my-website/docs/proxy_api.md
Normal file
52
docs/my-website/docs/proxy_api.md
Normal file
|
@ -0,0 +1,52 @@
|
|||
# Open Interpreter LLM API
|
||||
|
||||
This is an api built for the Open Interpreter community. It provides access to:
|
||||
* OpenAI models
|
||||
* gpt-4
|
||||
* gpt-3.5-turbo
|
||||
* gpt-3.5-turbo-16k
|
||||
* Llama2 models
|
||||
* togethercomputer/llama-2-70b-chat
|
||||
* togethercomputer/llama-2-70b
|
||||
* togethercomputer/LLaMA-2-7B-32K
|
||||
* togethercomputer/Llama-2-7B-32K-Instruct
|
||||
* togethercomputer/llama-2-7b
|
||||
* togethercomputer/CodeLlama-34b
|
||||
* WizardLM/WizardCoder-Python-34B-V1.0
|
||||
* NousResearch/Nous-Hermes-Llama2-13b
|
||||
* Falcon models
|
||||
* togethercomputer/falcon-40b-instruct
|
||||
* togethercomputer/falcon-7b-instruct
|
||||
* Jurassic/AI21 models
|
||||
* j2-ultra
|
||||
* j2-mid
|
||||
* j2-light
|
||||
* NLP Cloud models
|
||||
* dolpin
|
||||
* chatdolphin
|
||||
* Anthropic models
|
||||
* claude-2
|
||||
* claude-instant-v1
|
||||
|
||||
|
||||
Here's how to call it:
|
||||
|
||||
**Note**: You will need to clone and modify the Github repo, until [this PR is merged.](https://github.com/KillianLucas/open-interpreter/pull/288)
|
||||
|
||||
In `interpreter.py` set,
|
||||
```
|
||||
os.environ["OPENAI_API_KEY"] = "openinterpreter-key"
|
||||
litellm.api_base = "https://proxy.litellm.ai"
|
||||
```
|
||||
|
||||
and change the model on [this line](https://github.com/KillianLucas/open-interpreter/blob/f803d0d7a545edabd541943145a2a60beaf604e4/interpreter/interpreter.py#L342C10-L342C10), to:
|
||||
```
|
||||
self.model = "openai/gpt-4" # 👈 always add 'openai/' in front of the model name
|
||||
```
|
||||
|
||||
And that's it!
|
||||
|
||||
Now you can call any model you like!
|
||||
|
||||
|
||||
Want us to add more models? [Let us know!](https://github.com/BerriAI/litellm/issues/new/choose)
|
|
@ -80,6 +80,7 @@ const sidebars = {
|
|||
"exception_mapping",
|
||||
'debugging/local_debugging',
|
||||
"budget_manager",
|
||||
"proxy_api",
|
||||
{
|
||||
type: 'category',
|
||||
label: 'Tutorials',
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue