phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 02:34:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

update proxy docs

Browse source
This commit is contained in:
Krrish Dholakia 2023-09-17 06:01:00 -07:00
parent 4daaa1cf91
commit 8fb856047e
1 changed files with 12 additions and 10 deletions
Download patch file Download diff file Expand all files Collapse all files

22
docs/my-website/docs/proxy_api.md
View file

@ -55,19 +55,21 @@ print(response)
**Note**: You will need to clone and modify the Github repo, until [this PR is merged.](https://github.com/KillianLucas/open-interpreter/pull/288)
In `interpreter.py` set,
```python
os.environ["OPENAI_API_KEY"] = "openinterpreter-key"
litellm.api_base = "https://proxy.litellm.ai"
```
git clone https://github.com/krrishdholakia/open-interpreter-litellm-fork
```
To run it do:
```
poetry build
and change the model on [this line](https://github.com/KillianLucas/open-interpreter/blob/f803d0d7a545edabd541943145a2a60beaf604e4/interpreter/interpreter.py#L342C10-L342C10), to:
```python
# call gpt-4
self.model = "openai/gpt-4" # 👈 always add 'openai/' in front of the model name
# call gpt-4 - always add 'litellm_proxy/' in front of the model name
poetry run interpreter --model litellm_proxy/gpt-4
# call togethercomputer/llama-2-70b-chat
self.model = "openai/togethercomputer/llama-2-70b-chat" # 👈 always add 'openai/' in front of the model name
# call llama-70b - always add 'litellm_proxy/' in front of the model name
poetry run interpreter --model litellm_proxy/togethercomputer/llama-2-70b-chat
# call claude-2 - always add 'litellm_proxy/' in front of the model name
poetry run interpreter --model litellm_proxy/claude-2
```
And that's it!