phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Update README.md

Browse source
This commit is contained in:
Ishaan Jaff 2023-11-23 11:39:39 -08:00 • committed by GitHub
parent 276041e3bb
commit ed17e04bc2
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

5
README.md
View file

@ -116,7 +116,10 @@ print(response)
```
## OpenAI Proxy - ([Docs](https://docs.litellm.ai/docs/simple_proxy))
**If you want to use non-openai models in an openai code base**, you can use litellm proxy. Create a server to call 100+ LLMs (Huggingface/Bedrock/TogetherAI/etc) in the OpenAI ChatCompletions & Completions format
LiteLLM Proxy manages:
* Calling 100+ LLMs Huggingface/Bedrock/TogetherAI/etc. in the OpenAI ChatCompletions & Completions format
* Authentication & Spend Tracking Virtual Keys
* Load balancing - Routing between Multiple Models + Deployments of the same model
### Step 1: Start litellm proxy
```shell