phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

Update README.md

Browse source
This commit is contained in:
Krish Dholakia 2023-12-25 07:35:31 +05:30 • committed by GitHub
parent 402b2e5733
commit bedcd22f40
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 0 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

1
README.md
View file

@ -27,7 +27,6 @@
LiteLLM manages LiteLLM manages
- Translating inputs to the provider's `completion` and `embedding` endpoints - Translating inputs to the provider's `completion` and `embedding` endpoints
- Guarantees [consistent output](https://docs.litellm.ai/docs/completion/output), text responses will always be available at `['choices'][0]['message']['content']` - Guarantees [consistent output](https://docs.litellm.ai/docs/completion/output), text responses will always be available at `['choices'][0]['message']['content']`
- Exception mapping - common exceptions across providers are mapped to the OpenAI exception types.
- Load-balance across multiple deployments (e.g. Azure/OpenAI) - `Router` **1k+ requests/second** - Load-balance across multiple deployments (e.g. Azure/OpenAI) - `Router` **1k+ requests/second**
# OpenAI Proxy - ([Docs](https://docs.litellm.ai/docs/simple_proxy)) # OpenAI Proxy - ([Docs](https://docs.litellm.ai/docs/simple_proxy))