Commit graph

5147 commits

Author SHA1 Message Date
Krrish Dholakia
901b343519 fix(proxy_server.py): support smtp email auth
previously was a hard resend package dependency. removed in favor of allowing any smtp server connection (including resend)
2024-01-02 22:22:19 +05:30
Krish Dholakia
6662ddd211 Merge pull request #1300 from asedmammad/patch-1
fix(proxy_server.py) Check when '_hidden_params' is None
2024-01-02 21:34:09 +05:30
Ased Mammad
a0611430dd fix(proxy_server.py) Check when '_hidden_params' is None 2024-01-02 19:04:51 +03:30
Krrish Dholakia
5f5a6eb7bc feat(proxy_server.py): add slack alerting to proxy server
add alerting for calls hanging, failing and db read/writes failing

https://github.com/BerriAI/litellm/issues/1298
2024-01-02 17:45:18 +05:30
Krish Dholakia
4501b12923 Update README.md 2024-01-02 17:22:44 +05:30
ishaan-jaff
7d9ff31a95 (feat) proxy swagger - make admin link clickable 2024-01-02 17:04:32 +05:30
ishaan-jaff
c33a625b48 (docs) xinference on proxy 2024-01-02 16:57:25 +05:30
ishaan-jaff
3a555657d4 (docs) proxy - using xinference 2024-01-02 16:55:10 +05:30
ishaan-jaff
7458957d8e (test) xinference on litellm router 2024-01-02 16:51:08 +05:30
Ishaan Jaff
a0c519b11f Update README.md - add xinference [Xorbits Inference] 2024-01-02 16:38:35 +05:30
ishaan-jaff
1f4a328131 (test) xinference embeddings 2024-01-02 15:41:51 +05:30
ishaan-jaff
c395c82cef (docs) xinference embedding 2024-01-02 15:39:25 +05:30
ishaan-jaff
0e8809abf2 (feat) add xinference as an embedding provider 2024-01-02 15:32:26 +05:30
ishaan-jaff
122cfdb177 (docs) passing user config 2024-01-02 14:43:02 +05:30
Krrish Dholakia
d4da63800e fix(utils.py): support token counting for gpt-4-vision models 2024-01-02 14:41:42 +05:30
ishaan-jaff
b2e2fe1804 bump: version 1.16.9 → 1.16.10 2024-01-02 14:39:12 +05:30
ishaan-jaff
942bff6fd2 (docs) passing user_config to completion 2024-01-02 14:19:44 +05:30
ishaan-jaff
4db20ef478 (test) proxy - pass user_config 2024-01-02 14:15:03 +05:30
ishaan-jaff
2adcf8c762 (types) routerConfig 2024-01-02 14:14:29 +05:30
ishaan-jaff
81b30fa394 (docs) pass user config to proxy / router 2024-01-02 14:14:14 +05:30
ishaan-jaff
2cbbfa72f1 (feat) add Router init Pydantic Type 2024-01-02 13:30:24 +05:30
Krrish Dholakia
c79609e1b2 build(model_prices_and_context_window.json): add azure gpt-4-turbo, gpt-4-turbo-vision, dall-e-2 and dall-e-3 pricing 2024-01-02 12:50:15 +05:30
ishaan-jaff
f7fc4da850 (feat) litellm add types for completion, embedding request 2024-01-02 12:27:08 +05:30
ishaan-jaff
e1c121737c (feat) use - user router for aembedding 2024-01-02 12:27:08 +05:30
Krrish Dholakia
de1d51e3de fix(lowest_tpm_rpm.py): handle null case for text/message input 2024-01-02 12:24:29 +05:30
ishaan-jaff
4ef7c028ab (docs) router- init params 2024-01-02 12:14:32 +05:30
ishaan-jaff
4f1df08f54 (test) sustained load test proxy 2024-01-02 12:10:34 +05:30
ishaan-jaff
7fca998026 (test) proxy - use, user provided model_list 2024-01-02 12:10:34 +05:30
ishaan-jaff
dc5984c41d (feat) proxy - use user_config for /chat/compeltions 2024-01-02 12:10:34 +05:30
Krrish Dholakia
01c042fdc6 feat(router.py): add support for retry/fallbacks for async embedding calls 2024-01-02 11:54:28 +05:30
Krrish Dholakia
b82e20e517 fix(router.py): fix model name passed through 2024-01-02 11:15:30 +05:30
Krrish Dholakia
4f988058a1 refactor(test_router_caching.py): move tpm/rpm routing tests to separate file 2024-01-02 11:10:11 +05:30
ishaan-jaff
163b78fef1 (test) bedrock-test passing boto3 client 2024-01-02 10:23:28 +05:30
ishaan-jaff
6672591198 (fix) init_bedrock_client 2024-01-01 22:48:56 +05:30
Ishaan Jaff
16a6ffc3b2 Rename Dockerfile_alpine to Dockerfile.alpine 2024-01-01 22:11:11 +05:30
ishaan-jaff
1f40ded3fa (feat) build-push alpine Dockerfile 2024-01-01 22:09:23 +05:30
Ishaan Jaff
62e384dc84 Create Dockerfile_alpine 2024-01-01 22:01:44 +05:30
Ishaan Jaff
0e870c2746 (test) fix test_get_model_cost_map.py 2024-01-01 21:58:48 +05:30
Krrish Dholakia
aa37c64539 build(model_prices_and_context_window.json): add openai dall-e-2 and dall-e-3 pricing 2024-01-01 21:41:09 +05:30
Krrish Dholakia
4eae0c9a0d fix(router.py): correctly raise no model available error
https://github.com/BerriAI/litellm/issues/1289
2024-01-01 21:22:42 +05:30
Krrish Dholakia
34097afe2c bump: version 1.16.8 → 1.16.9 2024-01-01 20:47:17 +05:30
Krrish Dholakia
940e04f552 docs(ui.md): add docs on self serve ui flow 2024-01-01 18:25:52 +05:30
Ishaan Jaff
41491b2153 Merge pull request #1290 from fcakyon/patch-1
fix typos & add missing names for azure models
2024-01-01 17:58:17 +05:30
Krrish Dholakia
4a9477d4bc fix(ui/admin.py): handles trailing '/' case 2024-01-01 17:49:54 +05:30
Krrish Dholakia
4c4e8d0290 build(user.py): fix page param read issue 2024-01-01 17:25:52 +05:30
Krrish Dholakia
b73e6317b2 build(ui/): Add dockerfile for ui 2024-01-01 17:18:44 +05:30
Krrish Dholakia
81bb382f98 fix(proxy_server.py): enabling user auth via ui
https://github.com/BerriAI/litellm/issues/1231
2024-01-01 17:14:24 +05:30
fatih
49a925713b Update model_prices_and_context_window.json 2024-01-01 14:13:00 +03:00
fatih
783f5378f4 update azure turbo namings 2024-01-01 13:03:08 +03:00
fatih
1bca55d2c7 fix a typo 2024-01-01 11:57:48 +03:00