Commit graph

7255 commits

Author SHA1 Message Date
BeatrixCohere
ecd6037e15 Add request source 2024-05-21 10:12:57 +01:00
Ishaan Jaff
f20184cd49 (ci/cd) run again 2024-05-20 18:50:17 -07:00
Ishaan Jaff
e8a3916d46
Merge pull request #3751 from BerriAI/litellm_router_abatch_completion_one_model
[FEAT] - add litellm.Router - `abatch_completion_one_model_multiple_requests`
2024-05-20 18:42:54 -07:00
Ishaan Jaff
829ca84f07
Merge pull request #3750 from BerriAI/litellm_raise_exception_when_deleting_updating_team
[Fix] - raise Exception when trying to update/delete a non-existent team
2024-05-20 18:42:27 -07:00
Krish Dholakia
707cf24472
Merge branch 'main' into litellm_webhook_support 2024-05-20 18:41:58 -07:00
Ishaan Jaff
ad91bff6f7
Merge pull request #3749 from BerriAI/litellm_raise_404_when_team_not_exist
[Fix] - raise 404 from `/team/info`  when team does not exist
2024-05-20 17:52:43 -07:00
Ishaan Jaff
92a4df00d4 fix add doc string for abatch_completion_one_model_multiple_requests 2024-05-20 17:51:08 -07:00
Krish Dholakia
c6bb6e325b
Merge pull request #3740 from BerriAI/litellm_return_rejected_response
feat(proxy_server.py): allow admin to return rejected response as string to user
2024-05-20 17:48:21 -07:00
Ishaan Jaff
5be966dc09 feat - add abatch_completion_one_model_multiple_requests 2024-05-20 17:47:25 -07:00
Krish Dholakia
d69ad99e76
Merge pull request #3657 from phact/patch-4
Another dictionary changed size during iteration error
2024-05-20 17:45:50 -07:00
Krrish Dholakia
9d815be0b5 fix(proxy_server.py): fix error string 2024-05-20 17:37:41 -07:00
Ishaan Jaff
367d86047c fix - raise Exception when trying to update/delete a non-existtent team 2024-05-20 17:36:08 -07:00
Ishaan Jaff
f574127bc4 fix - raise 404 when team does not exist 2024-05-20 17:14:03 -07:00
Krrish Dholakia
9804eabcd5 test(test_alerting.py): fix testing 2024-05-20 17:01:34 -07:00
Krrish Dholakia
867f9300e3 fix(slack_alerting.py): cleanup webhook event 2024-05-20 16:55:01 -07:00
Ishaan Jaff
8413fdf4c7
Merge branch 'main' into litellm_standardize_slack_exception_msg_format 2024-05-20 16:39:41 -07:00
Ishaan Jaff
7fad52b7c8
Merge pull request #3745 from BerriAI/litellm_fix_slack_alerting_bug
fix divide by 0 bug on slack alerting
2024-05-20 16:38:29 -07:00
Ishaan Jaff
25fae37efc
Merge pull request #3716 from BerriAI/litellm_set_cooldown_time_based_on_exception_header
[Feat] Router/ Proxy - set cooldown_time based on Azure exception headers
2024-05-20 16:34:12 -07:00
Ishaan Jaff
f11de863f6 fix - standardize format of exceptions occuring on slack alerts 2024-05-20 16:29:16 -07:00
Ishaan Jaff
8263d15ca3 fix - standardize slack alerting format 2024-05-20 16:26:11 -07:00
Ishaan Jaff
5d24b47d2b fix standardize llm exception alert to msg: value 2024-05-20 16:23:48 -07:00
Ishaan Jaff
0ddaf320ef fix test - retry claude-3 image error 3 times 2024-05-20 16:17:09 -07:00
Ishaan Jaff
498bfa9a4c fix - revert check_request_disconnection 2024-05-20 15:43:29 -07:00
Krrish Dholakia
cba2b729b2 test(test_alerting.py): testing fixes 2024-05-20 15:37:35 -07:00
Krrish Dholakia
da0e5d1b8d feat(slack_alerting.py): support webhook for budget alerts
Closes https://github.com/BerriAI/litellm/issues/3743
2024-05-20 15:30:56 -07:00
Ishaan Jaff
b5f8c63875 try/except deployment metrics error 2024-05-20 15:03:04 -07:00
Ishaan Jaff
f417495b7b fix - only adding alerting callbacks when alerting is on 2024-05-20 14:59:06 -07:00
Ishaan Jaff
02fc507b01 fix divide by 0 bug 2024-05-20 14:26:30 -07:00
Ishaan Jaff
91a89eb4ed
Merge pull request #3739 from BerriAI/litellm_add_imagen_support
[FEAT] Async VertexAI Image Generation
2024-05-20 14:14:43 -07:00
Ishaan Jaff
1deb274d3a
Merge pull request #3742 from BerriAI/litellm_enforce_sso
[Feat] Enforce user has a valid license when using SSO on LiteLLM Proxy
2024-05-20 14:07:23 -07:00
Ishaan Jaff
f3eb832593 fix vertex httpx client 2024-05-20 13:43:54 -07:00
Krrish Dholakia
1384ee3c57 fix(slack_alerting.py): prevent alert spam within 24 hr period for budget alerts
Closes https://github.com/BerriAI/litellm/issues/3738
2024-05-20 13:35:19 -07:00
Ishaan Jaff
622e241e18
Merge pull request #3711 from hmcp22/add_gemini_base64_image_support
Adding decoding of base64 image data for gemini pro 1.5
2024-05-20 13:34:39 -07:00
Ishaan Jaff
518db13982 add parameter mapping with vertex ai 2024-05-20 13:28:20 -07:00
Ishaan Jaff
2c25bfa8df fix vertex ai import 2024-05-20 13:13:19 -07:00
Ishaan Jaff
11c9780ff0 fix self.async_handler 2024-05-20 13:11:10 -07:00
Ishaan Jaff
d956020470 fix error on enforce sso 2024-05-20 13:02:56 -07:00
Ishaan Jaff
561b00283c feat - enforce sso on Admin UI 2024-05-20 12:54:08 -07:00
Ishaan Jaff
8e730f57b8 only run check_request_disconnection logic for 10 mins 2024-05-20 12:39:03 -07:00
Krrish Dholakia
b41f30ca60 fix(proxy_server.py): fixes for making rejected responses work with streaming 2024-05-20 12:32:19 -07:00
Ishaan Jaff
b60a098251 docs - update openapi swagger docs 2024-05-20 12:26:42 -07:00
Ishaan Jaff
1fe3900800 fix python 3.8 2024-05-20 12:23:27 -07:00
Ishaan Jaff
dabaf5f297 fix python 3.8 Tuple 2024-05-20 12:21:02 -07:00
Ishaan Jaff
571d4cf569 test - fix test_aimage_generation_vertex_ai 2024-05-20 12:10:28 -07:00
Krrish Dholakia
f11f207ae6 feat(proxy_server.py): refactor returning rejected message, to work with error logging
log the rejected request as a failed call to langfuse/slack alerting
2024-05-20 11:14:36 -07:00
Ishaan Jaff
6ddc9873e5 test vertex image gen test 2024-05-20 11:14:16 -07:00
Ishaan Jaff
91f8443381 fix add debug to vertex httpx image 2024-05-20 11:11:14 -07:00
Ishaan Jaff
d50d552e5a fix python 3.8 import 2024-05-20 11:03:28 -07:00
Ishaan Jaff
655478e8dc fix python3.8 error 2024-05-20 10:55:10 -07:00
Ishaan Jaff
2da89a0c8e fix vertex test 2024-05-20 10:51:25 -07:00