Commit graph

7258 commits

Author SHA1 Message Date
Krish Dholakia
c0e43a7296 Merge pull request #3412 from sumanth13131/usage-based-routing-ttl-on-cache
usage-based-routing-ttl-on-cache
2024-05-21 07:58:41 -07:00
Ishaan Jaff
2e6807611a (ci/cd) run again 2024-05-20 18:50:17 -07:00
Ishaan Jaff
63b7bac927 Merge pull request #3751 from BerriAI/litellm_router_abatch_completion_one_model
[FEAT] - add litellm.Router - `abatch_completion_one_model_multiple_requests`
2024-05-20 18:42:54 -07:00
Ishaan Jaff
383c928d59 Merge pull request #3750 from BerriAI/litellm_raise_exception_when_deleting_updating_team
[Fix] - raise Exception when trying to update/delete a non-existent team
2024-05-20 18:42:27 -07:00
Krish Dholakia
f3a47e4b1a Merge branch 'main' into litellm_webhook_support 2024-05-20 18:41:58 -07:00
Ishaan Jaff
f1dd893e83 Merge pull request #3749 from BerriAI/litellm_raise_404_when_team_not_exist
[Fix] - raise 404 from `/team/info`  when team does not exist
2024-05-20 17:52:43 -07:00
Ishaan Jaff
ef9372ce00 fix add doc string for abatch_completion_one_model_multiple_requests 2024-05-20 17:51:08 -07:00
Krish Dholakia
db77e41833 Merge pull request #3740 from BerriAI/litellm_return_rejected_response
feat(proxy_server.py): allow admin to return rejected response as string to user
2024-05-20 17:48:21 -07:00
Ishaan Jaff
13c787f9b5 feat - add abatch_completion_one_model_multiple_requests 2024-05-20 17:47:25 -07:00
Krish Dholakia
dc8f238449 Merge pull request #3657 from phact/patch-4
Another dictionary changed size during iteration error
2024-05-20 17:45:50 -07:00
Krrish Dholakia
c6b4ad247b fix(proxy_server.py): fix error string 2024-05-20 17:37:41 -07:00
Ishaan Jaff
df89da8573 fix - raise Exception when trying to update/delete a non-existtent team 2024-05-20 17:36:08 -07:00
Ishaan Jaff
f94349297c fix - raise 404 when team does not exist 2024-05-20 17:14:03 -07:00
Krrish Dholakia
1b8ea914ed test(test_alerting.py): fix testing 2024-05-20 17:01:34 -07:00
Krrish Dholakia
fd13a830ab fix(slack_alerting.py): cleanup webhook event 2024-05-20 16:55:01 -07:00
Ishaan Jaff
7e6c9274fc Merge branch 'main' into litellm_standardize_slack_exception_msg_format 2024-05-20 16:39:41 -07:00
Ishaan Jaff
32785662a5 Merge pull request #3745 from BerriAI/litellm_fix_slack_alerting_bug
fix divide by 0 bug on slack alerting
2024-05-20 16:38:29 -07:00
Ishaan Jaff
dc55a57d8a Merge pull request #3716 from BerriAI/litellm_set_cooldown_time_based_on_exception_header
[Feat] Router/ Proxy - set cooldown_time based on Azure exception headers
2024-05-20 16:34:12 -07:00
Ishaan Jaff
2ccef68c2d fix - standardize format of exceptions occuring on slack alerts 2024-05-20 16:29:16 -07:00
Ishaan Jaff
233828e16f fix - standardize slack alerting format 2024-05-20 16:26:11 -07:00
Ishaan Jaff
6194860da4 fix standardize llm exception alert to msg: value 2024-05-20 16:23:48 -07:00
Ishaan Jaff
bac23e43a6 fix test - retry claude-3 image error 3 times 2024-05-20 16:17:09 -07:00
Ishaan Jaff
508bff13ab fix - revert check_request_disconnection 2024-05-20 15:43:29 -07:00
Krrish Dholakia
bca8b51992 test(test_alerting.py): testing fixes 2024-05-20 15:37:35 -07:00
Krrish Dholakia
c0d5e83570 feat(slack_alerting.py): support webhook for budget alerts
Closes https://github.com/BerriAI/litellm/issues/3743
2024-05-20 15:30:56 -07:00
Ishaan Jaff
540c476024 try/except deployment metrics error 2024-05-20 15:03:04 -07:00
Ishaan Jaff
175ef7f4f2 fix - only adding alerting callbacks when alerting is on 2024-05-20 14:59:06 -07:00
Ishaan Jaff
e9ea7438a9 fix divide by 0 bug 2024-05-20 14:26:30 -07:00
Ishaan Jaff
28d1bde250 Merge pull request #3739 from BerriAI/litellm_add_imagen_support
[FEAT] Async VertexAI Image Generation
2024-05-20 14:14:43 -07:00
Ishaan Jaff
4f3a90bb2e Merge pull request #3742 from BerriAI/litellm_enforce_sso
[Feat] Enforce user has a valid license when using SSO on LiteLLM Proxy
2024-05-20 14:07:23 -07:00
Ishaan Jaff
6fef49d1f6 fix vertex httpx client 2024-05-20 13:43:54 -07:00
Krrish Dholakia
41556b3d02 fix(slack_alerting.py): prevent alert spam within 24 hr period for budget alerts
Closes https://github.com/BerriAI/litellm/issues/3738
2024-05-20 13:35:19 -07:00
Ishaan Jaff
99ba8d74a0 Merge pull request #3711 from hmcp22/add_gemini_base64_image_support
Adding decoding of base64 image data for gemini pro 1.5
2024-05-20 13:34:39 -07:00
Ishaan Jaff
883a9eb69a add parameter mapping with vertex ai 2024-05-20 13:28:20 -07:00
Ishaan Jaff
97dc366402 fix vertex ai import 2024-05-20 13:13:19 -07:00
Ishaan Jaff
9d12a570a5 fix self.async_handler 2024-05-20 13:11:10 -07:00
Ishaan Jaff
9d2f60079d fix error on enforce sso 2024-05-20 13:02:56 -07:00
Ishaan Jaff
77ac6d9b74 feat - enforce sso on Admin UI 2024-05-20 12:54:08 -07:00
Ishaan Jaff
44c998293d only run check_request_disconnection logic for 10 mins 2024-05-20 12:39:03 -07:00
Krrish Dholakia
d4d4550bb6 fix(proxy_server.py): fixes for making rejected responses work with streaming 2024-05-20 12:32:19 -07:00
Ishaan Jaff
df4e6b6576 docs - update openapi swagger docs 2024-05-20 12:26:42 -07:00
Ishaan Jaff
5e64e76594 fix python 3.8 2024-05-20 12:23:27 -07:00
Ishaan Jaff
c309c9d82c fix python 3.8 Tuple 2024-05-20 12:21:02 -07:00
Ishaan Jaff
4e711c32ef test - fix test_aimage_generation_vertex_ai 2024-05-20 12:10:28 -07:00
Krrish Dholakia
8fb8d068fb feat(proxy_server.py): refactor returning rejected message, to work with error logging
log the rejected request as a failed call to langfuse/slack alerting
2024-05-20 11:14:36 -07:00
Ishaan Jaff
08796b06b0 test vertex image gen test 2024-05-20 11:14:16 -07:00
Ishaan Jaff
d2bc2259cc fix add debug to vertex httpx image 2024-05-20 11:11:14 -07:00
Ishaan Jaff
1256159229 fix python 3.8 import 2024-05-20 11:03:28 -07:00
Ishaan Jaff
8ea3482676 fix python3.8 error 2024-05-20 10:55:10 -07:00
Ishaan Jaff
d733010580 fix vertex test 2024-05-20 10:51:25 -07:00