Commit graph

8190 commits

Author SHA1 Message Date
Ishaan Jaff
39ca66f46d fix - remove deprecated clickhouse utils 2024-06-15 15:33:26 -07:00
Krish Dholakia
fa2d8bc794 Merge pull request #4216 from BerriAI/litellm_refactor_logging
refactor(utils.py): Cut down utils.py to <10k lines.
2024-06-15 15:19:42 -07:00
Krrish Dholakia
d1ab1c890b docs(utils.py): add comments explaining utils vs. core utils 2024-06-15 14:50:05 -07:00
Krrish Dholakia
bd05a0ca36 test(test_utils.py): fix import 2024-06-15 14:47:46 -07:00
Ishaan Jaff
873c6534d8 Merge pull request #4211 from BerriAI/litellm_fix_anthropic_cache_httpclient
[Reliability Fix] Anthropic / Bedrock HTTPX -  Cache Async Httpx client
2024-06-15 14:36:41 -07:00
Krrish Dholakia
966f9ebc6a test(test_completion_cost.py): fix import 2024-06-15 12:08:49 -07:00
Krrish Dholakia
019533d815 fix(utils.py): move 'set_callbacks' to litellm_logging.py 2024-06-15 12:02:30 -07:00
Krrish Dholakia
7de77ab677 fix(init.py): fix imports 2024-06-15 11:31:09 -07:00
Krrish Dholakia
95aa27c10e fix(litellm_logging.py): fix import 2024-06-15 11:17:39 -07:00
Krrish Dholakia
8f07399c57 fix(types/utils.py): fix import 2024-06-15 11:04:15 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Ishaan Jaff
b0b9bb9906 test fix _get_bearer_token 2024-06-15 10:51:44 -07:00
Ishaan Jaff
5b6f22b5dd test fix key gen prisma 2024-06-15 10:49:14 -07:00
Ishaan Jaff
ed273ef4f0 test - fixes 2024-06-15 10:40:02 -07:00
Ishaan Jaff
4bc2bfb176 fix - proxy refactor user_api_key_auth 2024-06-15 10:33:58 -07:00
Ishaan Jaff
cfa5e8cfd8 test commit 2024-06-15 09:39:00 -07:00
Ishaan Jaff
3325f6ec2e ci/cd run again 2024-06-14 21:37:35 -07:00
Ishaan Jaff
97aebaeb9a ci/cd run again 2024-06-14 21:31:24 -07:00
Ishaan Jaff
113b7e34ce refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Ishaan Jaff
8669a0e0be fix cached httpx client 2024-06-14 21:23:13 -07:00
Krrish Dholakia
ffe04e129d fix(slack_alerting.py): check if webhook is in alerting list before triggering it
Fixes https://github.com/BerriAI/litellm/issues/4193
2024-06-14 21:20:58 -07:00
Ishaan Jaff
6c6c718997 fix - result 2024-06-14 21:15:49 -07:00
Ishaan Jaff
d19efd62cf fix async client 2024-06-14 21:12:32 -07:00
Ishaan Jaff
56cd405972 cache anthropic httpx client 2024-06-14 20:55:40 -07:00
Ishaan Jaff
d4f45bd155 Merge pull request #4210 from BerriAI/litellm_fix_redact_message_input_output_from_logging_deepcopy
[Fix] redact_message_input_output_from_logging deepcopy bug
2024-06-14 20:41:27 -07:00
Ishaan Jaff
91eafc8827 ui - new build 2024-06-14 20:33:02 -07:00
Ishaan Jaff
8988b2e909 Merge pull request #4209 from BerriAI/litellm_send_email_alerts_budget_exceeded
[Feat] send email alerts when budget exceeded
2024-06-14 20:23:19 -07:00
Ishaan Jaff
b5aa1ced06 fix redact_message_input_output_from_logging 2024-06-14 20:23:10 -07:00
Ishaan Jaff
f16a9a6d92 fix send emails to team members 2024-06-14 20:11:16 -07:00
Ishaan Jaff
c0dd9d275d fix - send emails on crossing team budget 2024-06-14 19:48:22 -07:00
Krish Dholakia
9e280ba235 Merge pull request #4205 from BerriAI/litellm_alerting_metadata
fix(slack_alerting.py): allow new 'alerting_metadata' arg
2024-06-14 19:04:30 -07:00
Krish Dholakia
63780e1ccf Merge pull request #4207 from BerriAI/litellm_content_policy_fallbacks
feat(router.py): support content policy fallbacks
2024-06-14 18:55:11 -07:00
Ishaan Jaff
7e7f867860 fix - send team budget crossed 2024-06-14 18:52:13 -07:00
Ishaan Jaff
b075e667ad fix show email on config 2024-06-14 18:41:51 -07:00
Ishaan Jaff
cdffda16a0 add email alerting for budgets 2024-06-14 18:40:56 -07:00
Ishaan Jaff
24b3bd5c09 Merge pull request #4203 from BerriAI/litellm_fix_bug_tem_budget
[Bug fix] Don't cache team, user, customer budget after calling /update, /delete
2024-06-14 18:36:41 -07:00
Ishaan Jaff
80d97c4fef feat - send email alert to team members 2024-06-14 18:36:04 -07:00
Ishaan Jaff
614f41d12e fix -better debugging before sending emails 2024-06-14 17:38:33 -07:00
Krrish Dholakia
734bd5ef85 feat(router.py): support content policy fallbacks
Closes https://github.com/BerriAI/litellm/issues/2632
2024-06-14 17:15:44 -07:00
Ishaan Jaff
8013e0dd78 add team_alias in alerting info 2024-06-14 17:05:59 -07:00
Ishaan Jaff
3c56bfbc5a send team_alias on team budget alerts 2024-06-14 17:00:43 -07:00
Krrish Dholakia
33862020e8 test(test_alerting.py): fix tests 2024-06-14 16:20:54 -07:00
Krrish Dholakia
1cce99300f fix(slack_alerting.py): allow new 'alerting_metadata' arg
Allows user to pass in additional alerting metadata for debugging
2024-06-14 16:06:47 -07:00
Ishaan Jaff
9f22b470be fix - team budget exceeded 2024-06-14 15:54:14 -07:00
Ishaan Jaff
10a52d8344 Merge pull request #4197 from BerriAI/litellm_fix_router_level_alerting
[Fix + Refactor] - Router Alerting for llm exceptions  + use separate util for sending alert
2024-06-14 15:52:31 -07:00
Ishaan Jaff
fcbd496ed1 fix use safe access for router alerting 2024-06-14 15:17:32 -07:00
Krrish Dholakia
f1bff50d60 fix(main.py): include traceback in error string 2024-06-14 15:15:53 -07:00
Krrish Dholakia
29e06f4e72 fix(utils.py): return traceback on unmapped exception error
Fixes https://github.com/BerriAI/litellm/issues/4201
2024-06-14 15:08:01 -07:00
Krrish Dholakia
af2aeb595d fix(proxy/utils.py): fix reset monthly budget
fix to reset at the same time each month (not at start of month)
2024-06-14 14:41:06 -07:00
Ishaan Jaff
5f7423047f feat - send llm exception alert on acompletion, aembedding etc 2024-06-14 10:11:24 -07:00