Commit graph

2530 commits

Author SHA1 Message Date
Krrish Dholakia
019533d815 fix(utils.py): move 'set_callbacks' to litellm_logging.py 2024-06-15 12:02:30 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Ishaan Jaff
91eafc8827 ui - new build 2024-06-14 20:33:02 -07:00
Ishaan Jaff
8988b2e909 Merge pull request #4209 from BerriAI/litellm_send_email_alerts_budget_exceeded
[Feat] send email alerts when budget exceeded
2024-06-14 20:23:19 -07:00
Ishaan Jaff
f16a9a6d92 fix send emails to team members 2024-06-14 20:11:16 -07:00
Krish Dholakia
9e280ba235 Merge pull request #4205 from BerriAI/litellm_alerting_metadata
fix(slack_alerting.py): allow new 'alerting_metadata' arg
2024-06-14 19:04:30 -07:00
Ishaan Jaff
b075e667ad fix show email on config 2024-06-14 18:41:51 -07:00
Ishaan Jaff
614f41d12e fix -better debugging before sending emails 2024-06-14 17:38:33 -07:00
Ishaan Jaff
8013e0dd78 add team_alias in alerting info 2024-06-14 17:05:59 -07:00
Ishaan Jaff
3c56bfbc5a send team_alias on team budget alerts 2024-06-14 17:00:43 -07:00
Krrish Dholakia
1cce99300f fix(slack_alerting.py): allow new 'alerting_metadata' arg
Allows user to pass in additional alerting metadata for debugging
2024-06-14 16:06:47 -07:00
Ishaan Jaff
9f22b470be fix - team budget exceeded 2024-06-14 15:54:14 -07:00
Krrish Dholakia
29e06f4e72 fix(utils.py): return traceback on unmapped exception error
Fixes https://github.com/BerriAI/litellm/issues/4201
2024-06-14 15:08:01 -07:00
Krrish Dholakia
af2aeb595d fix(proxy/utils.py): fix reset monthly budget
fix to reset at the same time each month (not at start of month)
2024-06-14 14:41:06 -07:00
Krish Dholakia
c373f104cc Merge branch 'main' into litellm_redis_cache_usage 2024-06-13 22:07:21 -07:00
Krish Dholakia
f3fd84908b Merge pull request #4178 from BerriAI/litellm_http_handler
Retry on connection disconnect
2024-06-13 21:14:56 -07:00
Krrish Dholakia
5fd3ef671e build(ui): new build 2024-06-13 21:13:29 -07:00
Krrish Dholakia
46a5fb1747 feat(proxy/utils.py): allow budget duration in months
Closes https://github.com/BerriAI/litellm/issues/4042
2024-06-13 21:13:29 -07:00
Ishaan Jaff
e581f33a17 update swagger for /team endpoints 2024-06-13 21:13:29 -07:00
Ishaan Jaff
704c678689 fix /team/update 2024-06-13 21:13:29 -07:00
Ishaan Jaff
7ece6cf911 fix bug when updating team 2024-06-13 21:13:29 -07:00
Ishaan Jaff
78d0674e8d feat - add remaining budget for key on prometheus 2024-06-13 21:13:29 -07:00
Ishaan Jaff
09dff7b3de feat - add remaining team budget gauge 2024-06-13 21:13:29 -07:00
Ishaan Jaff
7a51d28c88 fix - clean up swagger spend endpoints 2024-06-13 21:13:29 -07:00
Ishaan Jaff
74c737f0d8 fix config 2024-06-13 21:13:29 -07:00
Krrish Dholakia
bb3167ff15 build(ui): new build 2024-06-13 20:55:50 -07:00
Krrish Dholakia
ced41130e4 feat(proxy/utils.py): allow budget duration in months
Closes https://github.com/BerriAI/litellm/issues/4042
2024-06-13 20:55:50 -07:00
Ishaan Jaff
31e89bf48b update swagger for /team endpoints 2024-06-13 20:55:50 -07:00
Ishaan Jaff
18c89a0dd7 fix /team/update 2024-06-13 20:55:50 -07:00
Ishaan Jaff
ffe3df74e6 fix bug when updating team 2024-06-13 20:55:49 -07:00
Ishaan Jaff
8e81fb89a4 feat - add remaining budget for key on prometheus 2024-06-13 20:55:49 -07:00
Ishaan Jaff
5aaedd7c26 feat - add remaining team budget gauge 2024-06-13 20:55:49 -07:00
Ishaan Jaff
0d822af00b fix - clean up swagger spend endpoints 2024-06-13 20:55:49 -07:00
Krrish Dholakia
2642cd2ee7 test(test_router_debug_logs.py): fix test 2024-06-13 20:37:37 -07:00
Krrish Dholakia
b580e0992d fix(utils.py): check if model info is for model with correct provider
Fixes issue where incorrect pricing was used for custom llm provider
2024-06-13 15:54:24 -07:00
Krrish Dholakia
e2a3895dfc fix(http_handler.py): add retry logic on httpx.remoteprotocolerror 2024-06-13 14:05:29 -07:00
Ishaan Jaff
44f8dff1a3 fix config 2024-06-13 11:53:04 -07:00
Ishaan Jaff
c55a68a9da fix "/global/spend/report", 2024-06-13 08:51:49 -07:00
Krish Dholakia
50c74fce49 Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Ishaan Jaff
bab917c71f ui - new build 2024-06-12 20:34:55 -07:00
Ishaan Jaff
de0e37ebfb feat - litellm_model_cost_map 2024-06-12 20:03:46 -07:00
Ishaan Jaff
412632985f ui - new build 2024-06-12 19:47:58 -07:00
Ishaan Jaff
7b1a99b816 Merge pull request #4164 from BerriAI/litellm_fix_error_inernal_users_sso_saw
[Admin UI] Fix error Internal Users see when using SSO
2024-06-12 19:45:10 -07:00
Ishaan Jaff
be7340c5a9 fix - sso pass correct role for user 2024-06-12 19:37:58 -07:00
Ishaan Jaff
cc91db907b fix - error internal users see on SSO 2024-06-12 17:42:08 -07:00
Krrish Dholakia
29169b3039 feat(vertex_httpx.py): Moving to call vertex ai via httpx (instead of their sdk). Allows us to support all their api updates. 2024-06-12 16:47:00 -07:00
Ishaan Jaff
9f2dc76a58 test - making mistral embedding request on proxy 2024-06-12 15:10:20 -07:00
Ishaan Jaff
dbdf102a01 feat - add mistral embedding config 2024-06-12 15:00:00 -07:00
Ishaan Jaff
67938564b4 fix - comment on /user/new 2024-06-12 13:16:39 -07:00
Krrish Dholakia
77328e4a28 fix(parallel_request_limiter.py): use redis cache, if available for rate limiting across instances
Fixes https://github.com/BerriAI/litellm/issues/4148
2024-06-12 10:35:48 -07:00