Commit graph

2519 commits

Author SHA1 Message Date
Ishaan Jaff
6bd7e24fdd fix - team budget exceeded 2024-06-14 15:54:14 -07:00
Krrish Dholakia
2732ff5d56 fix(utils.py): return traceback on unmapped exception error
Fixes https://github.com/BerriAI/litellm/issues/4201
2024-06-14 15:08:01 -07:00
Krrish Dholakia
d8acda9f39 fix(proxy/utils.py): fix reset monthly budget
fix to reset at the same time each month (not at start of month)
2024-06-14 14:41:06 -07:00
Krish Dholakia
e61cd2e1e2
Merge branch 'main' into litellm_redis_cache_usage 2024-06-13 22:07:21 -07:00
Krish Dholakia
d499477f54
Merge pull request #4178 from BerriAI/litellm_http_handler
Retry on connection disconnect
2024-06-13 21:14:56 -07:00
Krrish Dholakia
acdd8f16ea build(ui): new build 2024-06-13 21:13:29 -07:00
Krrish Dholakia
8498600d42 feat(proxy/utils.py): allow budget duration in months
Closes https://github.com/BerriAI/litellm/issues/4042
2024-06-13 21:13:29 -07:00
Ishaan Jaff
17b8a31f0e update swagger for /team endpoints 2024-06-13 21:13:29 -07:00
Ishaan Jaff
62ff15fe6c fix /team/update 2024-06-13 21:13:29 -07:00
Ishaan Jaff
6d44c56e41 fix bug when updating team 2024-06-13 21:13:29 -07:00
Ishaan Jaff
8b7b2eec6b feat - add remaining budget for key on prometheus 2024-06-13 21:13:29 -07:00
Ishaan Jaff
330df10907 feat - add remaining team budget gauge 2024-06-13 21:13:29 -07:00
Ishaan Jaff
1a9ab1d66a fix - clean up swagger spend endpoints 2024-06-13 21:13:29 -07:00
Ishaan Jaff
a166db1e73 fix config 2024-06-13 21:13:29 -07:00
Krrish Dholakia
11555e56ed build(ui): new build 2024-06-13 20:55:50 -07:00
Krrish Dholakia
b72d09689e feat(proxy/utils.py): allow budget duration in months
Closes https://github.com/BerriAI/litellm/issues/4042
2024-06-13 20:55:50 -07:00
Ishaan Jaff
b986aa2846 update swagger for /team endpoints 2024-06-13 20:55:50 -07:00
Ishaan Jaff
b4db497e23 fix /team/update 2024-06-13 20:55:50 -07:00
Ishaan Jaff
8f77cfc013 fix bug when updating team 2024-06-13 20:55:49 -07:00
Ishaan Jaff
fd3d764a3f feat - add remaining budget for key on prometheus 2024-06-13 20:55:49 -07:00
Ishaan Jaff
95cc2484ed feat - add remaining team budget gauge 2024-06-13 20:55:49 -07:00
Ishaan Jaff
21ed23296f fix - clean up swagger spend endpoints 2024-06-13 20:55:49 -07:00
Krrish Dholakia
e93727b585 test(test_router_debug_logs.py): fix test 2024-06-13 20:37:37 -07:00
Krrish Dholakia
345094a49d fix(utils.py): check if model info is for model with correct provider
Fixes issue where incorrect pricing was used for custom llm provider
2024-06-13 15:54:24 -07:00
Krrish Dholakia
46d57526c4 fix(http_handler.py): add retry logic on httpx.remoteprotocolerror 2024-06-13 14:05:29 -07:00
Ishaan Jaff
ec110976b8 fix config 2024-06-13 11:53:04 -07:00
Ishaan Jaff
eeb0e7d2be fix "/global/spend/report", 2024-06-13 08:51:49 -07:00
Krish Dholakia
05e21441a6
Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Ishaan Jaff
848d29fae7 ui - new build 2024-06-12 20:34:55 -07:00
Ishaan Jaff
8fd162136f feat - litellm_model_cost_map 2024-06-12 20:03:46 -07:00
Ishaan Jaff
2a32817963 ui - new build 2024-06-12 19:47:58 -07:00
Ishaan Jaff
4fc16a6bec
Merge pull request #4164 from BerriAI/litellm_fix_error_inernal_users_sso_saw
[Admin UI] Fix error Internal Users see when using SSO
2024-06-12 19:45:10 -07:00
Ishaan Jaff
8987f16507 fix - sso pass correct role for user 2024-06-12 19:37:58 -07:00
Ishaan Jaff
c510f6bb18 fix - error internal users see on SSO 2024-06-12 17:42:08 -07:00
Krrish Dholakia
3b913443fe feat(vertex_httpx.py): Moving to call vertex ai via httpx (instead of their sdk). Allows us to support all their api updates. 2024-06-12 16:47:00 -07:00
Ishaan Jaff
cb386fda20 test - making mistral embedding request on proxy 2024-06-12 15:10:20 -07:00
Ishaan Jaff
7eeef7ec1f feat - add mistral embedding config 2024-06-12 15:00:00 -07:00
Ishaan Jaff
d380697723 fix - comment on /user/new 2024-06-12 13:16:39 -07:00
Krrish Dholakia
76c9b715f2 fix(parallel_request_limiter.py): use redis cache, if available for rate limiting across instances
Fixes https://github.com/BerriAI/litellm/issues/4148
2024-06-12 10:35:48 -07:00
Krrish Dholakia
31cb1269f5 fix(proxy/_types.py): support logging k,v pairs to spend logs with spend_logs_metadata param 2024-06-12 08:42:35 -07:00
Ishaan Jaff
6d2134ad2a
Merge pull request #4138 from BerriAI/litellm_log_management_endpoint_logs_otel
[FEAT]  log management endpoint logs to otel
2024-06-11 19:00:13 -07:00
Krish Dholakia
75b0d7821b
Merge pull request #4139 from BerriAI/litellm_fix_budget_exceeded_error_code
fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
2024-06-11 18:36:58 -07:00
Ishaan Jaff
995b1e7315 fix when user_api_key_dict is None 2024-06-11 18:33:15 -07:00
Ishaan Jaff
b10ac0d1f3 fix linting error 2024-06-11 18:14:06 -07:00
Ishaan Jaff
fba7d2e623 fix team endpoints 2024-06-11 18:10:20 -07:00
Ishaan Jaff
7ad981b85c fix - log mgmt data to OTEL 2024-06-11 18:05:10 -07:00
Ishaan Jaff
51b78422df fix http_request 2024-06-11 17:57:50 -07:00
Ishaan Jaff
479a39cebd fix test new team 2024-06-11 17:48:11 -07:00
Krrish Dholakia
a1ca70a8a7 fix: more bug fixes 2024-06-11 17:41:59 -07:00
Ishaan Jaff
30f74aa471 fix import error 2024-06-11 17:17:57 -07:00