Commit graph

520 commits

Author SHA1 Message Date
Krrish Dholakia
941574a921 fix(proxy/utils.py): fix add langfuse trace id to alert
Fixing the import after refactor
2024-06-21 14:55:09 -07:00
Krrish Dholakia
5912decd19 fix(proxy/utils.py): fix bool on check 2024-06-21 14:29:38 -07:00
Krrish Dholakia
df3afa652f fix(proxy/utils.py): fix linting error 2024-06-20 14:13:38 -07:00
Krrish Dholakia
2623bb260f fix(litellm_logging.py): fix lago callback logic 2024-06-17 09:10:19 -07:00
Krish Dholakia
f2b3770869
Merge pull request #4216 from BerriAI/litellm_refactor_logging
refactor(utils.py): Cut down utils.py to <10k lines.
2024-06-15 15:19:42 -07:00
Krrish Dholakia
af88e55d46 fix(utils.py): move 'set_callbacks' to litellm_logging.py 2024-06-15 12:02:30 -07:00
Krrish Dholakia
4f91205530 refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Ishaan Jaff
da3ae00bd6 fix - proxy refactor user_api_key_auth 2024-06-15 10:33:58 -07:00
Ishaan Jaff
4bfd46d0a6
Merge pull request #4209 from BerriAI/litellm_send_email_alerts_budget_exceeded
[Feat] send email alerts when budget exceeded
2024-06-14 20:23:19 -07:00
Ishaan Jaff
52b54da354 fix -better debugging before sending emails 2024-06-14 17:38:33 -07:00
Krrish Dholakia
e18002023a fix(slack_alerting.py): allow new 'alerting_metadata' arg
Allows user to pass in additional alerting metadata for debugging
2024-06-14 16:06:47 -07:00
Krrish Dholakia
d8acda9f39 fix(proxy/utils.py): fix reset monthly budget
fix to reset at the same time each month (not at start of month)
2024-06-14 14:41:06 -07:00
Krish Dholakia
e61cd2e1e2
Merge branch 'main' into litellm_redis_cache_usage 2024-06-13 22:07:21 -07:00
Krrish Dholakia
f65752c18b feat(proxy/utils.py): allow budget duration in months
Closes https://github.com/BerriAI/litellm/issues/4042
2024-06-13 16:52:17 -07:00
Krrish Dholakia
76c9b715f2 fix(parallel_request_limiter.py): use redis cache, if available for rate limiting across instances
Fixes https://github.com/BerriAI/litellm/issues/4148
2024-06-12 10:35:48 -07:00
Krrish Dholakia
31cb1269f5 fix(proxy/_types.py): support logging k,v pairs to spend logs with spend_logs_metadata param 2024-06-12 08:42:35 -07:00
Ishaan Jaff
f2abac748e fix refactor management endpoint utils 2024-06-11 16:16:10 -07:00
Ishaan Jaff
13cb49688a feat - log management endpoint logs to otel 2024-06-11 16:09:11 -07:00
Ishaan Jaff
a4589e33dd
Merge pull request #4071 from BerriAI/litellm_log_db_exceptions_otel
[FEAT] OTEL - LOG DB Exceptions
2024-06-07 17:13:20 -07:00
Ishaan Jaff
718b547646
Merge branch 'main' into litellm_security_fix 2024-06-07 16:52:25 -07:00
Ishaan Jaff
ac722d02ce feat - log DB exceptions to OTEL 2024-06-07 16:48:55 -07:00
Ishaan Jaff
15c0d334e8 fix logic for deep copying otel spans / traces 2024-06-07 15:10:05 -07:00
Krrish Dholakia
51fb199329 fix(proxy/utils.py): handle user param being none 2024-06-07 14:35:16 -07:00
Ishaan Jaff
8501494072 fix - use safe_deep copy from litellm 2024-06-07 14:11:55 -07:00
Ishaan Jaff
d9dacc1f43
Merge pull request #4065 from BerriAI/litellm_use_common_func
[Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`
2024-06-07 14:02:17 -07:00
Ishaan Jaff
2cf3133669
Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
7ef7bc8a9a fix simplify - pass litellm_parent_otel_span 2024-06-07 13:48:21 -07:00
Krrish Dholakia
b41d7f5d51 fix(proxy/utils.py): security fix
use typed dict for spendlogs payload. assert no sensitive information logged.
2024-06-07 13:44:11 -07:00
Ishaan Jaff
9a5e63d3e8 fix import Span 2024-06-07 10:00:33 -07:00
Ishaan Jaff
c7545be275 feat - use safe safe_deep_copy 2024-06-07 08:49:47 -07:00
Ishaan Jaff
37e7a7b2d5 fix - log_to_opentelemetry 2024-06-06 22:28:01 -07:00
Ishaan Jaff
a3e6d557b2 add _to_ns to utils 2024-06-06 21:30:55 -07:00
Krrish Dholakia
7ddca8d834 fix(proxy_server.py): fix backoff attempt logging
make sure backoff uses our logging handler to log info to
2024-06-06 14:08:31 -07:00
Ishaan Jaff
b6825977c5 fix - fix redirecting after logging in 2024-06-05 15:37:45 -07:00
Ishaan Jaff
190ba2a3b9 fix allow PROXY_ADMIN_VIEW_ONLY to create an account 2024-05-31 17:29:17 -07:00
Ishaan Jaff
6166381579 fix migrate to LitellmUserRoles 2024-05-30 13:57:50 -07:00
Ishaan Jaff
7d5fe910f2 fix - make email alerting free 2024-05-27 19:27:20 -07:00
Krrish Dholakia
d3b724af7d refactor(proxy/utils.py): cleanup dead code 2024-05-27 08:52:01 -07:00
Krrish Dholakia
4408b717f0 fix(parallel_request_limiter.py): fix user+team tpm/rpm limit check
Closes https://github.com/BerriAI/litellm/issues/3788
2024-05-27 08:48:23 -07:00
Krish Dholakia
4e230f0a2e
Merge pull request #3844 from BerriAI/litellm_region_based_alerts
feat(slack_alerting.py): enable provider-region based alerting
2024-05-25 21:03:16 -07:00
Krrish Dholakia
a9a1447513 feat(ui): allow admin to configure slack alerting thresholds on ui 2024-05-25 21:01:19 -07:00
Ishaan Jaff
58625962df fiix - update / reset budget 2024-05-25 17:03:27 -07:00
Ishaan Jaff
7022993531 feat - ResetTeamBudgetRequest 2024-05-25 16:52:41 -07:00
Ishaan Jaff
bd5dc40340
Merge branch 'main' into litellm_send_alerts_making_new_key 2024-05-24 20:42:17 -07:00
Krrish Dholakia
9b90f91515 feat(ui): settings.tsx
enable/disable outage alerts on admin ui
2024-05-24 20:04:15 -07:00
Krish Dholakia
d25ed9c4d3
Merge pull request #3828 from BerriAI/litellm_outage_alerting
fix(slack_alerting.py): support region based outage alerting
2024-05-24 19:13:17 -07:00
Ishaan Jaff
41879ae002 feat - email alerts on /key/generate 2024-05-24 17:33:15 -07:00
Krrish Dholakia
f8350b9461 fix(slack_alerting.py): support region based outage alerting 2024-05-24 16:59:16 -07:00
Ishaan Jaff
c3dd0a1470 feat check SMTP_SENDER_EMAIL + put behind enterprise license 2024-05-24 14:37:53 -07:00
Ishaan Jaff
268d4f7665 fix send_email update 2024-05-24 14:23:27 -07:00