Commit graph

498 commits

Author SHA1 Message Date
Krrish Dholakia
51fb199329 fix(proxy/utils.py): handle user param being none 2024-06-07 14:35:16 -07:00
Ishaan Jaff
8501494072 fix - use safe_deep copy from litellm 2024-06-07 14:11:55 -07:00
Ishaan Jaff
d9dacc1f43
Merge pull request #4065 from BerriAI/litellm_use_common_func
[Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`
2024-06-07 14:02:17 -07:00
Ishaan Jaff
2cf3133669
Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
7ef7bc8a9a fix simplify - pass litellm_parent_otel_span 2024-06-07 13:48:21 -07:00
Krrish Dholakia
b41d7f5d51 fix(proxy/utils.py): security fix
use typed dict for spendlogs payload. assert no sensitive information logged.
2024-06-07 13:44:11 -07:00
Ishaan Jaff
9a5e63d3e8 fix import Span 2024-06-07 10:00:33 -07:00
Ishaan Jaff
c7545be275 feat - use safe safe_deep_copy 2024-06-07 08:49:47 -07:00
Ishaan Jaff
37e7a7b2d5 fix - log_to_opentelemetry 2024-06-06 22:28:01 -07:00
Ishaan Jaff
a3e6d557b2 add _to_ns to utils 2024-06-06 21:30:55 -07:00
Krrish Dholakia
7ddca8d834 fix(proxy_server.py): fix backoff attempt logging
make sure backoff uses our logging handler to log info to
2024-06-06 14:08:31 -07:00
Ishaan Jaff
b6825977c5 fix - fix redirecting after logging in 2024-06-05 15:37:45 -07:00
Ishaan Jaff
190ba2a3b9 fix allow PROXY_ADMIN_VIEW_ONLY to create an account 2024-05-31 17:29:17 -07:00
Ishaan Jaff
6166381579 fix migrate to LitellmUserRoles 2024-05-30 13:57:50 -07:00
Ishaan Jaff
7d5fe910f2 fix - make email alerting free 2024-05-27 19:27:20 -07:00
Krrish Dholakia
d3b724af7d refactor(proxy/utils.py): cleanup dead code 2024-05-27 08:52:01 -07:00
Krrish Dholakia
4408b717f0 fix(parallel_request_limiter.py): fix user+team tpm/rpm limit check
Closes https://github.com/BerriAI/litellm/issues/3788
2024-05-27 08:48:23 -07:00
Krish Dholakia
4e230f0a2e
Merge pull request #3844 from BerriAI/litellm_region_based_alerts
feat(slack_alerting.py): enable provider-region based alerting
2024-05-25 21:03:16 -07:00
Krrish Dholakia
a9a1447513 feat(ui): allow admin to configure slack alerting thresholds on ui 2024-05-25 21:01:19 -07:00
Ishaan Jaff
58625962df fiix - update / reset budget 2024-05-25 17:03:27 -07:00
Ishaan Jaff
7022993531 feat - ResetTeamBudgetRequest 2024-05-25 16:52:41 -07:00
Ishaan Jaff
bd5dc40340
Merge branch 'main' into litellm_send_alerts_making_new_key 2024-05-24 20:42:17 -07:00
Krrish Dholakia
9b90f91515 feat(ui): settings.tsx
enable/disable outage alerts on admin ui
2024-05-24 20:04:15 -07:00
Krish Dholakia
d25ed9c4d3
Merge pull request #3828 from BerriAI/litellm_outage_alerting
fix(slack_alerting.py): support region based outage alerting
2024-05-24 19:13:17 -07:00
Ishaan Jaff
41879ae002 feat - email alerts on /key/generate 2024-05-24 17:33:15 -07:00
Krrish Dholakia
f8350b9461 fix(slack_alerting.py): support region based outage alerting 2024-05-24 16:59:16 -07:00
Ishaan Jaff
c3dd0a1470 feat check SMTP_SENDER_EMAIL + put behind enterprise license 2024-05-24 14:37:53 -07:00
Ishaan Jaff
268d4f7665 fix send_email update 2024-05-24 14:23:27 -07:00
Krrish Dholakia
2af4948af4 feat(proxy_server.py): add setup instructions for UI 2024-05-24 08:15:44 -07:00
Ishaan Jaff
5291f380c9 feat - async_post_call_streaming_hook 2024-05-23 09:30:53 -07:00
Ishaan Jaff
a8b64a01dc
Merge pull request #3790 from BerriAI/litellm_set_team_member_budgets
[Feat] Set Budgets for Users within a Team
2024-05-22 19:44:04 -07:00
Ishaan Jaff
7a8d78e6c9 feat - check team member spend, budget 2024-05-22 18:36:39 -07:00
Ishaan Jaff
c2d25b9a14 feat - update team+user_id spend 2024-05-22 17:49:54 -07:00
Krrish Dholakia
3c0e9cb48e feat(schema.prisma): store model id + model group as part of spend logs
allows precise model metrics
2024-05-22 17:29:44 -07:00
Krrish Dholakia
9f518030b9 build(schema.prisma): add completion_start_time to spend logs
enables time to first token tracking for models
2024-05-22 16:43:08 -07:00
Krish Dholakia
707cf24472
Merge branch 'main' into litellm_webhook_support 2024-05-20 18:41:58 -07:00
Krish Dholakia
c6bb6e325b
Merge pull request #3740 from BerriAI/litellm_return_rejected_response
feat(proxy_server.py): allow admin to return rejected response as string to user
2024-05-20 17:48:21 -07:00
Krrish Dholakia
867f9300e3 fix(slack_alerting.py): cleanup webhook event 2024-05-20 16:55:01 -07:00
Ishaan Jaff
8413fdf4c7
Merge branch 'main' into litellm_standardize_slack_exception_msg_format 2024-05-20 16:39:41 -07:00
Ishaan Jaff
5d24b47d2b fix standardize llm exception alert to msg: value 2024-05-20 16:23:48 -07:00
Krrish Dholakia
da0e5d1b8d feat(slack_alerting.py): support webhook for budget alerts
Closes https://github.com/BerriAI/litellm/issues/3743
2024-05-20 15:30:56 -07:00
Ishaan Jaff
f417495b7b fix - only adding alerting callbacks when alerting is on 2024-05-20 14:59:06 -07:00
Krrish Dholakia
f11f207ae6 feat(proxy_server.py): refactor returning rejected message, to work with error logging
log the rejected request as a failed call to langfuse/slack alerting
2024-05-20 11:14:36 -07:00
Krrish Dholakia
372323c38a feat(proxy_server.py): allow admin to return rejected response as string to user
Closes https://github.com/BerriAI/litellm/issues/3671
2024-05-20 10:30:23 -07:00
Ishaan Jaff
a292583ff1 fix - allow users to opt into specific alert types 2024-05-16 16:52:44 -07:00
Krish Dholakia
d43f75150a
Merge pull request #3685 from BerriAI/litellm_lago_integration
feat(lago.py): Enable Usage-based billing with lago
2024-05-16 13:09:48 -07:00
Krrish Dholakia
e273e66618 feat(lago.py): adding support for usage-based billing with lago
Closes https://github.com/BerriAI/litellm/issues/3639
2024-05-16 10:54:18 -07:00
Krish Dholakia
152946e910
Merge branch 'main' into litellm_end_user_cost_tracking 2024-05-15 22:27:04 -07:00
Ishaan Jaff
89dd1ffee8 fix deep copy logic in during_call_hook 2024-05-15 17:34:54 -07:00
Ishaan Jaff
f6e342303e show debug info on slack alerts 2024-05-15 13:23:44 -07:00