498 commits

Author	SHA1	Message	Date
Krrish Dholakia	709ae8286d	fix(proxy/utils.py): handle user param being none	2024-06-07 14:35:16 -07:00
Ishaan Jaff	a6ec9cd54b	fix - use safe_deep copy from litellm	2024-06-07 14:11:55 -07:00
Ishaan Jaff	80def35a04	Merge pull request #4065 from BerriAI/litellm_use_common_func ... [Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`	2024-06-07 14:02:17 -07:00
Ishaan Jaff	860c9b52b6	Merge branch 'main' into litellm_svc_logger	2024-06-07 14:01:54 -07:00
Ishaan Jaff	8106a6dc9b	fix simplify - pass litellm_parent_otel_span	2024-06-07 13:48:21 -07:00
Krrish Dholakia	f7f8bcb21b	fix(proxy/utils.py): security fix ... use typed dict for spendlogs payload. assert no sensitive information logged.	2024-06-07 13:44:11 -07:00
Ishaan Jaff	141cea5eb6	fix import Span	2024-06-07 10:00:33 -07:00
Ishaan Jaff	8370f81aa6	feat - use safe safe_deep_copy	2024-06-07 08:49:47 -07:00
Ishaan Jaff	193e71642c	fix - log_to_opentelemetry	2024-06-06 22:28:01 -07:00
Ishaan Jaff	87df3a4a04	add _to_ns to utils	2024-06-06 21:30:55 -07:00
Krrish Dholakia	bb63046d8c	fix(proxy_server.py): fix backoff attempt logging ... make sure backoff uses our logging handler to log info to	2024-06-06 14:08:31 -07:00
Ishaan Jaff	06af142107	fix - fix redirecting after logging in	2024-06-05 15:37:45 -07:00
Ishaan Jaff	524cfd458a	fix allow PROXY_ADMIN_VIEW_ONLY to create an account	2024-05-31 17:29:17 -07:00
Ishaan Jaff	dc51fec22e	fix migrate to LitellmUserRoles	2024-05-30 13:57:50 -07:00
Ishaan Jaff	2037d88719	fix - make email alerting free	2024-05-27 19:27:20 -07:00
Krrish Dholakia	4e97b42ffd	refactor(proxy/utils.py): cleanup dead code	2024-05-27 08:52:01 -07:00
Krrish Dholakia	56fd0c60d1	fix(parallel_request_limiter.py): fix user+team tpm/rpm limit check ... Closes https://github.com/BerriAI/litellm/issues/3788	2024-05-27 08:48:23 -07:00
Krish Dholakia	960fa8b326	Merge pull request #3844 from BerriAI/litellm_region_based_alerts ... feat(slack_alerting.py): enable provider-region based alerting	2024-05-25 21:03:16 -07:00
Krrish Dholakia	1f42d086d6	feat(ui): allow admin to configure slack alerting thresholds on ui	2024-05-25 21:01:19 -07:00
Ishaan Jaff	088e8c7474	fiix - update / reset budget	2024-05-25 17:03:27 -07:00
Ishaan Jaff	fbc4c79334	feat - ResetTeamBudgetRequest	2024-05-25 16:52:41 -07:00
Ishaan Jaff	d3a8306952	Merge branch 'main' into litellm_send_alerts_making_new_key	2024-05-24 20:42:17 -07:00
Krrish Dholakia	d2d5e2d389	feat(ui): settings.tsx ... enable/disable outage alerts on admin ui	2024-05-24 20:04:15 -07:00
Krish Dholakia	40791ee1f8	Merge pull request #3828 from BerriAI/litellm_outage_alerting ... fix(slack_alerting.py): support region based outage alerting	2024-05-24 19:13:17 -07:00
Ishaan Jaff	35b38bad4c	feat - email alerts on /key/generate	2024-05-24 17:33:15 -07:00
Krrish Dholakia	7368406c24	fix(slack_alerting.py): support region based outage alerting	2024-05-24 16:59:16 -07:00
Ishaan Jaff	fd5a7a738f	feat check SMTP_SENDER_EMAIL + put behind enterprise license	2024-05-24 14:37:53 -07:00
Ishaan Jaff	215fb132f9	fix send_email update	2024-05-24 14:23:27 -07:00
Krrish Dholakia	c441232c62	feat(proxy_server.py): add setup instructions for UI	2024-05-24 08:15:44 -07:00
Ishaan Jaff	56c2d63d1f	feat - async_post_call_streaming_hook	2024-05-23 09:30:53 -07:00
Ishaan Jaff	e2fa0cf79f	Merge pull request #3790 from BerriAI/litellm_set_team_member_budgets ... [Feat] Set Budgets for Users within a Team	2024-05-22 19:44:04 -07:00
Ishaan Jaff	181675c6b7	feat - check team member spend, budget	2024-05-22 18:36:39 -07:00
Ishaan Jaff	5a013fb7be	feat - update team+user_id spend	2024-05-22 17:49:54 -07:00
Krrish Dholakia	2bdff9b19e	feat(schema.prisma): store model id + model group as part of spend logs ... allows precise model metrics	2024-05-22 17:29:44 -07:00
Krrish Dholakia	fda9e7107a	build(schema.prisma): add completion_start_time to spend logs ... enables time to first token tracking for models	2024-05-22 16:43:08 -07:00
Krish Dholakia	f3a47e4b1a	Merge branch 'main' into litellm_webhook_support	2024-05-20 18:41:58 -07:00
Krish Dholakia	db77e41833	Merge pull request #3740 from BerriAI/litellm_return_rejected_response ... feat(proxy_server.py): allow admin to return rejected response as string to user	2024-05-20 17:48:21 -07:00
Krrish Dholakia	fd13a830ab	fix(slack_alerting.py): cleanup webhook event	2024-05-20 16:55:01 -07:00
Ishaan Jaff	7e6c9274fc	Merge branch 'main' into litellm_standardize_slack_exception_msg_format	2024-05-20 16:39:41 -07:00
Ishaan Jaff	6194860da4	fix standardize llm exception alert to msg: value	2024-05-20 16:23:48 -07:00
Krrish Dholakia	c0d5e83570	feat(slack_alerting.py): support webhook for budget alerts ... Closes https://github.com/BerriAI/litellm/issues/3743	2024-05-20 15:30:56 -07:00
Ishaan Jaff	175ef7f4f2	fix - only adding alerting callbacks when alerting is on	2024-05-20 14:59:06 -07:00
Krrish Dholakia	8fb8d068fb	feat(proxy_server.py): refactor returning rejected message, to work with error logging ... log the rejected request as a failed call to langfuse/slack alerting	2024-05-20 11:14:36 -07:00
Krrish Dholakia	45fedb83c6	feat(proxy_server.py): allow admin to return rejected response as string to user ... Closes https://github.com/BerriAI/litellm/issues/3671	2024-05-20 10:30:23 -07:00
Ishaan Jaff	70194f7ba2	fix - allow users to opt into specific alert types	2024-05-16 16:52:44 -07:00
Krish Dholakia	4c8b620352	Merge pull request #3685 from BerriAI/litellm_lago_integration ... feat(lago.py): Enable Usage-based billing with lago	2024-05-16 13:09:48 -07:00
Krrish Dholakia	d167a9ea99	feat(lago.py): adding support for usage-based billing with lago ... Closes https://github.com/BerriAI/litellm/issues/3639	2024-05-16 10:54:18 -07:00
Krish Dholakia	07a1cf39e8	Merge branch 'main' into litellm_end_user_cost_tracking	2024-05-15 22:27:04 -07:00
Ishaan Jaff	d257518e47	fix deep copy logic in during_call_hook	2024-05-15 17:34:54 -07:00
Ishaan Jaff	38a539baf4	show debug info on slack alerts	2024-05-15 13:23:44 -07:00