1402 commits

Author	SHA1	Message	Date
Ishaan Jaff	bf0c0c08c8	feat - set budget duration	2024-05-25 14:32:08 -07:00
Ishaan Jaff	7ff8204573	fix - linting error	2024-05-25 13:30:32 -07:00
Ishaan Jaff	50bd6e9a61	Merge pull request #3836 from BerriAI/litellm_ui_show_activity_tab ... [Feat] - Admin UI - New Activity Tab	2024-05-25 12:37:18 -07:00
Ishaan Jaff	1afc18f371	fix - clean up proxy.py	2024-05-25 12:22:28 -07:00
Ishaan Jaff	aa50020bda	fix - backend sort by date + /global/activity/model	2024-05-25 12:21:14 -07:00
Krrish Dholakia	19321094da	fix(proxy_server.py): allow user_api_key_cache_ttl to be a controllable param	2024-05-25 12:07:28 -07:00
Ishaan Jaff	3bab323dcc	fix - formatting on admin ui	2024-05-25 10:51:36 -07:00
Ishaan Jaff	6d91ffd050	backend - get all up global activ	2024-05-25 10:40:26 -07:00
Ishaan Jaff	829a190083	feat - spend by provider on UI	2024-05-25 08:36:53 -07:00
Ishaan Jaff	6ae8a4623e	feat - backend - view spend by provider	2024-05-25 08:13:48 -07:00
Ishaan Jaff	bd5dc40340	Merge branch 'main' into litellm_send_alerts_making_new_key	2024-05-24 20:42:17 -07:00
Krrish Dholakia	9b90f91515	feat(ui): settings.tsx ... enable/disable outage alerts on admin ui	2024-05-24 20:04:15 -07:00
Krish Dholakia	d25ed9c4d3	Merge pull request #3828 from BerriAI/litellm_outage_alerting ... fix(slack_alerting.py): support region based outage alerting	2024-05-24 19:13:17 -07:00
Krrish Dholakia	8dec87425e	feat(slack_alerting.py): refactor region outage alerting to do model based alerting instead ... Unable to extract azure region from api base, makes sense to start with model alerting and then move to region	2024-05-24 19:10:33 -07:00
Ishaan Jaff	db54599222	feat - send email on api key created	2024-05-24 18:14:45 -07:00
Ishaan Jaff	41879ae002	feat - email alerts on /key/generate	2024-05-24 17:33:15 -07:00
Ishaan Jaff	36916852ad	fix - user_id_information	2024-05-24 15:37:36 -07:00
Ishaan Jaff	4f4607a4df	fix - send email alert when token crossed it's budget	2024-05-24 15:22:28 -07:00
Krrish Dholakia	2af4948af4	feat(proxy_server.py): add setup instructions for UI	2024-05-24 08:15:44 -07:00
Krrish Dholakia	f04e4b921b	feat(ui/model_dashboard.tsx): add databricks models via admin ui	2024-05-23 20:28:54 -07:00
Ishaan Jaff	30ac77532b	feat - enfore enterprise checks	2024-05-23 16:11:30 -07:00
Ishaan Jaff	580a342fdf	Merge pull request #3803 from BerriAI/litellm_add_lakera_ai ... [Feat] Add Lakera AI Prompt Injection Detection	2024-05-23 16:01:24 -07:00
Ishaan Jaff	769070b3fe	Merge pull request #3797 from BerriAI/litellm_fix_post_call_streaming_hooks ... [Fix] async_post_call_streaming_hook not triggered on proxy server	2024-05-23 15:35:47 -07:00
Ishaan Jaff	ec41226ee8	feat - add lakera ai prompt injection detection	2024-05-23 15:16:46 -07:00
Ishaan Jaff	1fe035c6dd	feat - add open ai moderations check	2024-05-23 13:08:06 -07:00
Ishaan Jaff	5291f380c9	feat - async_post_call_streaming_hook	2024-05-23 09:30:53 -07:00
Krrish Dholakia	a33b9221da	fix(proxy_server.py): fix admin allowed routes	2024-05-22 20:55:21 -07:00
Ishaan Jaff	9ba7d26597	feat - raise exception when creating team_id for exiting team_id	2024-05-22 20:26:56 -07:00
Ishaan Jaff	a8b64a01dc	Merge pull request #3790 from BerriAI/litellm_set_team_member_budgets ... [Feat] Set Budgets for Users within a Team	2024-05-22 19:44:04 -07:00
Krrish Dholakia	8d1067c81c	fix(time_to_first_token.tsx): require enterprise license for usage	2024-05-22 19:20:30 -07:00
Ishaan Jaff	c535576af5	feat - update existing_team_member_spend in memory	2024-05-22 18:44:44 -07:00
Ishaan Jaff	7a8d78e6c9	feat - check team member spend, budget	2024-05-22 18:36:39 -07:00
Krish Dholakia	3400596dd2	Merge pull request #3787 from BerriAI/litellm_set_budgets_ui_2 ... feat(proxy_server.py): enable admin to set tpm/rpm limits for end-users via UI	2024-05-22 18:22:51 -07:00
Krish Dholakia	5a3aca10ce	Merge pull request #3789 from BerriAI/litellm_ttft_ui ... feat(schema.prisma): store model id + model group as part of spend logs allows precise model metrics	2024-05-22 18:22:39 -07:00
Krrish Dholakia	259003ad8c	fix(proxy_server.py): fix model metrics to return slow responses based on model group	2024-05-22 18:21:27 -07:00
Krrish Dholakia	0f2c55dd81	feat(ui/time_to_first_token.tsx): add time to first token card to model metrics	2024-05-22 18:09:53 -07:00
Ishaan Jaff	c2d25b9a14	feat - update team+user_id spend	2024-05-22 17:49:54 -07:00
Ishaan Jaff	50461eb22c	feat - create budgets when team/member_add	2024-05-22 17:16:19 -07:00
Krrish Dholakia	7f0d85f12a	feat(proxy_server.py): enable admin to create/delete budgets for end-users	2024-05-22 16:20:06 -07:00
Ishaan Jaff	42078ac285	fix - run tpm / rpm checks on proxy admin keys too	2024-05-22 16:15:09 -07:00
Ishaan Jaff	e6b406d739	feat - enforce end user tpm / rpm limits	2024-05-22 15:45:30 -07:00
Krrish Dholakia	9609df16d3	feat(proxy_server.py): new 'add budget' endpoint ... create a budget object (max budget, tpm /rpm limits, etc.) and assign that to a user/team/etc.	2024-05-22 13:16:37 -07:00
Ishaan Jaff	b81fcf2482	feat -add failure callbacks from DB to proxy	2024-05-21 22:00:36 -07:00
Ishaan Jaff	64130e368c	feat - create keys with permissions	2024-05-21 18:04:17 -07:00
Ishaan Jaff	829ca84f07	Merge pull request #3750 from BerriAI/litellm_raise_exception_when_deleting_updating_team ... [Fix] - raise Exception when trying to update/delete a non-existent team	2024-05-20 18:42:27 -07:00
Krish Dholakia	707cf24472	Merge branch 'main' into litellm_webhook_support	2024-05-20 18:41:58 -07:00
Ishaan Jaff	ad91bff6f7	Merge pull request #3749 from BerriAI/litellm_raise_404_when_team_not_exist ... [Fix] - raise 404 from `/team/info` when team does not exist	2024-05-20 17:52:43 -07:00
Krish Dholakia	c6bb6e325b	Merge pull request #3740 from BerriAI/litellm_return_rejected_response ... feat(proxy_server.py): allow admin to return rejected response as string to user	2024-05-20 17:48:21 -07:00
Krrish Dholakia	9d815be0b5	fix(proxy_server.py): fix error string	2024-05-20 17:37:41 -07:00
Ishaan Jaff	367d86047c	fix - raise Exception when trying to update/delete a non-existtent team	2024-05-20 17:36:08 -07:00