Commit graph

2218 commits

Author SHA1 Message Date
Ishaan Jaff
a03d13fedd fix - allow setting budget duration and reset at 2024-05-25 14:38:05 -07:00
Ishaan Jaff
bf0c0c08c8 feat - set budget duration 2024-05-25 14:32:08 -07:00
Ishaan Jaff
7ff8204573 fix - linting error 2024-05-25 13:30:32 -07:00
Ishaan Jaff
b267b1be47 ui - new build 2024-05-25 13:17:10 -07:00
Ishaan Jaff
50bd6e9a61
Merge pull request #3836 from BerriAI/litellm_ui_show_activity_tab
[Feat] - Admin UI - New Activity Tab
2024-05-25 12:37:18 -07:00
Ishaan Jaff
1afc18f371 fix - clean up proxy.py 2024-05-25 12:22:28 -07:00
Ishaan Jaff
aa50020bda fix - backend sort by date + /global/activity/model 2024-05-25 12:21:14 -07:00
Krrish Dholakia
19321094da fix(proxy_server.py): allow user_api_key_cache_ttl to be a controllable param 2024-05-25 12:07:28 -07:00
Ishaan Jaff
3bab323dcc fix - formatting on admin ui 2024-05-25 10:51:36 -07:00
Ishaan Jaff
6d91ffd050 backend - get all up global activ 2024-05-25 10:40:26 -07:00
Ishaan Jaff
829a190083 feat - spend by provider on UI 2024-05-25 08:36:53 -07:00
Ishaan Jaff
6ae8a4623e feat - backend - view spend by provider 2024-05-25 08:13:48 -07:00
Ishaan Jaff
bd5dc40340
Merge branch 'main' into litellm_send_alerts_making_new_key 2024-05-24 20:42:17 -07:00
Krrish Dholakia
9b90f91515 feat(ui): settings.tsx
enable/disable outage alerts on admin ui
2024-05-24 20:04:15 -07:00
Krish Dholakia
d25ed9c4d3
Merge pull request #3828 from BerriAI/litellm_outage_alerting
fix(slack_alerting.py): support region based outage alerting
2024-05-24 19:13:17 -07:00
Krrish Dholakia
8dec87425e feat(slack_alerting.py): refactor region outage alerting to do model based alerting instead
Unable to extract azure region from api base, makes sense to start with model alerting and then move to region
2024-05-24 19:10:33 -07:00
Ishaan Jaff
f6d7d0e520 fix - update webhook event validation 2024-05-24 18:31:10 -07:00
Ishaan Jaff
db54599222 feat - send email on api key created 2024-05-24 18:14:45 -07:00
Ishaan Jaff
41879ae002 feat - email alerts on /key/generate 2024-05-24 17:33:15 -07:00
Ishaan Jaff
fa49833cdf feat - send email on new key created 2024-05-24 17:30:06 -07:00
Krrish Dholakia
f8350b9461 fix(slack_alerting.py): support region based outage alerting 2024-05-24 16:59:16 -07:00
Ishaan Jaff
36916852ad fix - user_id_information 2024-05-24 15:37:36 -07:00
Ishaan Jaff
4f4607a4df fix - send email alert when token crossed it's budget 2024-05-24 15:22:28 -07:00
Ishaan Jaff
c3dd0a1470 feat check SMTP_SENDER_EMAIL + put behind enterprise license 2024-05-24 14:37:53 -07:00
Ishaan Jaff
268d4f7665 fix send_email update 2024-05-24 14:23:27 -07:00
Krrish Dholakia
2af4948af4 feat(proxy_server.py): add setup instructions for UI 2024-05-24 08:15:44 -07:00
Krrish Dholakia
bc399029d8 build(ui): updating admin ui with changes 2024-05-23 20:34:48 -07:00
Krrish Dholakia
f04e4b921b feat(ui/model_dashboard.tsx): add databricks models via admin ui 2024-05-23 20:28:54 -07:00
Ishaan Jaff
30ac77532b feat - enfore enterprise checks 2024-05-23 16:11:30 -07:00
Ishaan Jaff
580a342fdf
Merge pull request #3803 from BerriAI/litellm_add_lakera_ai
[Feat] Add Lakera AI Prompt Injection Detection
2024-05-23 16:01:24 -07:00
Ishaan Jaff
769070b3fe
Merge pull request #3797 from BerriAI/litellm_fix_post_call_streaming_hooks
[Fix]  async_post_call_streaming_hook not triggered on proxy server
2024-05-23 15:35:47 -07:00
Ishaan Jaff
ec41226ee8 feat - add lakera ai prompt injection detection 2024-05-23 15:16:46 -07:00
Ishaan Jaff
ea76432844
Merge pull request #3802 from BerriAI/litellm_add_moderations_safety_check_proxy
[Feat]- Proxy Add OpenAI Content Moderation Pre call hook
2024-05-23 14:30:49 -07:00
Ishaan Jaff
1fe035c6dd feat - add open ai moderations check 2024-05-23 13:08:06 -07:00
Krrish Dholakia
54591e3920 test(test_key_generate_prisma.py): fix tests with unique team id 2024-05-23 12:55:26 -07:00
Ishaan Jaff
5291f380c9 feat - async_post_call_streaming_hook 2024-05-23 09:30:53 -07:00
Krrish Dholakia
a33b9221da fix(proxy_server.py): fix admin allowed routes 2024-05-22 20:55:21 -07:00
Ishaan Jaff
9ba7d26597 feat - raise exception when creating team_id for exiting team_id 2024-05-22 20:26:56 -07:00
Krrish Dholakia
851f26b759 fix(slack_alerting.py): fix time check + add more debug values 2024-05-22 20:11:36 -07:00
Ishaan Jaff
288303f797 (ci/cd) run again - new ui build 2024-05-22 20:04:10 -07:00
Ishaan Jaff
a8b64a01dc
Merge pull request #3790 from BerriAI/litellm_set_team_member_budgets
[Feat] Set Budgets for Users within a Team
2024-05-22 19:44:04 -07:00
Krrish Dholakia
8d1067c81c fix(time_to_first_token.tsx): require enterprise license for usage 2024-05-22 19:20:30 -07:00
Ishaan Jaff
c535576af5 feat - update existing_team_member_spend in memory 2024-05-22 18:44:44 -07:00
Ishaan Jaff
7a8d78e6c9 feat - check team member spend, budget 2024-05-22 18:36:39 -07:00
Krish Dholakia
3400596dd2
Merge pull request #3787 from BerriAI/litellm_set_budgets_ui_2
feat(proxy_server.py): enable admin to set tpm/rpm limits for end-users via UI
2024-05-22 18:22:51 -07:00
Krish Dholakia
5a3aca10ce
Merge pull request #3789 from BerriAI/litellm_ttft_ui
feat(schema.prisma): store model id + model group as part of spend logs allows precise model metrics
2024-05-22 18:22:39 -07:00
Krrish Dholakia
259003ad8c fix(proxy_server.py): fix model metrics to return slow responses based on model group 2024-05-22 18:21:27 -07:00
Krrish Dholakia
0f2c55dd81 feat(ui/time_to_first_token.tsx): add time to first token card to model metrics 2024-05-22 18:09:53 -07:00
Ishaan Jaff
c2d25b9a14 feat - update team+user_id spend 2024-05-22 17:49:54 -07:00
Krrish Dholakia
3c0e9cb48e feat(schema.prisma): store model id + model group as part of spend logs
allows precise model metrics
2024-05-22 17:29:44 -07:00