Commit graph

1518 commits

Author SHA1 Message Date
Ishaan Jaff
d7043baf6d router - include updated at and created at in model info 2024-05-27 15:53:16 -07:00
Ishaan Jaff
ddfb76a770 fix - show activity by model_group 2024-05-27 11:25:16 -07:00
Krrish Dholakia
56fd0c60d1 fix(parallel_request_limiter.py): fix user+team tpm/rpm limit check
Closes https://github.com/BerriAI/litellm/issues/3788
2024-05-27 08:48:23 -07:00
Krrish Dholakia
8e9a3fef81 feat(proxy_server.py): expose new /model_group/info endpoint
returns model-group level info on supported params, max tokens, pricing, etc.
2024-05-26 14:07:35 -07:00
Krrish Dholakia
a78be8d6f3 build(ui): add enterprise cta 2024-05-25 21:41:53 -07:00
Krish Dholakia
960fa8b326 Merge pull request #3844 from BerriAI/litellm_region_based_alerts
feat(slack_alerting.py): enable provider-region based alerting
2024-05-25 21:03:16 -07:00
Krrish Dholakia
1f42d086d6 feat(ui): allow admin to configure slack alerting thresholds on ui 2024-05-25 21:01:19 -07:00
Ishaan Jaff
1c8bfe827d Merge pull request #3842 from BerriAI/litellm_set_budget_dur
[Fix] Set budget_duration on `/team/new` and `/team/update`
2024-05-25 16:31:39 -07:00
Ishaan Jaff
7928b3aea0 fix - test team_alias 2024-05-25 15:42:52 -07:00
Ishaan Jaff
8efa76f1a4 fix - updating team 2024-05-25 15:31:25 -07:00
Ishaan Jaff
61bc6fae63 test - new_team 2024-05-25 15:20:49 -07:00
Ishaan Jaff
aa1a1bcb24 feat - update budget duration 2024-05-25 14:57:29 -07:00
Ishaan Jaff
f63c7035e5 fix - allow setting budget duration and reset at 2024-05-25 14:38:05 -07:00
Ishaan Jaff
50dfadcbcb feat - set budget duration 2024-05-25 14:32:08 -07:00
Krish Dholakia
02f2d67808 Merge pull request #3839 from BerriAI/litellm_fix_models_endpoint
fix(proxy_server.py): fix model check for `/v1/models` + `/model/info` endpoint when team has restricted access
2024-05-25 14:23:01 -07:00
Ishaan Jaff
7694622007 fix - linting error 2024-05-25 13:30:32 -07:00
Krrish Dholakia
0cbce770a2 fix(proxy_server.py): fix model list returned for /model/info when team has restricted access 2024-05-25 13:21:33 -07:00
Krrish Dholakia
b0afacf7e3 fix(proxy_server.py): fix model check for /v1/models endpoint when team has restricted access 2024-05-25 13:02:03 -07:00
Ishaan Jaff
83eab81b1c Merge pull request #3836 from BerriAI/litellm_ui_show_activity_tab
[Feat] - Admin UI - New Activity Tab
2024-05-25 12:37:18 -07:00
Ishaan Jaff
c7fea8d1ba fix - clean up proxy.py 2024-05-25 12:22:28 -07:00
Ishaan Jaff
19b1ac7c82 fix - backend sort by date + /global/activity/model 2024-05-25 12:21:14 -07:00
Krrish Dholakia
2db3819142 fix(proxy_server.py): allow user_api_key_cache_ttl to be a controllable param 2024-05-25 12:07:28 -07:00
Ishaan Jaff
30adc7c554 fix - formatting on admin ui 2024-05-25 10:51:36 -07:00
Ishaan Jaff
7a7c3ce1bb backend - get all up global activ 2024-05-25 10:40:26 -07:00
Ishaan Jaff
fcaa4408c0 feat - spend by provider on UI 2024-05-25 08:36:53 -07:00
Ishaan Jaff
b78ddfc5e4 feat - backend - view spend by provider 2024-05-25 08:13:48 -07:00
Ishaan Jaff
d3a8306952 Merge branch 'main' into litellm_send_alerts_making_new_key 2024-05-24 20:42:17 -07:00
Krrish Dholakia
d2d5e2d389 feat(ui): settings.tsx
enable/disable outage alerts on admin ui
2024-05-24 20:04:15 -07:00
Krish Dholakia
40791ee1f8 Merge pull request #3828 from BerriAI/litellm_outage_alerting
fix(slack_alerting.py): support region based outage alerting
2024-05-24 19:13:17 -07:00
Krrish Dholakia
4536ed6f6e feat(slack_alerting.py): refactor region outage alerting to do model based alerting instead
Unable to extract azure region from api base, makes sense to start with model alerting and then move to region
2024-05-24 19:10:33 -07:00
Ishaan Jaff
b7888bac36 feat - send email on api key created 2024-05-24 18:14:45 -07:00
Ishaan Jaff
35b38bad4c feat - email alerts on /key/generate 2024-05-24 17:33:15 -07:00
Ishaan Jaff
bc47ec4c86 fix - user_id_information 2024-05-24 15:37:36 -07:00
Ishaan Jaff
35a767d52c fix - send email alert when token crossed it's budget 2024-05-24 15:22:28 -07:00
Krrish Dholakia
c441232c62 feat(proxy_server.py): add setup instructions for UI 2024-05-24 08:15:44 -07:00
Krrish Dholakia
c50074a0b7 feat(ui/model_dashboard.tsx): add databricks models via admin ui 2024-05-23 20:28:54 -07:00
Ishaan Jaff
fd0bc03109 feat - enfore enterprise checks 2024-05-23 16:11:30 -07:00
Ishaan Jaff
3e7ec4714d Merge pull request #3803 from BerriAI/litellm_add_lakera_ai
[Feat] Add Lakera AI Prompt Injection Detection
2024-05-23 16:01:24 -07:00
Ishaan Jaff
bd2bdfa01e Merge pull request #3797 from BerriAI/litellm_fix_post_call_streaming_hooks
[Fix]  async_post_call_streaming_hook not triggered on proxy server
2024-05-23 15:35:47 -07:00
Ishaan Jaff
60d2778d69 feat - add lakera ai prompt injection detection 2024-05-23 15:16:46 -07:00
Ishaan Jaff
759852b1b8 feat - add open ai moderations check 2024-05-23 13:08:06 -07:00
Ishaan Jaff
56c2d63d1f feat - async_post_call_streaming_hook 2024-05-23 09:30:53 -07:00
Krrish Dholakia
7eeb8d6251 fix(proxy_server.py): fix admin allowed routes 2024-05-22 20:55:21 -07:00
Ishaan Jaff
0738ffca5b feat - raise exception when creating team_id for exiting team_id 2024-05-22 20:26:56 -07:00
Ishaan Jaff
e2fa0cf79f Merge pull request #3790 from BerriAI/litellm_set_team_member_budgets
[Feat] Set Budgets for Users within a Team
2024-05-22 19:44:04 -07:00
Krrish Dholakia
5571b9f4a3 fix(time_to_first_token.tsx): require enterprise license for usage 2024-05-22 19:20:30 -07:00
Ishaan Jaff
2a5e654b1a feat - update existing_team_member_spend in memory 2024-05-22 18:44:44 -07:00
Ishaan Jaff
181675c6b7 feat - check team member spend, budget 2024-05-22 18:36:39 -07:00
Krish Dholakia
f5ddc5440a Merge pull request #3787 from BerriAI/litellm_set_budgets_ui_2
feat(proxy_server.py): enable admin to set tpm/rpm limits for end-users via UI
2024-05-22 18:22:51 -07:00
Krish Dholakia
8e0825295f Merge pull request #3789 from BerriAI/litellm_ttft_ui
feat(schema.prisma): store model id + model group as part of spend logs allows precise model metrics
2024-05-22 18:22:39 -07:00