Krish Dholakia
|
322f89782f
|
Merge pull request #3839 from BerriAI/litellm_fix_models_endpoint
fix(proxy_server.py): fix model check for `/v1/models` + `/model/info` endpoint when team has restricted access
|
2024-05-25 14:23:01 -07:00 |
|
Ishaan Jaff
|
7ff8204573
|
fix - linting error
|
2024-05-25 13:30:32 -07:00 |
|
Krrish Dholakia
|
95566dc249
|
fix(proxy_server.py): fix model list returned for /model/info when team has restricted access
|
2024-05-25 13:21:33 -07:00 |
|
Krrish Dholakia
|
25a2f00db6
|
fix(proxy_server.py): fix model check for /v1/models endpoint when team has restricted access
|
2024-05-25 13:02:03 -07:00 |
|
Ishaan Jaff
|
50bd6e9a61
|
Merge pull request #3836 from BerriAI/litellm_ui_show_activity_tab
[Feat] - Admin UI - New Activity Tab
|
2024-05-25 12:37:18 -07:00 |
|
Ishaan Jaff
|
1afc18f371
|
fix - clean up proxy.py
|
2024-05-25 12:22:28 -07:00 |
|
Ishaan Jaff
|
aa50020bda
|
fix - backend sort by date + /global/activity/model
|
2024-05-25 12:21:14 -07:00 |
|
Krrish Dholakia
|
19321094da
|
fix(proxy_server.py): allow user_api_key_cache_ttl to be a controllable param
|
2024-05-25 12:07:28 -07:00 |
|
Ishaan Jaff
|
3bab323dcc
|
fix - formatting on admin ui
|
2024-05-25 10:51:36 -07:00 |
|
Ishaan Jaff
|
6d91ffd050
|
backend - get all up global activ
|
2024-05-25 10:40:26 -07:00 |
|
Ishaan Jaff
|
829a190083
|
feat - spend by provider on UI
|
2024-05-25 08:36:53 -07:00 |
|
Ishaan Jaff
|
6ae8a4623e
|
feat - backend - view spend by provider
|
2024-05-25 08:13:48 -07:00 |
|
Ishaan Jaff
|
bd5dc40340
|
Merge branch 'main' into litellm_send_alerts_making_new_key
|
2024-05-24 20:42:17 -07:00 |
|
Krrish Dholakia
|
9b90f91515
|
feat(ui): settings.tsx
enable/disable outage alerts on admin ui
|
2024-05-24 20:04:15 -07:00 |
|
Krish Dholakia
|
d25ed9c4d3
|
Merge pull request #3828 from BerriAI/litellm_outage_alerting
fix(slack_alerting.py): support region based outage alerting
|
2024-05-24 19:13:17 -07:00 |
|
Krrish Dholakia
|
8dec87425e
|
feat(slack_alerting.py): refactor region outage alerting to do model based alerting instead
Unable to extract azure region from api base, makes sense to start with model alerting and then move to region
|
2024-05-24 19:10:33 -07:00 |
|
Ishaan Jaff
|
db54599222
|
feat - send email on api key created
|
2024-05-24 18:14:45 -07:00 |
|
Ishaan Jaff
|
41879ae002
|
feat - email alerts on /key/generate
|
2024-05-24 17:33:15 -07:00 |
|
Ishaan Jaff
|
36916852ad
|
fix - user_id_information
|
2024-05-24 15:37:36 -07:00 |
|
Ishaan Jaff
|
4f4607a4df
|
fix - send email alert when token crossed it's budget
|
2024-05-24 15:22:28 -07:00 |
|
Krrish Dholakia
|
2af4948af4
|
feat(proxy_server.py): add setup instructions for UI
|
2024-05-24 08:15:44 -07:00 |
|
Krrish Dholakia
|
f04e4b921b
|
feat(ui/model_dashboard.tsx): add databricks models via admin ui
|
2024-05-23 20:28:54 -07:00 |
|
Ishaan Jaff
|
30ac77532b
|
feat - enfore enterprise checks
|
2024-05-23 16:11:30 -07:00 |
|
Ishaan Jaff
|
580a342fdf
|
Merge pull request #3803 from BerriAI/litellm_add_lakera_ai
[Feat] Add Lakera AI Prompt Injection Detection
|
2024-05-23 16:01:24 -07:00 |
|
Ishaan Jaff
|
769070b3fe
|
Merge pull request #3797 from BerriAI/litellm_fix_post_call_streaming_hooks
[Fix] async_post_call_streaming_hook not triggered on proxy server
|
2024-05-23 15:35:47 -07:00 |
|
Ishaan Jaff
|
ec41226ee8
|
feat - add lakera ai prompt injection detection
|
2024-05-23 15:16:46 -07:00 |
|
Ishaan Jaff
|
1fe035c6dd
|
feat - add open ai moderations check
|
2024-05-23 13:08:06 -07:00 |
|
Ishaan Jaff
|
5291f380c9
|
feat - async_post_call_streaming_hook
|
2024-05-23 09:30:53 -07:00 |
|
Krrish Dholakia
|
a33b9221da
|
fix(proxy_server.py): fix admin allowed routes
|
2024-05-22 20:55:21 -07:00 |
|
Ishaan Jaff
|
9ba7d26597
|
feat - raise exception when creating team_id for exiting team_id
|
2024-05-22 20:26:56 -07:00 |
|
Ishaan Jaff
|
a8b64a01dc
|
Merge pull request #3790 from BerriAI/litellm_set_team_member_budgets
[Feat] Set Budgets for Users within a Team
|
2024-05-22 19:44:04 -07:00 |
|
Krrish Dholakia
|
8d1067c81c
|
fix(time_to_first_token.tsx): require enterprise license for usage
|
2024-05-22 19:20:30 -07:00 |
|
Ishaan Jaff
|
c535576af5
|
feat - update existing_team_member_spend in memory
|
2024-05-22 18:44:44 -07:00 |
|
Ishaan Jaff
|
7a8d78e6c9
|
feat - check team member spend, budget
|
2024-05-22 18:36:39 -07:00 |
|
Krish Dholakia
|
3400596dd2
|
Merge pull request #3787 from BerriAI/litellm_set_budgets_ui_2
feat(proxy_server.py): enable admin to set tpm/rpm limits for end-users via UI
|
2024-05-22 18:22:51 -07:00 |
|
Krish Dholakia
|
5a3aca10ce
|
Merge pull request #3789 from BerriAI/litellm_ttft_ui
feat(schema.prisma): store model id + model group as part of spend logs allows precise model metrics
|
2024-05-22 18:22:39 -07:00 |
|
Krrish Dholakia
|
259003ad8c
|
fix(proxy_server.py): fix model metrics to return slow responses based on model group
|
2024-05-22 18:21:27 -07:00 |
|
Krrish Dholakia
|
0f2c55dd81
|
feat(ui/time_to_first_token.tsx): add time to first token card to model metrics
|
2024-05-22 18:09:53 -07:00 |
|
Ishaan Jaff
|
c2d25b9a14
|
feat - update team+user_id spend
|
2024-05-22 17:49:54 -07:00 |
|
Ishaan Jaff
|
50461eb22c
|
feat - create budgets when team/member_add
|
2024-05-22 17:16:19 -07:00 |
|
Krrish Dholakia
|
7f0d85f12a
|
feat(proxy_server.py): enable admin to create/delete budgets for end-users
|
2024-05-22 16:20:06 -07:00 |
|
Ishaan Jaff
|
42078ac285
|
fix - run tpm / rpm checks on proxy admin keys too
|
2024-05-22 16:15:09 -07:00 |
|
Ishaan Jaff
|
e6b406d739
|
feat - enforce end user tpm / rpm limits
|
2024-05-22 15:45:30 -07:00 |
|
Krrish Dholakia
|
9609df16d3
|
feat(proxy_server.py): new 'add budget' endpoint
create a budget object (max budget, tpm /rpm limits, etc.) and assign that to a user/team/etc.
|
2024-05-22 13:16:37 -07:00 |
|
Ishaan Jaff
|
b81fcf2482
|
feat -add failure callbacks from DB to proxy
|
2024-05-21 22:00:36 -07:00 |
|
Ishaan Jaff
|
64130e368c
|
feat - create keys with permissions
|
2024-05-21 18:04:17 -07:00 |
|
Ishaan Jaff
|
829ca84f07
|
Merge pull request #3750 from BerriAI/litellm_raise_exception_when_deleting_updating_team
[Fix] - raise Exception when trying to update/delete a non-existent team
|
2024-05-20 18:42:27 -07:00 |
|
Krish Dholakia
|
707cf24472
|
Merge branch 'main' into litellm_webhook_support
|
2024-05-20 18:41:58 -07:00 |
|
Ishaan Jaff
|
ad91bff6f7
|
Merge pull request #3749 from BerriAI/litellm_raise_404_when_team_not_exist
[Fix] - raise 404 from `/team/info` when team does not exist
|
2024-05-20 17:52:43 -07:00 |
|
Krish Dholakia
|
c6bb6e325b
|
Merge pull request #3740 from BerriAI/litellm_return_rejected_response
feat(proxy_server.py): allow admin to return rejected response as string to user
|
2024-05-20 17:48:21 -07:00 |
|