phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
12101 commits 2490 branches 894 tags 548 MiB
Commit graph

2218 commits

Author SHA1 Message Date
Ishaan Jaff
f548334e8b build - prisma schema change 2024-05-22 17:19:31 -07:00
Ishaan Jaff
50461eb22c feat - create budgets when team/member_add 2024-05-22 17:16:19 -07:00
Ishaan Jaff
31fc6d79af
Merge pull request #3785 from BerriAI/litellm_end_user_rate_limits 
[Feat] LiteLLM Proxy: Enforce End-User TPM, RPM Limits
 2024-05-22 17:12:58 -07:00
Krrish Dholakia
9f518030b9 build(schema.prisma): add completion_start_time to spend logs 
enables time to first token tracking for models
 2024-05-22 16:43:08 -07:00
Krrish Dholakia
7f0d85f12a feat(proxy_server.py): enable admin to create/delete budgets for end-users 2024-05-22 16:20:06 -07:00
Ishaan Jaff
42078ac285 fix - run tpm / rpm checks on proxy admin keys too 2024-05-22 16:15:09 -07:00
Ishaan Jaff
e6b406d739 feat - enforce end user tpm / rpm limits 2024-05-22 15:45:30 -07:00
Ishaan Jaff
106910cecf feat - add end user rate limiting 2024-05-22 14:01:57 -07:00
Ishaan Jaff
eac7e70dca feat - include litellm_budget table when getting end_user 2024-05-22 13:30:08 -07:00
Krrish Dholakia
9609df16d3 feat(proxy_server.py): new 'add budget' endpoint 
create a budget object (max budget, tpm /rpm limits, etc.) and assign that to a user/team/etc.
 2024-05-22 13:16:37 -07:00
Ishaan Jaff
b81fcf2482 feat -add failure callbacks from DB to proxy 2024-05-21 22:00:36 -07:00
Ishaan Jaff
64130e368c feat - create keys with permissions 2024-05-21 18:04:17 -07:00
Ishaan Jaff
829ca84f07
Merge pull request #3750 from BerriAI/litellm_raise_exception_when_deleting_updating_team 
[Fix] - raise Exception when trying to update/delete a non-existent team
 2024-05-20 18:42:27 -07:00
Krish Dholakia
707cf24472
Merge branch 'main' into litellm_webhook_support 2024-05-20 18:41:58 -07:00
Ishaan Jaff
ad91bff6f7
Merge pull request #3749 from BerriAI/litellm_raise_404_when_team_not_exist 
[Fix] - raise 404 from `/team/info`  when team does not exist
 2024-05-20 17:52:43 -07:00
Krish Dholakia
c6bb6e325b
Merge pull request #3740 from BerriAI/litellm_return_rejected_response 
feat(proxy_server.py): allow admin to return rejected response as string to user
 2024-05-20 17:48:21 -07:00
Krrish Dholakia
9d815be0b5 fix(proxy_server.py): fix error string 2024-05-20 17:37:41 -07:00
Ishaan Jaff
367d86047c fix - raise Exception when trying to update/delete a non-existtent team 2024-05-20 17:36:08 -07:00
Ishaan Jaff
f574127bc4 fix - raise 404 when team does not exist 2024-05-20 17:14:03 -07:00
Krrish Dholakia
867f9300e3 fix(slack_alerting.py): cleanup webhook event 2024-05-20 16:55:01 -07:00
Ishaan Jaff
8413fdf4c7
Merge branch 'main' into litellm_standardize_slack_exception_msg_format 2024-05-20 16:39:41 -07:00
Ishaan Jaff
7fad52b7c8
Merge pull request #3745 from BerriAI/litellm_fix_slack_alerting_bug 
fix divide by 0 bug on slack alerting
 2024-05-20 16:38:29 -07:00
Ishaan Jaff
5d24b47d2b fix standardize llm exception alert to msg: value 2024-05-20 16:23:48 -07:00
Ishaan Jaff
498bfa9a4c fix - revert check_request_disconnection 2024-05-20 15:43:29 -07:00
Krrish Dholakia
da0e5d1b8d feat(slack_alerting.py): support webhook for budget alerts 
Closes https://github.com/BerriAI/litellm/issues/3743
 2024-05-20 15:30:56 -07:00
Ishaan Jaff
f417495b7b fix - only adding alerting callbacks when alerting is on 2024-05-20 14:59:06 -07:00
Ishaan Jaff
1deb274d3a
Merge pull request #3742 from BerriAI/litellm_enforce_sso 
[Feat] Enforce user has a valid license when using SSO on LiteLLM Proxy
 2024-05-20 14:07:23 -07:00
Ishaan Jaff
d956020470 fix error on enforce sso 2024-05-20 13:02:56 -07:00
Ishaan Jaff
561b00283c feat - enforce sso on Admin UI 2024-05-20 12:54:08 -07:00
Ishaan Jaff
8e730f57b8 only run check_request_disconnection logic for 10 mins 2024-05-20 12:39:03 -07:00
Krrish Dholakia
b41f30ca60 fix(proxy_server.py): fixes for making rejected responses work with streaming 2024-05-20 12:32:19 -07:00
Ishaan Jaff
b60a098251 docs - update openapi swagger docs 2024-05-20 12:26:42 -07:00
Krrish Dholakia
f11f207ae6 feat(proxy_server.py): refactor returning rejected message, to work with error logging 
log the rejected request as a failed call to langfuse/slack alerting
 2024-05-20 11:14:36 -07:00
Krrish Dholakia
372323c38a feat(proxy_server.py): allow admin to return rejected response as string to user 
Closes https://github.com/BerriAI/litellm/issues/3671
 2024-05-20 10:30:23 -07:00
Krrish Dholakia
058bfb101d feat(proxy_cli.py): support json logs on proxy 
allow user to enable 'json logs' for proxy server
 2024-05-20 09:18:12 -07:00
Krrish Dholakia
25df95ab10 feat(proxy_server.py): new 'supported_openai_params' endpoint 
get supported openai params for a given model
 2024-05-20 08:39:50 -07:00
Krish Dholakia
5e5179e476
Merge branch 'main' into litellm_model_id_fix 2024-05-17 22:36:17 -07:00
Ishaan Jaff
6708a1adaa ui - new build 2024-05-17 21:58:10 -07:00
Ishaan Jaff
8281c150f0
Merge pull request #3713 from BerriAI/litellm_ui_infer_azure_prefix 
[Feat] Admin UI - use `base_model` for Slack Alerts
 2024-05-17 21:55:23 -07:00
Krrish Dholakia
4b3551abfc fix(slack_alerting.py): show langfuse traces on error messages 2024-05-17 18:42:30 -07:00
Krish Dholakia
3a06fe2818
Merge branch 'main' into litellm_bedrock_anthropic_fix 2024-05-17 17:47:32 -07:00
Krrish Dholakia
b137cea230 fix(proxy_server.py): fix setting model id for db models 
get model_id and use that as it's id in router, this enables `/model/delete` to work with the given id from `/model/info`
 2024-05-17 17:45:05 -07:00
Ishaan Jaff
be273b3c3b fix - show correct base_model in slack alerts 2024-05-17 16:07:02 -07:00
Krrish Dholakia
29a26af298 fix(litellm_license.py): fix json handling 2024-05-17 15:48:39 -07:00
Krrish Dholakia
c0d62e94ae feat(proxy_server.py): enable custom branding + routes on openapi docs 
Allows user to add their branding + show only openai routes on docs
 2024-05-17 15:21:29 -07:00
Ishaan Jaff
cae5ecea8e fix llm utils routes 2024-05-17 08:41:46 -07:00
Ishaan Jaff
c1ed863dfa fix - allow non master key to access llm_utils_routes 2024-05-17 08:25:10 -07:00
Krrish Dholakia
180bc46ca4 fix(bedrock_httpx.py): move anthropic bedrock calls to httpx 
Fixing https://github.com/BerriAI/litellm/issues/2921
 2024-05-16 21:51:55 -07:00
Krrish Dholakia
10a672634d fix(proxy_server.py): fix invalid header string 2024-05-16 21:05:40 -07:00
Krish Dholakia
7502e15295
Merge pull request #3701 from paneru-rajan/Issue-3675-remove-empty-valued-header 
Exclude custom headers from response if the value is None or empty string
 2024-05-16 17:42:07 -07:00