phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 11:14:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
18893 commits 2484 branches 894 tags 537 MiB
Commit graph

485 commits

Author SHA1 Message Date
Ishaan Jaff
dc51fec22e fix migrate to LitellmUserRoles 2024-05-30 13:57:50 -07:00
Ishaan Jaff
2037d88719 fix - make email alerting free 2024-05-27 19:27:20 -07:00
Krrish Dholakia
4e97b42ffd refactor(proxy/utils.py): cleanup dead code 2024-05-27 08:52:01 -07:00
Krrish Dholakia
56fd0c60d1 fix(parallel_request_limiter.py): fix user+team tpm/rpm limit check 
Closes https://github.com/BerriAI/litellm/issues/3788
 2024-05-27 08:48:23 -07:00
Krish Dholakia
960fa8b326 Merge pull request #3844 from BerriAI/litellm_region_based_alerts 
feat(slack_alerting.py): enable provider-region based alerting
 2024-05-25 21:03:16 -07:00
Krrish Dholakia
1f42d086d6 feat(ui): allow admin to configure slack alerting thresholds on ui 2024-05-25 21:01:19 -07:00
Ishaan Jaff
088e8c7474 fiix - update / reset budget 2024-05-25 17:03:27 -07:00
Ishaan Jaff
fbc4c79334 feat - ResetTeamBudgetRequest 2024-05-25 16:52:41 -07:00
Ishaan Jaff
d3a8306952 Merge branch 'main' into litellm_send_alerts_making_new_key 2024-05-24 20:42:17 -07:00
Krrish Dholakia
d2d5e2d389 feat(ui): settings.tsx 
enable/disable outage alerts on admin ui
 2024-05-24 20:04:15 -07:00
Krish Dholakia
40791ee1f8 Merge pull request #3828 from BerriAI/litellm_outage_alerting 
fix(slack_alerting.py): support region based outage alerting
 2024-05-24 19:13:17 -07:00
Ishaan Jaff
35b38bad4c feat - email alerts on /key/generate 2024-05-24 17:33:15 -07:00
Krrish Dholakia
7368406c24 fix(slack_alerting.py): support region based outage alerting 2024-05-24 16:59:16 -07:00
Ishaan Jaff
fd5a7a738f feat check SMTP_SENDER_EMAIL + put behind enterprise license 2024-05-24 14:37:53 -07:00
Ishaan Jaff
215fb132f9 fix send_email update 2024-05-24 14:23:27 -07:00
Krrish Dholakia
c441232c62 feat(proxy_server.py): add setup instructions for UI 2024-05-24 08:15:44 -07:00
Ishaan Jaff
56c2d63d1f feat - async_post_call_streaming_hook 2024-05-23 09:30:53 -07:00
Ishaan Jaff
e2fa0cf79f Merge pull request #3790 from BerriAI/litellm_set_team_member_budgets 
[Feat] Set Budgets for Users within a Team
 2024-05-22 19:44:04 -07:00
Ishaan Jaff
181675c6b7 feat - check team member spend, budget 2024-05-22 18:36:39 -07:00
Ishaan Jaff
5a013fb7be feat - update team+user_id spend 2024-05-22 17:49:54 -07:00
Krrish Dholakia
2bdff9b19e feat(schema.prisma): store model id + model group as part of spend logs 
allows precise model metrics
 2024-05-22 17:29:44 -07:00
Krrish Dholakia
fda9e7107a build(schema.prisma): add completion_start_time to spend logs 
enables time to first token tracking for models
 2024-05-22 16:43:08 -07:00
Krish Dholakia
f3a47e4b1a Merge branch 'main' into litellm_webhook_support 2024-05-20 18:41:58 -07:00
Krish Dholakia
db77e41833 Merge pull request #3740 from BerriAI/litellm_return_rejected_response 
feat(proxy_server.py): allow admin to return rejected response as string to user
 2024-05-20 17:48:21 -07:00
Krrish Dholakia
fd13a830ab fix(slack_alerting.py): cleanup webhook event 2024-05-20 16:55:01 -07:00
Ishaan Jaff
7e6c9274fc Merge branch 'main' into litellm_standardize_slack_exception_msg_format 2024-05-20 16:39:41 -07:00
Ishaan Jaff
6194860da4 fix standardize llm exception alert to msg: value 2024-05-20 16:23:48 -07:00
Krrish Dholakia
c0d5e83570 feat(slack_alerting.py): support webhook for budget alerts 
Closes https://github.com/BerriAI/litellm/issues/3743
 2024-05-20 15:30:56 -07:00
Ishaan Jaff
175ef7f4f2 fix - only adding alerting callbacks when alerting is on 2024-05-20 14:59:06 -07:00
Krrish Dholakia
8fb8d068fb feat(proxy_server.py): refactor returning rejected message, to work with error logging 
log the rejected request as a failed call to langfuse/slack alerting
 2024-05-20 11:14:36 -07:00
Krrish Dholakia
45fedb83c6 feat(proxy_server.py): allow admin to return rejected response as string to user 
Closes https://github.com/BerriAI/litellm/issues/3671
 2024-05-20 10:30:23 -07:00
Ishaan Jaff
70194f7ba2 fix - allow users to opt into specific alert types 2024-05-16 16:52:44 -07:00
Krish Dholakia
4c8b620352 Merge pull request #3685 from BerriAI/litellm_lago_integration 
feat(lago.py): Enable Usage-based billing with lago
 2024-05-16 13:09:48 -07:00
Krrish Dholakia
d167a9ea99 feat(lago.py): adding support for usage-based billing with lago 
Closes https://github.com/BerriAI/litellm/issues/3639
 2024-05-16 10:54:18 -07:00
Krish Dholakia
07a1cf39e8 Merge branch 'main' into litellm_end_user_cost_tracking 2024-05-15 22:27:04 -07:00
Ishaan Jaff
d257518e47 fix deep copy logic in during_call_hook 2024-05-15 17:34:54 -07:00
Ishaan Jaff
38a539baf4 show debug info on slack alerts 2024-05-15 13:23:44 -07:00
Krrish Dholakia
9945387d7a feat(proxy_server.py): new /end_user/info endpoint 
get spend for a specific end-user
 2024-05-15 09:50:52 -07:00
Krish Dholakia
64ca2fde53 Merge branch 'main' into litellm_region_based_routing 2024-05-08 22:19:51 -07:00
Krrish Dholakia
7c99808529 feat(proxy_server.py): add CRUD endpoints for 'end_user' management 
allow admin to specify region + default models for end users
 2024-05-08 18:50:36 -07:00
Krrish Dholakia
5f93cae3ff feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00
Krrish Dholakia
e5c57cdddb feat(slack_alerting.py): reintegrate langfuse trace url for slack alerts 
this ensures langfuse trace url returned in llm api exception err
 2024-05-07 12:58:49 -07:00
Krrish Dholakia
2170e1723d feat(proxy_server.py): schedule slack daily report if enabled 
if user enabled daily_reports, send them a slack report every 12 hours
 2024-05-06 18:25:48 -07:00
Krrish Dholakia
0c1fc34e9f feat(slack_alerting.py): support sending daily reports on deployments 
allow admin to easily know slow + failing deployments

Closes  https://github.com/BerriAI/litellm/issues/3483
 2024-05-06 17:18:42 -07:00
Krrish Dholakia
4a22948ce4 fix(proxy/utils.py): fix slack alerting to only raise alerts for llm api exceptions 
don't spam for bad user requests. Closes https://github.com/BerriAI/litellm/issues/3395
 2024-05-02 17:18:21 -07:00
Krrish Dholakia
c1ffa7d409 fix(proxy/utils.py): fix retry logic for generic data request 2024-05-02 14:50:50 -07:00
Krrish Dholakia
e7b3ac8e06 feat(openmeter.py): add support for user billing 
open-meter supports user based billing. Closes https://github.com/BerriAI/litellm/issues/1268
 2024-05-01 17:23:48 -07:00
Krrish Dholakia
0b2c3f78d4 fix(proxy/utils.py): emit number of spend transactions for keys being written to db in a batch 2024-05-01 08:25:04 -07:00
Krrish Dholakia
462724feef fix(proxy/utils.py): log rejected proxy requests to langfuse 2024-04-25 19:26:27 -07:00
Ishaan Jaff
2190b039fd pass alert type on alerting handle 2024-04-25 13:05:34 -07:00