Commit graph

34 commits

Author SHA1 Message Date
Krish Dholakia
3ef5d40b73
Merge pull request #4205 from BerriAI/litellm_alerting_metadata
fix(slack_alerting.py): allow new 'alerting_metadata' arg
2024-06-14 19:04:30 -07:00
Krrish Dholakia
9e8eacbc77 test(test_alerting.py): fix tests 2024-06-14 16:20:54 -07:00
Krrish Dholakia
e18002023a fix(slack_alerting.py): allow new 'alerting_metadata' arg
Allows user to pass in additional alerting metadata for debugging
2024-06-14 16:06:47 -07:00
Ishaan Jaff
63ddc3d012 test_alerting 2024-06-14 08:45:04 -07:00
Ishaan Jaff
a01746c19e fix test_daily_reports_redis_cache_scheduler 2024-06-01 21:00:24 -07:00
Krrish Dholakia
f729370890 feat(proxy_server.py): emit webhook event whenever customer spend is tracked
Closes https://github.com/BerriAI/litellm/issues/3903
2024-05-29 15:59:32 -07:00
Krrish Dholakia
dde6af7420 test(test_alerting.py): fix test 2024-05-25 21:48:01 -07:00
Krrish Dholakia
c2f19d631e feat(slack_alerting.py): enable provider-region based alerting 2024-05-25 16:55:46 -07:00
Ishaan Jaff
9d3b2e7e0d test alerting 2024-05-24 20:54:17 -07:00
Krrish Dholakia
8dec87425e feat(slack_alerting.py): refactor region outage alerting to do model based alerting instead
Unable to extract azure region from api base, makes sense to start with model alerting and then move to region
2024-05-24 19:10:33 -07:00
Krrish Dholakia
2cdb0584d1 fix(slack_alerting.py): fixes for outage alerting 2024-05-24 17:17:17 -07:00
Krrish Dholakia
f8350b9461 fix(slack_alerting.py): support region based outage alerting 2024-05-24 16:59:16 -07:00
Krrish Dholakia
9804eabcd5 test(test_alerting.py): fix testing 2024-05-20 17:01:34 -07:00
Krrish Dholakia
867f9300e3 fix(slack_alerting.py): cleanup webhook event 2024-05-20 16:55:01 -07:00
Krrish Dholakia
cba2b729b2 test(test_alerting.py): testing fixes 2024-05-20 15:37:35 -07:00
Krrish Dholakia
da0e5d1b8d feat(slack_alerting.py): support webhook for budget alerts
Closes https://github.com/BerriAI/litellm/issues/3743
2024-05-20 15:30:56 -07:00
Krrish Dholakia
1384ee3c57 fix(slack_alerting.py): prevent alert spam within 24 hr period for budget alerts
Closes https://github.com/BerriAI/litellm/issues/3738
2024-05-20 13:35:19 -07:00
Anand Taralika
bd2e4cdfe0 Fixed the test alert sequence
Also fixed the issue that MagicMock does not create asynchronous mocks by default.
2024-05-13 22:43:12 -07:00
Anand Taralika
30332a6d68
Added tests for ignoring 0 metrics when alerting 2024-05-13 21:29:52 -07:00
Ishaan Jaff
596adf6e2f test - slack alerting on litellm router 2024-05-07 19:04:25 -07:00
Ishaan Jaff
b1230dd919 test - slack alerts on router 2024-05-07 15:12:21 -07:00
Krrish Dholakia
724660606a fix(slack_alerting.py): fix storing + reading datetime object from cache
this converts the dt object to isoformat before storing, and loads it back to dt when comparing
2024-05-07 11:44:55 -07:00
Krish Dholakia
aa62d891a0
Merge branch 'main' into litellm_slack_daily_reports 2024-05-06 19:31:20 -07:00
Krrish Dholakia
72299a6894 fix(slack_alerting.py): allow internal cache to be an optional param 2024-05-06 18:34:09 -07:00
Ishaan Jaff
a382517992 fix - test alerting 2024-05-06 18:07:58 -07:00
Krrish Dholakia
718f423d7d feat(slack_alerting.py): support sending daily reports on deployments
allow admin to easily know slow + failing deployments

Closes  https://github.com/BerriAI/litellm/issues/3483
2024-05-06 17:18:42 -07:00
Ishaan Jaff
926670bfb7
Merge pull request #3429 from BerriAI/litellm_add_unit_tests_slack_alerts
[Test] Add Slack Alerting unit tests
2024-05-03 16:27:40 -07:00
Krrish Dholakia
5b39f8e282 feat(proxy_server.py): return api base in response headers
Closes https://github.com/BerriAI/litellm/issues/2631
2024-05-03 15:27:32 -07:00
Ishaan Jaff
bae5d3601d feat - add unit tests for slack alerting 2024-05-03 15:08:55 -07:00
Krrish Dholakia
fdc4fdb91a fix(proxy/utils.py): fix slack alerting to only raise alerts for llm api exceptions
don't spam for bad user requests. Closes https://github.com/BerriAI/litellm/issues/3395
2024-05-02 17:18:21 -07:00
Ishaan Jaff
2aa849b7ae fix test alerting 2024-04-25 13:06:17 -07:00
Ishaan Jaff
c1ea3597bc fix test alerting 2024-04-23 19:10:06 -07:00
Krrish Dholakia
6773341a08 test(test_alerting.py): remove duplicate test 2024-04-06 19:33:01 -07:00
Krrish Dholakia
6110d32b1c feat(proxy/utils.py): return api base for request hanging alerts 2024-04-06 15:58:53 -07:00