Commit graph

104 commits

Author SHA1 Message Date
Krish Dholakia
f9e6507cd1
LiteLLM Minor Fixes + Improvements (#5474)
* feat(proxy/_types.py): add lago billing to callbacks ui

Closes https://github.com/BerriAI/litellm/issues/5472

* fix(anthropic.py): return anthropic prompt caching information

Fixes https://github.com/BerriAI/litellm/issues/5364

* feat(bedrock/chat.py): support 'json_schema' for bedrock models

Closes https://github.com/BerriAI/litellm/issues/5434

* fix(bedrock/embed/embeddings.py): support async embeddings for amazon titan models

* fix: linting fixes

* fix: handle key errors

* fix(bedrock/chat.py): fix bedrock ai21 streaming object

* feat(bedrock/embed): support bedrock embedding optional params

* fix(databricks.py): fix usage chunk

* fix(internal_user_endpoints.py): apply internal user defaults, if user role updated

Fixes issue where user update wouldn't apply defaults

* feat(slack_alerting.py): provide multiple slack channels for a given alert type

multiple channels might be interested in receiving an alert for a given type

* docs(alerting.md): add multiple channel alerting to docs
2024-09-02 14:29:57 -07:00
Ishaan Jaff
ae7cc6b198 fix _get_spend_report_for_time_range 2024-08-19 20:53:39 -07:00
Ishaan Jaff
4435a23121 send alert on all key events 2024-08-12 11:39:24 -07:00
Ishaan Jaff
30a54ef007 v0 log KeyCreatedEvent 2024-08-12 10:56:11 -07:00
Ishaan Jaff
35de40e6eb add fallback_reports in slack alert types 2024-08-10 16:08:36 -07:00
Ishaan Jaff
1e90329c4b add error when trying to send emails 2024-08-06 16:03:20 -07:00
Marc Abramowitz
fe27182e8e Add missing space in "Failed Tracking Cost" msg
Fixes stuff like this:

```
Message: Failed Tracking Cost forerror in tracking cost callback - Traceback (most recent call last):
                              ^^^^^^^^
```
2024-07-11 13:26:59 -07:00
Krrish Dholakia
2163434ff3 fix(llm_cost_calc/google.py): fix google embedding cost calculation
Fixes https://github.com/BerriAI/litellm/issues/4630
2024-07-11 11:55:48 -07:00
Ishaan Jaff
e20b540dac add validation on slack 2024-07-10 10:10:32 -07:00
Krrish Dholakia
66c6992f8a fix(slack_alerting.py): use in-memory cache for checking request status 2024-07-02 13:01:59 -07:00
Krrish Dholakia
2584120012 refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
gets the url from logging object
2024-06-21 16:12:25 -07:00
Krrish Dholakia
941574a921 fix(proxy/utils.py): fix add langfuse trace id to alert
Fixing the import after refactor
2024-06-21 14:55:09 -07:00
Ishaan Jaff
da3ae00bd6 fix - proxy refactor user_api_key_auth 2024-06-15 10:33:58 -07:00
Krrish Dholakia
74d8605f5c fix(slack_alerting.py): check if webhook is in alerting list before triggering it
Fixes https://github.com/BerriAI/litellm/issues/4193
2024-06-14 21:20:58 -07:00
Ishaan Jaff
4bfd46d0a6
Merge pull request #4209 from BerriAI/litellm_send_email_alerts_budget_exceeded
[Feat] send email alerts when budget exceeded
2024-06-14 20:23:19 -07:00
Krish Dholakia
3ef5d40b73
Merge pull request #4205 from BerriAI/litellm_alerting_metadata
fix(slack_alerting.py): allow new 'alerting_metadata' arg
2024-06-14 19:04:30 -07:00
Ishaan Jaff
0ec52e57b4 fix - send team budget crossed 2024-06-14 18:52:13 -07:00
Ishaan Jaff
f6d0c6c272 add email alerting for budgets 2024-06-14 18:40:56 -07:00
Krrish Dholakia
e18002023a fix(slack_alerting.py): allow new 'alerting_metadata' arg
Allows user to pass in additional alerting metadata for debugging
2024-06-14 16:06:47 -07:00
Ishaan Jaff
a0ecc6f414 fix - send alert on router level exceptions 2024-06-14 08:41:12 -07:00
Ishaan Jaff
64a9fe1827 docs - redacting messages from slack alerting 2024-06-06 12:30:56 -07:00
Ishaan Jaff
35684fdf4b fix - turn of message logging 2024-06-06 10:48:08 -07:00
Krish Dholakia
ff7291abba
Merge pull request #4028 from BerriAI/litellm_user_invite_links
feat(create_user_button.tsx): allow admin to invite user to proxy via user-email/pwd invite-links
2024-06-05 16:32:24 -07:00
Krrish Dholakia
847cf3111d fix(slack_alerting.py): fix email logo url env passed to proxy 2024-06-05 16:26:50 -07:00
Spencer Krum
46c78cf33b feat: clarify slack alerting message
Specify the time of the next run, not the interval
2024-06-05 11:57:42 -05:00
Ishaan Jaff
71721cfd06 fix - move email templates 2024-05-31 10:37:56 -07:00
Ishaan Jaff
838ab59a84 return correct fields in NewUserResponse 2024-05-31 10:31:19 -07:00
Krrish Dholakia
da56201e80 fix(main.py): pass api key and api base to openai.py for audio transcription call 2024-05-29 21:29:01 -07:00
Krrish Dholakia
cfcf5969c8 fix(proxy_server.py): fix end user object check when master key used
check if end user max budget exceeded for master key
2024-05-29 17:20:59 -07:00
Krrish Dholakia
f729370890 feat(proxy_server.py): emit webhook event whenever customer spend is tracked
Closes https://github.com/BerriAI/litellm/issues/3903
2024-05-29 15:59:32 -07:00
Ishaan Jaff
b5f88b67b3 fix - validation for email alerting 2024-05-27 22:38:17 -07:00
Ishaan Jaff
8d0bd9d8f1 ffeat - make email alerting a free feature 2024-05-27 19:40:47 -07:00
Krrish Dholakia
a9a1447513 feat(ui): allow admin to configure slack alerting thresholds on ui 2024-05-25 21:01:19 -07:00
Krrish Dholakia
c2f19d631e feat(slack_alerting.py): enable provider-region based alerting 2024-05-25 16:55:46 -07:00
Ishaan Jaff
bd5dc40340
Merge branch 'main' into litellm_send_alerts_making_new_key 2024-05-24 20:42:17 -07:00
Krrish Dholakia
9b90f91515 feat(ui): settings.tsx
enable/disable outage alerts on admin ui
2024-05-24 20:04:15 -07:00
Krish Dholakia
d25ed9c4d3
Merge pull request #3828 from BerriAI/litellm_outage_alerting
fix(slack_alerting.py): support region based outage alerting
2024-05-24 19:13:17 -07:00
Krrish Dholakia
8dec87425e feat(slack_alerting.py): refactor region outage alerting to do model based alerting instead
Unable to extract azure region from api base, makes sense to start with model alerting and then move to region
2024-05-24 19:10:33 -07:00
Ishaan Jaff
f6d7d0e520 fix - update webhook event validation 2024-05-24 18:31:10 -07:00
Ishaan Jaff
1434e5b66a feat - customize logo, support contact on email 2024-05-24 18:12:51 -07:00
Ishaan Jaff
fb7fe2b87c feat - send send_key_created_email 2024-05-24 17:59:15 -07:00
Ishaan Jaff
dba35536e9 feat - resize logo 2024-05-24 17:54:38 -07:00
Ishaan Jaff
fa49833cdf feat - send email on new key created 2024-05-24 17:30:06 -07:00
Krrish Dholakia
2cdb0584d1 fix(slack_alerting.py): fixes for outage alerting 2024-05-24 17:17:17 -07:00
Krrish Dholakia
f8350b9461 fix(slack_alerting.py): support region based outage alerting 2024-05-24 16:59:16 -07:00
Ishaan Jaff
c43a4dff7f use litellm prefix in all emails 2024-05-24 15:32:51 -07:00
Ishaan Jaff
06370d24b4 feat - email alerts 2024-05-24 15:23:36 -07:00
Ishaan Jaff
c3dd0a1470 feat check SMTP_SENDER_EMAIL + put behind enterprise license 2024-05-24 14:37:53 -07:00
Ishaan Jaff
9bcbb6cc8b feat - send send_email_alert_using_smtp 2024-05-24 14:29:00 -07:00
Krrish Dholakia
851f26b759 fix(slack_alerting.py): fix time check + add more debug values 2024-05-22 20:11:36 -07:00