Krish Dholakia
7f47c48b35
LiteLLM Minor Fixes and Improvements (09/10/2024) ( #5618 )
...
* fix(cost_calculator.py): move to debug for noisy warning message on cost calculation error
Fixes https://github.com/BerriAI/litellm/issues/5610
* fix(databricks/cost_calculator.py): Handles model name issues for databricks models
* fix(main.py): fix stream chunk builder for multiple tool calls
Fixes https://github.com/BerriAI/litellm/issues/5591
* fix: correctly set user_alias when passed in
Fixes https://github.com/BerriAI/litellm/issues/5612
* fix(types/utils.py): allow passing role for message object
https://github.com/BerriAI/litellm/issues/5621
* fix(litellm_logging.py): Fix langfuse logging across multiple projects
Fixes issue where langfuse logger was re-using the old logging object
* feat(proxy/_types.py): support adding key-based tags for tag-based routing
Enable tag based routing at key-level
* fix(proxy/_types.py): fix inheritance
* test(test_key_generate_prisma.py): fix test
* test: fix test
* fix(litellm_logging.py): return used callback object
2024-09-11 11:30:29 -07:00
Ishaan Jaff
5e15cc546a
use get_async_httpx_client for logging httpx
2024-09-10 13:03:55 -07:00
Ishaan Jaff
8286804649
fix slack alerting allow setting custom spend report frequency
2024-09-07 11:42:16 -07:00
Krish Dholakia
11f85d883f
LiteLLM Minor Fixes + Improvements ( #5474 )
...
* feat(proxy/_types.py): add lago billing to callbacks ui
Closes https://github.com/BerriAI/litellm/issues/5472
* fix(anthropic.py): return anthropic prompt caching information
Fixes https://github.com/BerriAI/litellm/issues/5364
* feat(bedrock/chat.py): support 'json_schema' for bedrock models
Closes https://github.com/BerriAI/litellm/issues/5434
* fix(bedrock/embed/embeddings.py): support async embeddings for amazon titan models
* fix: linting fixes
* fix: handle key errors
* fix(bedrock/chat.py): fix bedrock ai21 streaming object
* feat(bedrock/embed): support bedrock embedding optional params
* fix(databricks.py): fix usage chunk
* fix(internal_user_endpoints.py): apply internal user defaults, if user role updated
Fixes issue where user update wouldn't apply defaults
* feat(slack_alerting.py): provide multiple slack channels for a given alert type
multiple channels might be interested in receiving an alert for a given type
* docs(alerting.md): add multiple channel alerting to docs
2024-09-02 14:29:57 -07:00
Ishaan Jaff
2f618d08be
fix _get_spend_report_for_time_range
2024-08-19 20:53:39 -07:00
Ishaan Jaff
0f7d575992
send alert on all key events
2024-08-12 11:39:24 -07:00
Ishaan Jaff
2e2da04024
v0 log KeyCreatedEvent
2024-08-12 10:56:11 -07:00
Ishaan Jaff
f324ca7b86
add fallback_reports in slack alert types
2024-08-10 16:08:36 -07:00
Ishaan Jaff
72756a7dc6
add error when trying to send emails
2024-08-06 16:03:20 -07:00
Marc Abramowitz
3b1459056b
Add missing space in "Failed Tracking Cost" msg
...
Fixes stuff like this:
```
Message: Failed Tracking Cost forerror in tracking cost callback - Traceback (most recent call last):
^^^^^^^^
```
2024-07-11 13:26:59 -07:00
Krrish Dholakia
3f965df68b
fix(llm_cost_calc/google.py): fix google embedding cost calculation
...
Fixes https://github.com/BerriAI/litellm/issues/4630
2024-07-11 11:55:48 -07:00
Ishaan Jaff
7849e97847
add validation on slack
2024-07-10 10:10:32 -07:00
Krrish Dholakia
d09a78d7fd
fix(slack_alerting.py): use in-memory cache for checking request status
2024-07-02 13:01:59 -07:00
Krrish Dholakia
c7b06c42b7
refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
...
gets the url from logging object
2024-06-21 16:12:25 -07:00
Krrish Dholakia
174b345766
fix(proxy/utils.py): fix add langfuse trace id to alert
...
Fixing the import after refactor
2024-06-21 14:55:09 -07:00
Ishaan Jaff
4bc2bfb176
fix - proxy refactor user_api_key_auth
2024-06-15 10:33:58 -07:00
Krrish Dholakia
ffe04e129d
fix(slack_alerting.py): check if webhook is in alerting list before triggering it
...
Fixes https://github.com/BerriAI/litellm/issues/4193
2024-06-14 21:20:58 -07:00
Ishaan Jaff
8988b2e909
Merge pull request #4209 from BerriAI/litellm_send_email_alerts_budget_exceeded
...
[Feat] send email alerts when budget exceeded
2024-06-14 20:23:19 -07:00
Krish Dholakia
9e280ba235
Merge pull request #4205 from BerriAI/litellm_alerting_metadata
...
fix(slack_alerting.py): allow new 'alerting_metadata' arg
2024-06-14 19:04:30 -07:00
Ishaan Jaff
7e7f867860
fix - send team budget crossed
2024-06-14 18:52:13 -07:00
Ishaan Jaff
cdffda16a0
add email alerting for budgets
2024-06-14 18:40:56 -07:00
Krrish Dholakia
1cce99300f
fix(slack_alerting.py): allow new 'alerting_metadata' arg
...
Allows user to pass in additional alerting metadata for debugging
2024-06-14 16:06:47 -07:00
Ishaan Jaff
bd341c69b5
fix - send alert on router level exceptions
2024-06-14 08:41:12 -07:00
Ishaan Jaff
9942945797
docs - redacting messages from slack alerting
2024-06-06 12:30:56 -07:00
Ishaan Jaff
383d58a3f8
fix - turn of message logging
2024-06-06 10:48:08 -07:00
Krish Dholakia
ef6924f917
Merge pull request #4028 from BerriAI/litellm_user_invite_links
...
feat(create_user_button.tsx): allow admin to invite user to proxy via user-email/pwd invite-links
2024-06-05 16:32:24 -07:00
Krrish Dholakia
622c6e1d82
fix(slack_alerting.py): fix email logo url env passed to proxy
2024-06-05 16:26:50 -07:00
Spencer Krum
10ef409594
feat: clarify slack alerting message
...
Specify the time of the next run, not the interval
2024-06-05 11:57:42 -05:00
Ishaan Jaff
0d44b1581a
fix - move email templates
2024-05-31 10:37:56 -07:00
Ishaan Jaff
024c37099a
return correct fields in NewUserResponse
2024-05-31 10:31:19 -07:00
Krrish Dholakia
5f01dce284
fix(main.py): pass api key and api base to openai.py for audio transcription call
2024-05-29 21:29:01 -07:00
Krrish Dholakia
bb3c786194
fix(proxy_server.py): fix end user object check when master key used
...
check if end user max budget exceeded for master key
2024-05-29 17:20:59 -07:00
Krrish Dholakia
df0365175a
feat(proxy_server.py): emit webhook event whenever customer spend is tracked
...
Closes https://github.com/BerriAI/litellm/issues/3903
2024-05-29 15:59:32 -07:00
Ishaan Jaff
c0658ddc70
fix - validation for email alerting
2024-05-27 22:38:17 -07:00
Ishaan Jaff
67675d3382
ffeat - make email alerting a free feature
2024-05-27 19:40:47 -07:00
Krrish Dholakia
1f42d086d6
feat(ui): allow admin to configure slack alerting thresholds on ui
2024-05-25 21:01:19 -07:00
Krrish Dholakia
e4629ba65d
feat(slack_alerting.py): enable provider-region based alerting
2024-05-25 16:55:46 -07:00
Ishaan Jaff
d3a8306952
Merge branch 'main' into litellm_send_alerts_making_new_key
2024-05-24 20:42:17 -07:00
Krrish Dholakia
d2d5e2d389
feat(ui): settings.tsx
...
enable/disable outage alerts on admin ui
2024-05-24 20:04:15 -07:00
Krish Dholakia
40791ee1f8
Merge pull request #3828 from BerriAI/litellm_outage_alerting
...
fix(slack_alerting.py): support region based outage alerting
2024-05-24 19:13:17 -07:00
Krrish Dholakia
4536ed6f6e
feat(slack_alerting.py): refactor region outage alerting to do model based alerting instead
...
Unable to extract azure region from api base, makes sense to start with model alerting and then move to region
2024-05-24 19:10:33 -07:00
Ishaan Jaff
b99ece46c0
fix - update webhook event validation
2024-05-24 18:31:10 -07:00
Ishaan Jaff
f7cbef42f1
feat - customize logo, support contact on email
2024-05-24 18:12:51 -07:00
Ishaan Jaff
7f1eb5af92
feat - send send_key_created_email
2024-05-24 17:59:15 -07:00
Ishaan Jaff
b039caaae1
feat - resize logo
2024-05-24 17:54:38 -07:00
Ishaan Jaff
6ac65d6101
feat - send email on new key created
2024-05-24 17:30:06 -07:00
Krrish Dholakia
a8fb4e33d5
fix(slack_alerting.py): fixes for outage alerting
2024-05-24 17:17:17 -07:00
Krrish Dholakia
7368406c24
fix(slack_alerting.py): support region based outage alerting
2024-05-24 16:59:16 -07:00
Ishaan Jaff
9b04d6144a
use litellm prefix in all emails
2024-05-24 15:32:51 -07:00
Ishaan Jaff
6798b45abe
feat - email alerts
2024-05-24 15:23:36 -07:00
