Commit graph

946 commits

Author SHA1 Message Date
Ishaan Jaff
da3ae00bd6 fix - proxy refactor user_api_key_auth 2024-06-15 10:33:58 -07:00
Krrish Dholakia
74d8605f5c fix(slack_alerting.py): check if webhook is in alerting list before triggering it
Fixes https://github.com/BerriAI/litellm/issues/4193
2024-06-14 21:20:58 -07:00
Ishaan Jaff
4bfd46d0a6
Merge pull request #4209 from BerriAI/litellm_send_email_alerts_budget_exceeded
[Feat] send email alerts when budget exceeded
2024-06-14 20:23:19 -07:00
Ishaan Jaff
408899dac8 fix - send emails on crossing team budget 2024-06-14 19:48:22 -07:00
Krish Dholakia
3ef5d40b73
Merge pull request #4205 from BerriAI/litellm_alerting_metadata
fix(slack_alerting.py): allow new 'alerting_metadata' arg
2024-06-14 19:04:30 -07:00
Ishaan Jaff
0ec52e57b4 fix - send team budget crossed 2024-06-14 18:52:13 -07:00
Ishaan Jaff
f6d0c6c272 add email alerting for budgets 2024-06-14 18:40:56 -07:00
Ishaan Jaff
84b281bf2a feat - send email alert to team members 2024-06-14 18:36:04 -07:00
Krrish Dholakia
e18002023a fix(slack_alerting.py): allow new 'alerting_metadata' arg
Allows user to pass in additional alerting metadata for debugging
2024-06-14 16:06:47 -07:00
Ishaan Jaff
a0ecc6f414 fix - send alert on router level exceptions 2024-06-14 08:41:12 -07:00
Krish Dholakia
056913fd70
Merge pull request #3559 from Intellegam/main
Langfuse integration support for `parent_observation_id` parameter
2024-06-14 06:55:45 -07:00
Ishaan Jaff
9b340fb2f8 feat - add remaining budget for key on prometheus 2024-06-13 14:37:02 -07:00
Ishaan Jaff
51157c148f feat - add remaining team budget gauge 2024-06-13 14:28:25 -07:00
hughcrt
e0608eae72
add tests 2024-06-13 15:10:24 -03:00
Hugues Chocart
03f63b9a79
Merge branch 'BerriAI:main' into main 2024-06-13 14:38:37 -03:00
Bram van Meurs
270dad93d5
feat(prometheus): add api_team_alias to exported labels 2024-06-13 12:50:40 +02:00
Hugues Chocart
9927d1e427
fix last commit 2024-06-12 09:55:23 -03:00
hughcrt
418caf800d fix: lunary callback tags 2024-06-11 21:30:11 -03:00
Ishaan Jaff
427f2ee1fa feat - otel log /team exceptions 2024-06-11 16:27:07 -07:00
Ishaan Jaff
13cb49688a feat - log management endpoint logs to otel 2024-06-11 16:09:11 -07:00
Ishaan Jaff
7ce1289548 feat - use traceparent to proporgate OTEL traces 2024-06-11 13:57:31 -07:00
Ishaan Jaff
1af3d34d8b fix OTEL semantic conventions does not exist 2024-06-11 12:28:38 -07:00
Ishaan Jaff
39bbc5d8ac
Merge pull request #4086 from BerriAI/litellm_sdk_tool_calling_fic
[Fix] Litellm sdk - allow ChatCompletionMessageToolCall, and Function to be used as dict
2024-06-08 20:48:54 -07:00
Krish Dholakia
b4fc4abb76
Merge pull request #4080 from BerriAI/litellm_predibase_exception_mapping
fix(utils.py): improved predibase exception mapping
2024-06-08 20:27:44 -07:00
Ishaan Jaff
0d3add56a6
Merge pull request #4078 from BerriAI/litellm_low_raw_request_response_otel
[FEAT]- OTEL Log raw LLM request/response on OTEL
2024-06-08 19:49:28 -07:00
Ishaan Jaff
0253c2b213 feat - allow ChatCompletionMessageToolCall, and Function to be used as dict 2024-06-08 19:47:31 -07:00
Ishaan Jaff
5b73bcfe31 fix - otel set tools attribute 2024-06-08 19:40:29 -07:00
Ishaan Jaff
8b187eb66d fix - show custom llm provider on OTEL span 2024-06-08 19:13:10 -07:00
Ishaan Jaff
090f350169 minor fix - _debug_otel 2024-06-08 18:16:35 -07:00
Ishaan Jaff
dcc63c7d67 fix otel don't log raw request / response when turn_off_message_logging 2024-06-08 14:37:06 -07:00
Krrish Dholakia
1dafb1b3b7 fix(utils.py): improved predibase exception mapping
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00
Ishaan Jaff
9478c98fff otel - use correct raw request name 2024-06-08 14:22:44 -07:00
Ishaan Jaff
1ff99bf9b5 fix otel - handle vision images content 2024-06-08 14:12:00 -07:00
Ishaan Jaff
259540900b feat - set span attributes OTEL with raw request / response 2024-06-08 14:01:59 -07:00
Ishaan Jaff
62411d2870 feat - low raw request on OTEL 2024-06-08 11:35:17 -07:00
Ishaan Jaff
17833b117d feat - OTEL log litellm request / response 2024-06-08 09:58:52 -07:00
Ishaan Jaff
5a5dd33b24 feat - working exception logs for Redis errors 2024-06-07 16:30:29 -07:00
Ishaan Jaff
e86fa19257 fix - basic success logging for redis cache 2024-06-07 16:20:23 -07:00
Ishaan Jaff
1915cd326c v0 - log proxy server exceptions on OTEL 2024-06-07 14:48:16 -07:00
Ishaan Jaff
d9dacc1f43
Merge pull request #4065 from BerriAI/litellm_use_common_func
[Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`
2024-06-07 14:02:17 -07:00
Ishaan Jaff
2cf3133669
Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
7ef7bc8a9a fix simplify - pass litellm_parent_otel_span 2024-06-07 13:48:21 -07:00
Ishaan Jaff
d2857fc24c
Merge branch 'main' into litellm_redact_messages_slack_alerting 2024-06-07 12:43:53 -07:00
Ishaan Jaff
87533bacf7 fix importing Span 2024-06-07 09:55:59 -07:00
Ishaan Jaff
1f5c3b5448 fix - otel _get_span_context 2024-06-07 08:55:35 -07:00
Ishaan Jaff
dab756d129
Merge pull request #4048 from BerriAI/litellm_otel_set_svc_name
feat - OTEL set custom service names and custom tracer names
2024-06-07 08:53:07 -07:00
Ishaan Jaff
992c273bf7 feat - use async_service_success_hook with litellm proxy 2024-06-07 08:27:47 -07:00
Ishaan Jaff
b734cca43e fix service logger for OTEL 2024-06-06 22:12:45 -07:00
Krish Dholakia
677e0255c8
Merge branch 'main' into litellm_cleanup_traceback 2024-06-06 16:32:08 -07:00
Krrish Dholakia
6cca5612d2 refactor: replace 'traceback.print_exc()' with logging library
allows error logs to be in json format for otel logging
2024-06-06 13:47:43 -07:00