Commit graph

493 commits

Author SHA1 Message Date
Ishaan Jaff
39ca66f46d fix - remove deprecated clickhouse utils 2024-06-15 15:33:26 -07:00
Ishaan Jaff
4bc2bfb176 fix - proxy refactor user_api_key_auth 2024-06-15 10:33:58 -07:00
Krrish Dholakia
ffe04e129d fix(slack_alerting.py): check if webhook is in alerting list before triggering it
Fixes https://github.com/BerriAI/litellm/issues/4193
2024-06-14 21:20:58 -07:00
Ishaan Jaff
8988b2e909 Merge pull request #4209 from BerriAI/litellm_send_email_alerts_budget_exceeded
[Feat] send email alerts when budget exceeded
2024-06-14 20:23:19 -07:00
Ishaan Jaff
c0dd9d275d fix - send emails on crossing team budget 2024-06-14 19:48:22 -07:00
Krish Dholakia
9e280ba235 Merge pull request #4205 from BerriAI/litellm_alerting_metadata
fix(slack_alerting.py): allow new 'alerting_metadata' arg
2024-06-14 19:04:30 -07:00
Ishaan Jaff
7e7f867860 fix - send team budget crossed 2024-06-14 18:52:13 -07:00
Ishaan Jaff
cdffda16a0 add email alerting for budgets 2024-06-14 18:40:56 -07:00
Ishaan Jaff
80d97c4fef feat - send email alert to team members 2024-06-14 18:36:04 -07:00
Krrish Dholakia
1cce99300f fix(slack_alerting.py): allow new 'alerting_metadata' arg
Allows user to pass in additional alerting metadata for debugging
2024-06-14 16:06:47 -07:00
Ishaan Jaff
bd341c69b5 fix - send alert on router level exceptions 2024-06-14 08:41:12 -07:00
Krish Dholakia
8c7aa24959 Merge pull request #3559 from Intellegam/main
Langfuse integration support for `parent_observation_id` parameter
2024-06-14 06:55:45 -07:00
Ishaan Jaff
ee9e2ef980 feat - add remaining budget for key on prometheus 2024-06-13 14:37:02 -07:00
Ishaan Jaff
8d3c9aeea3 feat - add remaining team budget gauge 2024-06-13 14:28:25 -07:00
Bram van Meurs
3bd7ad6edf feat(prometheus): add api_team_alias to exported labels 2024-06-13 12:50:40 +02:00
Ishaan Jaff
4859244e67 feat - otel log /team exceptions 2024-06-11 16:27:07 -07:00
Ishaan Jaff
9d78e1bd5f feat - log management endpoint logs to otel 2024-06-11 16:09:11 -07:00
Ishaan Jaff
2d5904c9a5 feat - use traceparent to proporgate OTEL traces 2024-06-11 13:57:31 -07:00
Ishaan Jaff
6c19b76edc fix OTEL semantic conventions does not exist 2024-06-11 12:28:38 -07:00
Ishaan Jaff
ef9349e6a2 Merge pull request #4086 from BerriAI/litellm_sdk_tool_calling_fic
[Fix] Litellm sdk - allow ChatCompletionMessageToolCall, and Function to be used as dict
2024-06-08 20:48:54 -07:00
Krish Dholakia
3be558c4bb Merge pull request #4080 from BerriAI/litellm_predibase_exception_mapping
fix(utils.py): improved predibase exception mapping
2024-06-08 20:27:44 -07:00
Ishaan Jaff
8c5802d506 Merge pull request #4078 from BerriAI/litellm_low_raw_request_response_otel
[FEAT]- OTEL Log raw LLM request/response on OTEL
2024-06-08 19:49:28 -07:00
Ishaan Jaff
af61eff8e3 feat - allow ChatCompletionMessageToolCall, and Function to be used as dict 2024-06-08 19:47:31 -07:00
Ishaan Jaff
21ac0efaae fix - otel set tools attribute 2024-06-08 19:40:29 -07:00
Ishaan Jaff
638c4acbb2 fix - show custom llm provider on OTEL span 2024-06-08 19:13:10 -07:00
Ishaan Jaff
0d83ffb4e2 minor fix - _debug_otel 2024-06-08 18:16:35 -07:00
Ishaan Jaff
e7f6c5d651 fix otel don't log raw request / response when turn_off_message_logging 2024-06-08 14:37:06 -07:00
Krrish Dholakia
39ee6be477 fix(utils.py): improved predibase exception mapping
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00
Ishaan Jaff
22fa537d98 otel - use correct raw request name 2024-06-08 14:22:44 -07:00
Ishaan Jaff
4d7ff7c79b fix otel - handle vision images content 2024-06-08 14:12:00 -07:00
Ishaan Jaff
7f86dc859e feat - set span attributes OTEL with raw request / response 2024-06-08 14:01:59 -07:00
Ishaan Jaff
9da1b27793 feat - low raw request on OTEL 2024-06-08 11:35:17 -07:00
Ishaan Jaff
33e72939d4 feat - OTEL log litellm request / response 2024-06-08 09:58:52 -07:00
Ishaan Jaff
72a6d49b21 feat - working exception logs for Redis errors 2024-06-07 16:30:29 -07:00
Ishaan Jaff
ef99e3e1d0 fix - basic success logging for redis cache 2024-06-07 16:20:23 -07:00
Ishaan Jaff
cb4bdee18d v0 - log proxy server exceptions on OTEL 2024-06-07 14:48:16 -07:00
Ishaan Jaff
80def35a04 Merge pull request #4065 from BerriAI/litellm_use_common_func
[Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`
2024-06-07 14:02:17 -07:00
Ishaan Jaff
860c9b52b6 Merge branch 'main' into litellm_svc_logger 2024-06-07 14:01:54 -07:00
Ishaan Jaff
8106a6dc9b fix simplify - pass litellm_parent_otel_span 2024-06-07 13:48:21 -07:00
Ishaan Jaff
c9c25a8ede Merge branch 'main' into litellm_redact_messages_slack_alerting 2024-06-07 12:43:53 -07:00
Ishaan Jaff
4828e2426f fix importing Span 2024-06-07 09:55:59 -07:00
Ishaan Jaff
98ed4533f7 fix - otel _get_span_context 2024-06-07 08:55:35 -07:00
Ishaan Jaff
731f298761 Merge pull request #4048 from BerriAI/litellm_otel_set_svc_name
feat - OTEL set custom service names and custom tracer names
2024-06-07 08:53:07 -07:00
Ishaan Jaff
0ccf1bff52 feat - use async_service_success_hook with litellm proxy 2024-06-07 08:27:47 -07:00
Ishaan Jaff
312521a0b3 fix service logger for OTEL 2024-06-06 22:12:45 -07:00
Krish Dholakia
ea4334f760 Merge branch 'main' into litellm_cleanup_traceback 2024-06-06 16:32:08 -07:00
Krrish Dholakia
e391e30285 refactor: replace 'traceback.print_exc()' with logging library
allows error logs to be in json format for otel logging
2024-06-06 13:47:43 -07:00
Ishaan Jaff
7f2346f9a3 feat - custom OTEL service names 2024-06-06 12:45:14 -07:00
Ishaan Jaff
9942945797 docs - redacting messages from slack alerting 2024-06-06 12:30:56 -07:00
Ishaan Jaff
383d58a3f8 fix - turn of message logging 2024-06-06 10:48:08 -07:00