62 commits

Author	SHA1	Message	Date
Ishaan Jaff	26d8097779	[Fix] OTEL - Don't log messages when callback settings disable message logging (#5875) ... * fix otel dont log messages * otel fix redis failure hook logging	2024-09-24 18:29:52 -07:00
Ishaan Jaff	fd6cc10922	[Feat] Add proxy level prometheus metrics (#5789) ... * add Proxy Level Tracking Metrics doc * update service logger * prometheus - track litellm_proxy_failed_requests_metric * use REQUESTED_MODEL * fix prom request_data	2024-09-19 17:13:07 -07:00
Ishaan Jaff	c72c8c0383	fix otel use sensible defaults	2024-09-11 14:24:04 -07:00
Ishaan Jaff	02325f33d7	Merge branch 'main' into litellm_allow_turning_off_message_logging_for_callbacks	2024-09-09 21:59:36 -07:00
Ishaan Jaff	2e021a6203	fix otel defaults	2024-09-09 16:18:55 -07:00
Ishaan Jaff	0f0a5c1758	fix init custom logger when init OTEL runs	2024-09-09 16:03:39 -07:00
Ishaan Jaff	22fe7705e7	fix otel set max_queue_size, max_queue_size	2024-09-06 17:31:43 -07:00
Ishaan Jaff	5c7fbe0be2	fix otel max batch size	2024-09-06 17:12:01 -07:00
Ishaan Jaff	4bc0d297f7	fix otel type	2024-09-05 19:04:56 -07:00
Ishaan Jaff	8da555a2d9	otel log service errors	2024-08-05 20:21:26 -07:00
Ishaan Jaff	774807d2c4	otel log event_metadata	2024-08-05 20:01:58 -07:00
Ishaan Jaff	291df6b41d	fix _handle_failure for otel	2024-08-01 11:12:31 -07:00
Ishaan Jaff	aade38760d	use common helpers for writing to otel	2024-07-27 11:40:39 -07:00
Ishaan Jaff	40f9e67be4	move _get_parent_otel_span_from_kwargs to otel.py	2024-07-27 11:12:13 -07:00
Krrish Dholakia	1562cba823	fix(utils.py): fix cache hits for streaming ... Fixes https://github.com/BerriAI/litellm/issues/4109	2024-07-26 19:04:08 -07:00
Krrish Dholakia	8c005d8134	feat(redact_messages.py): allow remove sensitive key information before passing to logging integration	2024-07-22 20:58:02 -07:00
Ishaan Jaff	464a4edfb2	otel - log to arize ai	2024-07-22 13:40:42 -07:00
Krrish Dholakia	d2a0977af7	feat(opentelemetry.py): support logging call metadata to otel	2024-07-12 15:41:34 -07:00
Ishaan Jaff	97da1252f1	test- otel span recording	2024-07-11 08:47:16 -07:00
Ishaan Jaff	35d4adb147	Merge pull request #4422 from BerriAI/litellm_otel_env_name ... [Feat] OTEL allow setting deployment environment	2024-07-06 15:23:07 -07:00
Ishaan Jaff	9738aaebf6	fix OTEL TracerProvider	2024-07-06 15:15:49 -07:00
Krrish Dholakia	56410cfcd0	fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions	2024-07-05 13:07:09 -07:00
Ishaan Jaff	4f409e647f	OTEL allow setting deployment environment	2024-06-26 11:50:16 -07:00
Krrish Dholakia	0430807178	feat(dynamic_rate_limiter.py): update cache with active project	2024-06-21 20:25:40 -07:00
Ishaan Jaff	b343911d59	fix - otel fixes	2024-06-17 19:15:14 -07:00
Ishaan Jaff	4859244e67	feat - otel log /team exceptions	2024-06-11 16:27:07 -07:00
Ishaan Jaff	9d78e1bd5f	feat - log management endpoint logs to otel	2024-06-11 16:09:11 -07:00
Ishaan Jaff	2d5904c9a5	feat - use traceparent to proporgate OTEL traces	2024-06-11 13:57:31 -07:00
Ishaan Jaff	6c19b76edc	fix OTEL semantic conventions does not exist	2024-06-11 12:28:38 -07:00
Ishaan Jaff	ef9349e6a2	Merge pull request #4086 from BerriAI/litellm_sdk_tool_calling_fic ... [Fix] Litellm sdk - allow ChatCompletionMessageToolCall, and Function to be used as dict	2024-06-08 20:48:54 -07:00
Ishaan Jaff	8c5802d506	Merge pull request #4078 from BerriAI/litellm_low_raw_request_response_otel ... [FEAT]- OTEL Log raw LLM request/response on OTEL	2024-06-08 19:49:28 -07:00
Ishaan Jaff	af61eff8e3	feat - allow ChatCompletionMessageToolCall, and Function to be used as dict	2024-06-08 19:47:31 -07:00
Ishaan Jaff	21ac0efaae	fix - otel set tools attribute	2024-06-08 19:40:29 -07:00
Ishaan Jaff	638c4acbb2	fix - show custom llm provider on OTEL span	2024-06-08 19:13:10 -07:00
Ishaan Jaff	0d83ffb4e2	minor fix - _debug_otel	2024-06-08 18:16:35 -07:00
Ishaan Jaff	e7f6c5d651	fix otel don't log raw request / response when turn_off_message_logging	2024-06-08 14:37:06 -07:00
Ishaan Jaff	22fa537d98	otel - use correct raw request name	2024-06-08 14:22:44 -07:00
Ishaan Jaff	4d7ff7c79b	fix otel - handle vision images content	2024-06-08 14:12:00 -07:00
Ishaan Jaff	7f86dc859e	feat - set span attributes OTEL with raw request / response	2024-06-08 14:01:59 -07:00
Ishaan Jaff	9da1b27793	feat - low raw request on OTEL	2024-06-08 11:35:17 -07:00
Ishaan Jaff	33e72939d4	feat - OTEL log litellm request / response	2024-06-08 09:58:52 -07:00
Ishaan Jaff	72a6d49b21	feat - working exception logs for Redis errors	2024-06-07 16:30:29 -07:00
Ishaan Jaff	ef99e3e1d0	fix - basic success logging for redis cache	2024-06-07 16:20:23 -07:00
Ishaan Jaff	cb4bdee18d	v0 - log proxy server exceptions on OTEL	2024-06-07 14:48:16 -07:00
Ishaan Jaff	80def35a04	Merge pull request #4065 from BerriAI/litellm_use_common_func ... [Refactor] - Refactor proxy_server.py to use common function for `add_litellm_data_to_request`	2024-06-07 14:02:17 -07:00
Ishaan Jaff	860c9b52b6	Merge branch 'main' into litellm_svc_logger	2024-06-07 14:01:54 -07:00
Ishaan Jaff	8106a6dc9b	fix simplify - pass litellm_parent_otel_span	2024-06-07 13:48:21 -07:00
Ishaan Jaff	4828e2426f	fix importing Span	2024-06-07 09:55:59 -07:00
Ishaan Jaff	98ed4533f7	fix - otel _get_span_context	2024-06-07 08:55:35 -07:00
Ishaan Jaff	0ccf1bff52	feat - use async_service_success_hook with litellm proxy	2024-06-07 08:27:47 -07:00