9 commits

Author	SHA1	Message	Date
Krrish Dholakia	606d04b05b	fix(_service_logging.py): only trigger otel if in service_callback ... Fixes https://github.com/BerriAI/litellm/issues/4511	2024-07-03 09:48:38 -07:00
Krrish Dholakia	a028600932	feat(dynamic_rate_limiter.py): update cache with active project	2024-06-21 20:25:40 -07:00
Ishaan Jaff	5a5dd33b24	feat - working exception logs for Redis errors	2024-06-07 16:30:29 -07:00
Ishaan Jaff	7c1183e76e	fix import OTEL span	2024-06-07 09:47:13 -07:00
Ishaan Jaff	b734cca43e	fix service logger for OTEL	2024-06-06 22:12:45 -07:00
Krrish Dholakia	81573b2dd9	fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2	2024-04-18 21:38:00 -07:00
Krrish Dholakia	919a2876f1	fix(proxy/utils.py): add prometheus failed db request tracking	2024-04-18 16:30:29 -07:00
Krrish Dholakia	0f95a824c4	feat(prometheus_services.py): emit proxy latency for successful llm api requests ... uses prometheus histogram for this	2024-04-18 16:04:35 -07:00
Krrish Dholakia	4e81acf2c6	feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)	2024-04-13 18:15:02 -07:00