7 commits

Author	SHA1	Message	Date
Ishaan Jaff	72a6d49b21	feat - working exception logs for Redis errors	2024-06-07 16:30:29 -07:00
Ishaan Jaff	ca99456e04	fix import OTEL span	2024-06-07 09:47:13 -07:00
Ishaan Jaff	312521a0b3	fix service logger for OTEL	2024-06-06 22:12:45 -07:00
Krrish Dholakia	376ee4e9d7	fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2	2024-04-18 21:38:00 -07:00
Krrish Dholakia	51cc8dd95b	fix(proxy/utils.py): add prometheus failed db request tracking	2024-04-18 16:30:29 -07:00
Krrish Dholakia	7f5bcf38b7	feat(prometheus_services.py): emit proxy latency for successful llm api requests ... uses prometheus histogram for this	2024-04-18 16:04:35 -07:00
Krrish Dholakia	866259f95f	feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)	2024-04-13 18:15:02 -07:00