4 commits

Author	SHA1	Message	Date
Krrish Dholakia	376ee4e9d7	fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2	2024-04-18 21:38:00 -07:00
Krrish Dholakia	51cc8dd95b	fix(proxy/utils.py): add prometheus failed db request tracking	2024-04-18 16:30:29 -07:00
Krrish Dholakia	7f5bcf38b7	feat(prometheus_services.py): emit proxy latency for successful llm api requests ... uses prometheus histogram for this	2024-04-18 16:04:35 -07:00
Krrish Dholakia	866259f95f	feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)	2024-04-13 18:15:02 -07:00