4 commits

Author	SHA1	Message	Date
Krrish Dholakia	81573b2dd9	fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2	2024-04-18 21:38:00 -07:00
Krrish Dholakia	919a2876f1	fix(proxy/utils.py): add prometheus failed db request tracking	2024-04-18 16:30:29 -07:00
Krrish Dholakia	0f95a824c4	feat(prometheus_services.py): emit proxy latency for successful llm api requests ... uses prometheus histogram for this	2024-04-18 16:04:35 -07:00
Krrish Dholakia	4e81acf2c6	feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)	2024-04-13 18:15:02 -07:00