6 commits

Author	SHA1	Message	Date
Krrish Dholakia	b3a8c2885b	test(test_prometheus_services.py): fix testing to handle caching ping in init	2024-04-19 16:15:29 -07:00
Krrish Dholakia	7f5bcf38b7	feat(prometheus_services.py): emit proxy latency for successful llm api requests ... uses prometheus histogram for this	2024-04-18 16:04:35 -07:00
Krrish Dholakia	4455f0008e	fix(prometheus_services.py): add better import error statement	2024-04-13 19:03:32 -07:00
Krrish Dholakia	b0fc2b342d	fix(caching.py): don't decode a string	2024-04-13 18:48:03 -07:00
Krrish Dholakia	218976c55d	feat(prometheus_services.py): track when redis calls fail	2024-04-13 18:31:35 -07:00
Krrish Dholakia	866259f95f	feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)	2024-04-13 18:15:02 -07:00