6 commits

Author	SHA1	Message	Date
Krrish Dholakia	0d9c96bebf	test(test_prometheus_services.py): fix testing to handle caching ping in init	2024-04-19 16:15:29 -07:00
Krrish Dholakia	0f95a824c4	feat(prometheus_services.py): emit proxy latency for successful llm api requests ... uses prometheus histogram for this	2024-04-18 16:04:35 -07:00
Krrish Dholakia	67d0d5e356	fix(prometheus_services.py): add better import error statement	2024-04-13 19:03:32 -07:00
Krrish Dholakia	bef24cd4ab	fix(caching.py): don't decode a string	2024-04-13 18:48:03 -07:00
Krrish Dholakia	9f42d15713	feat(prometheus_services.py): track when redis calls fail	2024-04-13 18:31:35 -07:00
Krrish Dholakia	4e81acf2c6	feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)	2024-04-13 18:15:02 -07:00