12 commits

Author	SHA1	Message	Date
Krrish Dholakia	5f93cae3ff	feat(proxy_server.py): return litellm version in response headers	2024-05-08 16:00:08 -07:00
Krrish Dholakia	17bf753309	fix(prometheus.py): fix user-id get for prometheus	2024-04-24 08:08:42 -07:00
Krrish Dholakia	49852b68c1	fix(prometheus.py): add user tracking to prometheus	2024-04-22 15:14:38 -07:00
Krrish Dholakia	1ca2439eb7	fix(lowest_tpm_rpm_v2.py): use a combined tpm+rpm query in async get cache, to reduce redis client calls in high traffic	2024-04-20 16:13:11 -07:00
Krrish Dholakia	7065e4ee12	fix(caching.py): remove url parsing logic - causing redis ssl connections to fail ... this reverts a change that was causing redis url w/ ssl to fail. this also adds unit testing for this sc enario, to prevent future regressions	2024-04-19 14:01:13 -07:00
Krrish Dholakia	f6ac469573	fix(prometheus.py): fix metric name to be more accurate ... change metric name from litellm_failed_requests_metric to litellm_llm_api_failed_requests_metric	2024-04-18 12:30:44 -07:00
Krrish Dholakia	deccde6be1	fix(utils.py): support prometheus failed call metrics	2024-04-18 12:29:15 -07:00
Ishaan Jaff	3dca830fcb	fix don't log user_api_key to prometheus	2024-04-16 19:01:38 -07:00
Krrish Dholakia	866259f95f	feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)	2024-04-13 18:15:02 -07:00
Krrish Dholakia	5fe8aa27d1	feat(prometheus.py): track team based metrics on prometheus	2024-04-03 13:43:21 -07:00
Ishaan Jaff	a23746b776	(fix) add /metrics to utils.py	2024-03-19 17:28:33 -07:00
Ishaan Jaff	4be25c8817	(feat) prometheus metric collector	2024-03-19 15:44:36 -07:00