90 commits

Author	SHA1	Message	Date
Ishaan Jaff	9476582fb7	update promtheus metric names	2024-08-22 14:03:00 -07:00
Ishaan Jaff	c719c375f7	track litellm_request_latency_metric	2024-08-22 13:58:10 -07:00
Ishaan Jaff	0ccb1c17f7	fix init correct prometheus metrics	2024-08-22 13:29:35 -07:00
Ishaan Jaff	db8f789318	Merge pull request #5259 from BerriAI/litellm_return_remaining_tokens_in_header ... [Feat] return `x-litellm-key-remaining-requests-{model}`: 1, `x-litellm-key-remaining-tokens-{model}: None` in response headers	2024-08-17 12:41:16 -07:00
Ishaan Jaff	a62277a6aa	feat - use commong helper for getting model group	2024-08-17 10:46:04 -07:00
Ishaan Jaff	2dd098f384	show correct metric	2024-08-17 10:12:23 -07:00
Ishaan Jaff	03196742d2	add litellm-key-remaining-tokens on prometheus	2024-08-17 10:02:20 -07:00
Krrish Dholakia	2874b94fb1	refactor: replace .error() with .exception() logging for better debugging on sentry	2024-08-16 09:22:47 -07:00
Ishaan Jaff	38868a0a45	use litellm_ prefix for new deployment metrics	2024-08-14 09:08:14 -07:00
Ishaan Jaff	ecec37e220	doc new prometheus metrics	2024-08-10 17:13:36 -07:00
Ishaan Jaff	3ecf4db741	prometheus log_success_fallback_event	2024-08-10 14:05:18 -07:00
Ishaan Jaff	5765baa5b2	feat - track latency per llm deployment	2024-08-10 12:53:56 -07:00
Ishaan Jaff	e086479fd7	track llm_deployment_success_responses	2024-08-10 10:05:33 -07:00
Ishaan Jaff	c3c570ac7e	feat - refactor prometheus metrics	2024-08-10 09:14:38 -07:00
Ishaan Jaff	408d17dfee	refactor prom metrics	2024-08-09 09:02:23 -07:00
Ishaan Jaff	fc60bd07b2	show warning about prometheus moving to enterprise	2024-08-07 12:46:26 -07:00
Ishaan Jaff	27e8a89077	fix logging cool down deployment	2024-08-07 11:27:05 -07:00
Ishaan Jaff	92a38b213b	allow setting outage metrics	2024-08-07 10:36:18 -07:00
Ishaan Jaff	426dcc9275	emit deployment_partial_outage on prometheus	2024-08-07 09:56:01 -07:00
Ishaan Jaff	7222791210	rename to set_llm_deployment_success_metrics	2024-08-07 09:46:08 -07:00
Ishaan Jaff	786a3f9e95	add set_remaining_tokens_requests_metric	2024-08-07 09:43:35 -07:00
Ishaan Jaff	09e22d8e33	feat - show key alias on prometheus metrics	2024-07-04 09:57:00 -07:00
Ishaan Jaff	86e3cae596	feat - prometheus log remaining headers	2024-07-01 20:00:47 -07:00
Ishaan Jaff	ee9e2ef980	feat - add remaining budget for key on prometheus	2024-06-13 14:37:02 -07:00
Ishaan Jaff	8d3c9aeea3	feat - add remaining team budget gauge	2024-06-13 14:28:25 -07:00
Bram van Meurs	3bd7ad6edf	feat(prometheus): add api_team_alias to exported labels	2024-06-13 12:50:40 +02:00
Krrish Dholakia	e391e30285	refactor: replace 'traceback.print_exc()' with logging library ... allows error logs to be in json format for otel logging	2024-06-06 13:47:43 -07:00
Krrish Dholakia	926b86af87	feat(bedrock_httpx.py): moves to using httpx client for bedrock cohere calls	2024-05-11 13:43:08 -07:00
Krrish Dholakia	5f93cae3ff	feat(proxy_server.py): return litellm version in response headers	2024-05-08 16:00:08 -07:00
Krrish Dholakia	17bf753309	fix(prometheus.py): fix user-id get for prometheus	2024-04-24 08:08:42 -07:00
Krrish Dholakia	49852b68c1	fix(prometheus.py): add user tracking to prometheus	2024-04-22 15:14:38 -07:00
Krrish Dholakia	1ca2439eb7	fix(lowest_tpm_rpm_v2.py): use a combined tpm+rpm query in async get cache, to reduce redis client calls in high traffic	2024-04-20 16:13:11 -07:00
Krrish Dholakia	7065e4ee12	fix(caching.py): remove url parsing logic - causing redis ssl connections to fail ... this reverts a change that was causing redis url w/ ssl to fail. this also adds unit testing for this sc enario, to prevent future regressions	2024-04-19 14:01:13 -07:00
Krrish Dholakia	f6ac469573	fix(prometheus.py): fix metric name to be more accurate ... change metric name from litellm_failed_requests_metric to litellm_llm_api_failed_requests_metric	2024-04-18 12:30:44 -07:00
Krrish Dholakia	deccde6be1	fix(utils.py): support prometheus failed call metrics	2024-04-18 12:29:15 -07:00
Ishaan Jaff	3dca830fcb	fix don't log user_api_key to prometheus	2024-04-16 19:01:38 -07:00
Krrish Dholakia	866259f95f	feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)	2024-04-13 18:15:02 -07:00
Krrish Dholakia	5fe8aa27d1	feat(prometheus.py): track team based metrics on prometheus	2024-04-03 13:43:21 -07:00
Ishaan Jaff	a23746b776	(fix) add /metrics to utils.py	2024-03-19 17:28:33 -07:00
Ishaan Jaff	4be25c8817	(feat) prometheus metric collector	2024-03-19 15:44:36 -07:00