Ishaan Jaff
|
9b340fb2f8
|
feat - add remaining budget for key on prometheus
|
2024-06-13 14:37:02 -07:00 |
|
Ishaan Jaff
|
51157c148f
|
feat - add remaining team budget gauge
|
2024-06-13 14:28:25 -07:00 |
|
Bram van Meurs
|
270dad93d5
|
feat(prometheus): add api_team_alias to exported labels
|
2024-06-13 12:50:40 +02:00 |
|
Krrish Dholakia
|
6cca5612d2
|
refactor: replace 'traceback.print_exc()' with logging library
allows error logs to be in json format for otel logging
|
2024-06-06 13:47:43 -07:00 |
|
Krrish Dholakia
|
4a3b084961
|
feat(bedrock_httpx.py): moves to using httpx client for bedrock cohere calls
|
2024-05-11 13:43:08 -07:00 |
|
Krrish Dholakia
|
6575143460
|
feat(proxy_server.py): return litellm version in response headers
|
2024-05-08 16:00:08 -07:00 |
|
Krrish Dholakia
|
52d5e02d8b
|
fix(prometheus.py): fix user-id get for prometheus
|
2024-04-24 08:08:42 -07:00 |
|
Krrish Dholakia
|
6ac0dba5c2
|
fix(prometheus.py): add user tracking to prometheus
|
2024-04-22 15:14:38 -07:00 |
|
Krrish Dholakia
|
9379e3d047
|
fix(lowest_tpm_rpm_v2.py): use a combined tpm+rpm query in async get cache, to reduce redis client calls in high traffic
|
2024-04-20 16:13:11 -07:00 |
|
Krrish Dholakia
|
08cf77623b
|
fix(caching.py): remove url parsing logic - causing redis ssl connections to fail
this reverts a change that was causing redis url w/ ssl to fail. this also adds unit testing for this sc
enario, to prevent future regressions
|
2024-04-19 14:01:13 -07:00 |
|
Krrish Dholakia
|
d8d78bfb4f
|
fix(prometheus.py): fix metric name to be more accurate
change metric name from litellm_failed_requests_metric to litellm_llm_api_failed_requests_metric
|
2024-04-18 12:30:44 -07:00 |
|
Krrish Dholakia
|
28edb77350
|
fix(utils.py): support prometheus failed call metrics
|
2024-04-18 12:29:15 -07:00 |
|
Ishaan Jaff
|
53388b4436
|
fix don't log user_api_key to prometheus
|
2024-04-16 19:01:38 -07:00 |
|
Krrish Dholakia
|
4e81acf2c6
|
feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)
|
2024-04-13 18:15:02 -07:00 |
|
Krrish Dholakia
|
fcaa452ccd
|
feat(prometheus.py): track team based metrics on prometheus
|
2024-04-03 13:43:21 -07:00 |
|
Ishaan Jaff
|
c196186190
|
(fix) add /metrics to utils.py
|
2024-03-19 17:28:33 -07:00 |
|
Ishaan Jaff
|
d2522752a6
|
(feat) prometheus metric collector
|
2024-03-19 15:44:36 -07:00 |
|