Ishaan Jaff
|
fd6cc10922
|
[Feat] Add proxy level prometheus metrics (#5789)
* add Proxy Level Tracking Metrics doc
* update service logger
* prometheus - track litellm_proxy_failed_requests_metric
* use REQUESTED_MODEL
* fix prom request_data
|
2024-09-19 17:13:07 -07:00 |
|
Ishaan Jaff
|
d9ded448ec
|
[Feat-Proxy-DataDog] Log Redis, Postgres Failure events on DataDog (#5750)
* dd - start tracking redis status on dd
* add async_service_succes_hook / failure hook in custom logger
* add async_service_failure_hook
* log service failures on dd
* fix import error
* add test for redis errors / warning
|
2024-09-17 20:24:06 -07:00 |
|
Ishaan Jaff
|
d8345fe615
|
fix handle case when service logger has no attribute prometheusServicesLogger
|
2024-08-08 08:23:29 -07:00 |
|
Ishaan Jaff
|
587b9dce9a
|
prom svc logger init if it's None
|
2024-08-07 09:02:03 -07:00 |
|
Ishaan Jaff
|
98073f575a
|
otel log failures
|
2024-08-05 20:23:02 -07:00 |
|
Ishaan Jaff
|
a68969ea0e
|
log event_metadata on otel
|
2024-08-05 20:03:34 -07:00 |
|
Ishaan Jaff
|
aade38760d
|
use common helpers for writing to otel
|
2024-07-27 11:40:39 -07:00 |
|
Krrish Dholakia
|
131fcac7d8
|
fix(_service_logging.py): only trigger otel if in service_callback
Fixes https://github.com/BerriAI/litellm/issues/4511
|
2024-07-03 09:48:38 -07:00 |
|
Krrish Dholakia
|
0430807178
|
feat(dynamic_rate_limiter.py): update cache with active project
|
2024-06-21 20:25:40 -07:00 |
|
Ishaan Jaff
|
72a6d49b21
|
feat - working exception logs for Redis errors
|
2024-06-07 16:30:29 -07:00 |
|
Ishaan Jaff
|
ca99456e04
|
fix import OTEL span
|
2024-06-07 09:47:13 -07:00 |
|
Ishaan Jaff
|
312521a0b3
|
fix service logger for OTEL
|
2024-06-06 22:12:45 -07:00 |
|
Krrish Dholakia
|
376ee4e9d7
|
fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2
|
2024-04-18 21:38:00 -07:00 |
|
Krrish Dholakia
|
51cc8dd95b
|
fix(proxy/utils.py): add prometheus failed db request tracking
|
2024-04-18 16:30:29 -07:00 |
|
Krrish Dholakia
|
7f5bcf38b7
|
feat(prometheus_services.py): emit proxy latency for successful llm api requests
uses prometheus histogram for this
|
2024-04-18 16:04:35 -07:00 |
|
Krrish Dholakia
|
866259f95f
|
feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)
|
2024-04-13 18:15:02 -07:00 |
|