Ishaan Jaff
|
91e58d9049
|
[Feat] Add proxy level prometheus metrics (#5789)
* add Proxy Level Tracking Metrics doc
* update service logger
* prometheus - track litellm_proxy_failed_requests_metric
* use REQUESTED_MODEL
* fix prom request_data
|
2024-09-19 17:13:07 -07:00 |
|
Ishaan Jaff
|
911230c434
|
[Feat-Proxy-DataDog] Log Redis, Postgres Failure events on DataDog (#5750)
* dd - start tracking redis status on dd
* add async_service_succes_hook / failure hook in custom logger
* add async_service_failure_hook
* log service failures on dd
* fix import error
* add test for redis errors / warning
|
2024-09-17 20:24:06 -07:00 |
|
Ishaan Jaff
|
7d4e834091
|
fix handle case when service logger has no attribute prometheusServicesLogger
|
2024-08-08 08:23:29 -07:00 |
|
Ishaan Jaff
|
315bba34e6
|
prom svc logger init if it's None
|
2024-08-07 09:02:03 -07:00 |
|
Ishaan Jaff
|
f55a0d98f3
|
otel log failures
|
2024-08-05 20:23:02 -07:00 |
|
Ishaan Jaff
|
8d91112726
|
log event_metadata on otel
|
2024-08-05 20:03:34 -07:00 |
|
Ishaan Jaff
|
19fb5cc11c
|
use common helpers for writing to otel
|
2024-07-27 11:40:39 -07:00 |
|
Krrish Dholakia
|
606d04b05b
|
fix(_service_logging.py): only trigger otel if in service_callback
Fixes https://github.com/BerriAI/litellm/issues/4511
|
2024-07-03 09:48:38 -07:00 |
|
Krrish Dholakia
|
a028600932
|
feat(dynamic_rate_limiter.py): update cache with active project
|
2024-06-21 20:25:40 -07:00 |
|
Ishaan Jaff
|
5a5dd33b24
|
feat - working exception logs for Redis errors
|
2024-06-07 16:30:29 -07:00 |
|
Ishaan Jaff
|
7c1183e76e
|
fix import OTEL span
|
2024-06-07 09:47:13 -07:00 |
|
Ishaan Jaff
|
b734cca43e
|
fix service logger for OTEL
|
2024-06-06 22:12:45 -07:00 |
|
Krrish Dholakia
|
81573b2dd9
|
fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2
|
2024-04-18 21:38:00 -07:00 |
|
Krrish Dholakia
|
919a2876f1
|
fix(proxy/utils.py): add prometheus failed db request tracking
|
2024-04-18 16:30:29 -07:00 |
|
Krrish Dholakia
|
0f95a824c4
|
feat(prometheus_services.py): emit proxy latency for successful llm api requests
uses prometheus histogram for this
|
2024-04-18 16:04:35 -07:00 |
|
Krrish Dholakia
|
4e81acf2c6
|
feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)
|
2024-04-13 18:15:02 -07:00 |
|