Krish Dholakia
70111a7abd
Litellm dev 10 26 2024 ( #6472 )
...
* docs(exception_mapping.md): add missing exception types
Fixes https://github.com/Aider-AI/aider/issues/2120#issuecomment-2438971183
* fix(main.py): register custom model pricing with specific key
Ensure custom model pricing is registered to the specific model+provider key combination
* test: make testing more robust for custom pricing
* fix(redis_cache.py): instrument otel logging for sync redis calls
ensures complete coverage for all redis cache calls
2024-10-28 15:05:43 -07:00
Ishaan Jaff
3ccdb42d26
[Fix] OTEL - Don't log messages when callback settings disable message logging ( #5875 )
...
* fix otel dont log messages
* otel fix redis failure hook logging
2024-09-24 18:29:52 -07:00
Ishaan Jaff
91e58d9049
[Feat] Add proxy level prometheus metrics ( #5789 )
...
* add Proxy Level Tracking Metrics doc
* update service logger
* prometheus - track litellm_proxy_failed_requests_metric
* use REQUESTED_MODEL
* fix prom request_data
2024-09-19 17:13:07 -07:00
Ishaan Jaff
911230c434
[Feat-Proxy-DataDog] Log Redis, Postgres Failure events on DataDog ( #5750 )
...
* dd - start tracking redis status on dd
* add async_service_succes_hook / failure hook in custom logger
* add async_service_failure_hook
* log service failures on dd
* fix import error
* add test for redis errors / warning
2024-09-17 20:24:06 -07:00
Ishaan Jaff
7d4e834091
fix handle case when service logger has no attribute prometheusServicesLogger
2024-08-08 08:23:29 -07:00
Ishaan Jaff
315bba34e6
prom svc logger init if it's None
2024-08-07 09:02:03 -07:00
Ishaan Jaff
f55a0d98f3
otel log failures
2024-08-05 20:23:02 -07:00
Ishaan Jaff
8d91112726
log event_metadata on otel
2024-08-05 20:03:34 -07:00
Ishaan Jaff
19fb5cc11c
use common helpers for writing to otel
2024-07-27 11:40:39 -07:00
Krrish Dholakia
606d04b05b
fix(_service_logging.py): only trigger otel if in service_callback
...
Fixes https://github.com/BerriAI/litellm/issues/4511
2024-07-03 09:48:38 -07:00
Krrish Dholakia
a028600932
feat(dynamic_rate_limiter.py): update cache with active project
2024-06-21 20:25:40 -07:00
Ishaan Jaff
5a5dd33b24
feat - working exception logs for Redis errors
2024-06-07 16:30:29 -07:00
Ishaan Jaff
7c1183e76e
fix import OTEL span
2024-06-07 09:47:13 -07:00
Ishaan Jaff
b734cca43e
fix service logger for OTEL
2024-06-06 22:12:45 -07:00
Krrish Dholakia
81573b2dd9
fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2
2024-04-18 21:38:00 -07:00
Krrish Dholakia
919a2876f1
fix(proxy/utils.py): add prometheus failed db request tracking
2024-04-18 16:30:29 -07:00
Krrish Dholakia
0f95a824c4
feat(prometheus_services.py): emit proxy latency for successful llm api requests
...
uses prometheus histogram for this
2024-04-18 16:04:35 -07:00
Krrish Dholakia
4e81acf2c6
feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)
2024-04-13 18:15:02 -07:00
