Krish Dholakia
c1bfbc882f
Litellm dev 10 26 2024 ( #6472 )
...
* docs(exception_mapping.md): add missing exception types
Fixes https://github.com/Aider-AI/aider/issues/2120#issuecomment-2438971183
* fix(main.py): register custom model pricing with specific key
Ensure custom model pricing is registered to the specific model+provider key combination
* test: make testing more robust for custom pricing
* fix(redis_cache.py): instrument otel logging for sync redis calls
ensures complete coverage for all redis cache calls
2024-10-28 15:05:43 -07:00
Ishaan Jaff
26d8097779
[Fix] OTEL - Don't log messages when callback settings disable message logging ( #5875 )
...
* fix otel dont log messages
* otel fix redis failure hook logging
2024-09-24 18:29:52 -07:00
Ishaan Jaff
fd6cc10922
[Feat] Add proxy level prometheus metrics ( #5789 )
...
* add Proxy Level Tracking Metrics doc
* update service logger
* prometheus - track litellm_proxy_failed_requests_metric
* use REQUESTED_MODEL
* fix prom request_data
2024-09-19 17:13:07 -07:00
Ishaan Jaff
d9ded448ec
[Feat-Proxy-DataDog] Log Redis, Postgres Failure events on DataDog ( #5750 )
...
* dd - start tracking redis status on dd
* add async_service_succes_hook / failure hook in custom logger
* add async_service_failure_hook
* log service failures on dd
* fix import error
* add test for redis errors / warning
2024-09-17 20:24:06 -07:00
Ishaan Jaff
d8345fe615
fix handle case when service logger has no attribute prometheusServicesLogger
2024-08-08 08:23:29 -07:00
Ishaan Jaff
587b9dce9a
prom svc logger init if it's None
2024-08-07 09:02:03 -07:00
Ishaan Jaff
98073f575a
otel log failures
2024-08-05 20:23:02 -07:00
Ishaan Jaff
a68969ea0e
log event_metadata on otel
2024-08-05 20:03:34 -07:00
Ishaan Jaff
aade38760d
use common helpers for writing to otel
2024-07-27 11:40:39 -07:00
Krrish Dholakia
131fcac7d8
fix(_service_logging.py): only trigger otel if in service_callback
...
Fixes https://github.com/BerriAI/litellm/issues/4511
2024-07-03 09:48:38 -07:00
Krrish Dholakia
0430807178
feat(dynamic_rate_limiter.py): update cache with active project
2024-06-21 20:25:40 -07:00
Ishaan Jaff
72a6d49b21
feat - working exception logs for Redis errors
2024-06-07 16:30:29 -07:00
Ishaan Jaff
ca99456e04
fix import OTEL span
2024-06-07 09:47:13 -07:00
Ishaan Jaff
312521a0b3
fix service logger for OTEL
2024-06-06 22:12:45 -07:00
Krrish Dholakia
376ee4e9d7
fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2
2024-04-18 21:38:00 -07:00
Krrish Dholakia
51cc8dd95b
fix(proxy/utils.py): add prometheus failed db request tracking
2024-04-18 16:30:29 -07:00
Krrish Dholakia
7f5bcf38b7
feat(prometheus_services.py): emit proxy latency for successful llm api requests
...
uses prometheus histogram for this
2024-04-18 16:04:35 -07:00
Krrish Dholakia
866259f95f
feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)
2024-04-13 18:15:02 -07:00
