litellm-mirror/litellm/router_utils
Krish Dholakia 4f8a3fd4cf
redis otel tracing + async support for latency routing (#6452)
* docs(exception_mapping.md): add missing exception types

Fixes https://github.com/Aider-AI/aider/issues/2120#issuecomment-2438971183

* fix(main.py): register custom model pricing with specific key

Ensure custom model pricing is registered to the specific model+provider key combination

* test: make testing more robust for custom pricing

* fix(redis_cache.py): instrument otel logging for sync redis calls

ensures complete coverage for all redis cache calls

* refactor: pass parent_otel_span for redis caching calls in router

allows for more observability into what calls are causing latency issues

* test: update tests with new params

* refactor: ensure e2e otel tracing for router

* refactor(router.py): add more otel tracing acrosss router

catch all latency issues for router requests

* fix: fix linting error

* fix(router.py): fix linting error

* fix: fix test

* test: fix tests

* fix(dual_cache.py): pass ttl to redis cache

* fix: fix param
2024-10-28 21:52:12 -07:00
..
router_callbacks (testing) Router add testing coverage (#6253) 2024-10-16 07:32:27 -07:00
batch_utils.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
client_initalization_utils.py (refactor) router - use static methods for client init utils (#6420) 2024-10-24 19:26:46 +04:00
cooldown_cache.py redis otel tracing + async support for latency routing (#6452) 2024-10-28 21:52:12 -07:00
cooldown_callbacks.py (testing) add router unit testing for send_llm_exception_alert , router_cooldown_event_callback , cooldown utils (#6258) 2024-10-16 23:19:51 +05:30
cooldown_handlers.py redis otel tracing + async support for latency routing (#6452) 2024-10-28 21:52:12 -07:00
fallback_event_handlers.py (router testing) Add testing coverage for run_async_fallback and run_sync_fallback (#6256) 2024-10-16 16:16:17 +05:30
handle_error.py (testing) add router unit testing for send_llm_exception_alert , router_cooldown_event_callback , cooldown utils (#6258) 2024-10-16 23:19:51 +05:30
pattern_match_deployments.py LiteLLM Minor Fixes & Improvements (10/23/2024) (#6407) 2024-10-24 19:01:41 -07:00