litellm-mirror/litellm/router_utils
Ishaan Jaff 4d1b4beb3d
(refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208)
* use folder for caching

* fix importing caching

* fix clickhouse pyright

* fix linting

* fix correctly pass kwargs and args

* fix test case for embedding

* fix linting

* fix embedding caching logic

* fix refactor handle utils.py

* fix test_embedding_caching_azure_individual_items_reordered
2024-10-14 16:34:01 +05:30
..
router_callbacks [Fix] Router cooldown logic - use % thresholds instead of allowed fails to cooldown deployments (#5698) 2024-09-14 18:01:19 -07:00
batch_utils.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
client_initalization_utils.py Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
cooldown_cache.py (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
cooldown_callbacks.py fix prometheus track cooldown events on custom logger (#6060) 2024-10-04 16:56:22 +05:30
cooldown_handlers.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
fallback_event_handlers.py (feat proxy prometheus) track virtual key, key alias, error code, error code class on prometheus (#5968) 2024-09-28 19:00:21 -07:00
handle_error.py Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
pattern_match_deployments.py LiteLLM Minor Fixes & Improvements (10/10/2024) (#6158) 2024-10-11 23:04:36 -07:00