mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-26 19:24:27 +00:00
80f7af510b
* refactor(_is_cooldown_required): move '_is_cooldown_required' into cooldown_handlers.py * refactor(cooldown_handlers.py): move cooldown constants into `.constants.py` * fix(cooldown_handlers.py): remove if single deployment don't cooldown logic move to traffic based cooldown logic Addresses https://github.com/BerriAI/litellm/issues/7822 * fix: add unit tests for '_should_cooldown_deployment' * test: ensure all tests pass * test: update test * fix(cooldown_handlers.py): don't cooldown single deployment models for anything besides traffic related errors * fix(cooldown_handlers.py): fix cooldown handler logic * fix(cooldown_handlers.py): fix check |
||
|---|---|---|
| .. | ||
| pre_call_checks | ||
| router_callbacks | ||
| batch_utils.py | ||
| client_initalization_utils.py | ||
| cooldown_cache.py | ||
| cooldown_callbacks.py | ||
| cooldown_handlers.py | ||
| fallback_event_handlers.py | ||
| get_retry_from_policy.py | ||
| handle_error.py | ||
| pattern_match_deployments.py | ||
| prompt_caching_cache.py | ||
| response_headers.py | ||