phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 10:44:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(Router) - If allowed_fails or allowed_fail_policy set, use that for single deployment cooldown logic (#8668)

Browse source 
* fix cooldown 1 deployment

* test_single_deployment_cooldown_with_allowed_fail_policy

* fix docstring test

* test_single_deployment_no_cooldowns

* ci/cd run again

* test router cooldowns
This commit is contained in:
Ishaan Jaff 2025-02-25 15:15:01 -08:00 • committed by GitHub
parent fd9e62cbc8
commit f6fa2399cc
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 106 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/router_utils/cooldown_handlers.py
View file

@ -216,7 +216,7 @@ def _should_cooldown_deployment(
return True
return False
elif not is_single_deployment_model_group:
else:
return should_cooldown_based_on_allowed_fails_policy(
litellm_router_instance=litellm_router_instance,
deployment=deployment,