phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(refactor router.py ) - PR 3 - Ensure all functions under 100 lines (#6181)

Browse source 
* add flake 8 check

* split up litellm _acompletion

* fix get model client

* refactor use commong func to add metadata to kwargs

* use common func to get timeout

* re-use helper to _get_async_model_client

* use _handle_mock_testing_rate_limit_error

* fix docstring for _handle_mock_testing_rate_limit_error

* fix function_with_retries

* use helper for mock testing fallbacks

* router - use 1 func for simple_shuffle

* add doc string for simple_shuffle

* use 1 function for filtering cooldown deployments

* fix use common helper to _get_fallback_model_group_from_fallbacks
This commit is contained in:
Ishaan Jaff 2024-10-14 21:27:54 +05:30 • committed by GitHub
parent 0761a03d05
commit d0a3052937
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 422 additions and 598 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/router_utils/fallback_event_handlers.py
View file

@ -66,7 +66,7 @@ def run_sync_fallback(
**kwargs,
) -> Any:
"""
Iterate through the model groups and try calling that deployment.
Iterate through the fallback model groups and try calling each fallback deployment.
"""
error_from_fallbacks = original_exception
for mg in fallback_model_group: