(refactor router.py ) - PR 3 - Ensure all functions under 100 lines (#6181)

Browse source

* add flake 8 check

* split up litellm _acompletion

* fix get model client

* refactor use commong func to add metadata to kwargs

* use common func to get timeout

* re-use helper to _get_async_model_client

* use _handle_mock_testing_rate_limit_error

* fix docstring for _handle_mock_testing_rate_limit_error

* fix function_with_retries

* use helper for mock testing fallbacks

* router - use 1 func for simple_shuffle

* add doc string for simple_shuffle

* use 1 function for filtering cooldown deployments

* fix use common helper to _get_fallback_model_group_from_fallbacks

...

This commit is contained in:

Ishaan Jaff 2024-10-14 21:27:54 +05:30 • committed by GitHub

parent a2844c851b

commit ece65164fb

5 changed files with 422 additions and 598 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

916

litellm/router.py

View file

File diff suppressed because it is too large Load diff