(refactor router.py ) - PR 3 - Ensure all functions under 100 lines (#6181)

* add flake 8 check

* split up litellm _acompletion

* fix get model client

* refactor use commong func to add metadata to kwargs

* use common func to get timeout

* re-use helper to _get_async_model_client

* use _handle_mock_testing_rate_limit_error

* fix docstring for _handle_mock_testing_rate_limit_error

* fix function_with_retries

* use helper for mock testing fallbacks

* router - use 1 func for simple_shuffle

* add doc string for simple_shuffle

* use 1 function for filtering cooldown deployments

* fix use common helper to _get_fallback_model_group_from_fallbacks
This commit is contained in:
Ishaan Jaff 2024-10-14 21:27:54 +05:30 committed by GitHub
parent 0761a03d05
commit d0a3052937
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 422 additions and 598 deletions

View file

@ -73,6 +73,7 @@ async def test_azure_tenant_id_auth(respx_mock: MockRouter):
],
created=int(datetime.now().timestamp()),
)
litellm.set_verbose = True
mock_request = respx_mock.post(url__regex=r".*/chat/completions.*").mock(
return_value=httpx.Response(200, json=obj.model_dump(mode="json"))
)