phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix(router.py): check for request_timeout in acompletion

Browse source 
support 'request_timeout' param in router acompletion
This commit is contained in:
Krrish Dholakia 2024-07-17 17:16:44 -07:00
parent 5faa840eb1
commit 0a94953896
2 changed files with 6 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

3
litellm/router.py
View file

@ -718,6 +718,9 @@ class Router:
data.get(
"timeout", None
) # timeout set on litellm_params for this deployment
or data.get(
"request_timeout", None
) # timeout set on litellm_params for this deployment
or self.timeout # timeout set on router
or kwargs.get(
"timeout", None