phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Don't fail for global_max_parallel_requests = 1

Browse source 
When `global_max_parallel_requests` was set to `1`, all requests
failed.
This commit is contained in:
Vedran Vidović 2025-02-21 09:39:38 +01:00 • committed by Vedran Vidović
parent f670ebeb2f
commit f449857d57
2 changed files with 30 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/proxy/hooks/parallel_request_limiter.py
View file

@ -222,7 +222,7 @@ class _PROXY_MaxParallelRequestsHandler(CustomLogger):
)
# check if below limit
if current_global_requests is None:
current_global_requests = 1
current_global_requests = 0
# if above -> raise error
if current_global_requests >= global_max_parallel_requests:
return self.raise_rate_limit_error(