phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 10:44:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(docs + testing) Correctly document the timeout value used by litellm proxy is 6000 seconds + add to best practices for prod (#6339)

Browse source 
* fix docs use documented timeout

* document request timeout

* add test for litellm.request_timeout

* add test for checking value of timeout
This commit is contained in:
Ishaan Jaff 2024-10-23 14:09:35 +05:30 • committed by GitHub
parent 64c3d3210c
commit 807e9dcea8
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
7 changed files with 54 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/proxy/proxy_cli.py
View file

@ -125,7 +125,7 @@ def is_port_in_use(port):
)
@click.option(
"--request_timeout",
default=600,
default=6000,
type=int,
help="Set timeout in seconds for completion calls",
)