phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 03:04:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

docs(main.py): add timeout to docstring

Browse source
This commit is contained in:
Krrish Dholakia 2024-03-18 21:21:19 -07:00
parent a524918140
commit 693b5eb376
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/main.py
View file

@ -195,10 +195,10 @@ async def acompletion(
api_version (str, optional): API version (default is None). api_version (str, optional): API version (default is None).
api_key (str, optional): API key (default is None). api_key (str, optional): API key (default is None).
model_list (list, optional): List of api base, version, keys model_list (list, optional): List of api base, version, keys
timeout (float, optional): The maximum execution time in seconds for the completion request.
LITELLM Specific Params LITELLM Specific Params
mock_response (str, optional): If provided, return a mock completion response for testing or debugging purposes (default is None). mock_response (str, optional): If provided, return a mock completion response for testing or debugging purposes (default is None).
force_timeout (int, optional): The maximum execution time in seconds for the completion request (default is 600).
custom_llm_provider (str, optional): Used for Non-OpenAI LLMs, Example usage for bedrock, set model="amazon.titan-tg1-large" and custom_llm_provider="bedrock" custom_llm_provider (str, optional): Used for Non-OpenAI LLMs, Example usage for bedrock, set model="amazon.titan-tg1-large" and custom_llm_provider="bedrock"
Returns: Returns:
ModelResponse: A response object containing the generated completion and associated metadata. ModelResponse: A response object containing the generated completion and associated metadata.