phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix add doc string for abatch_completion_one_model_multiple_requests

Browse source
This commit is contained in:
Ishaan Jaff 2024-05-20 17:51:08 -07:00
parent 5be966dc09
commit 92a4df00d4
1 changed files with 8 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

8
litellm/router.py
View file

@ -702,6 +702,14 @@ class Router:
model (List[str]): model group model (List[str]): model group
messages (List[List[Dict[str, str]]]): list of messages. Each element in the list is one request messages (List[List[Dict[str, str]]]): list of messages. Each element in the list is one request
**kwargs: additional kwargs **kwargs: additional kwargs
Usage:
response = await self.abatch_completion_one_model_multiple_requests(
model="gpt-3.5-turbo",
messages=[
[{"role": "user", "content": "hello"}, {"role": "user", "content": "tell me something funny"}],
[{"role": "user", "content": "hello good mornign"}],
]
)
""" """
async def _async_completion_no_exceptions( async def _async_completion_no_exceptions(