phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 11:14:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix add doc string for abatch_completion_one_model_multiple_requests

Browse source
This commit is contained in:
Ishaan Jaff 2024-05-20 17:51:08 -07:00
parent 13c787f9b5
commit ef9372ce00
1 changed files with 8 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

8
litellm/router.py
View file

@ -702,6 +702,14 @@ class Router:
model (List[str]): model group model (List[str]): model group
messages (List[List[Dict[str, str]]]): list of messages. Each element in the list is one request messages (List[List[Dict[str, str]]]): list of messages. Each element in the list is one request
**kwargs: additional kwargs **kwargs: additional kwargs
Usage:
response = await self.abatch_completion_one_model_multiple_requests(
model="gpt-3.5-turbo",
messages=[
[{"role": "user", "content": "hello"}, {"role": "user", "content": "tell me something funny"}],
[{"role": "user", "content": "hello good mornign"}],
]
)
""" """
async def _async_completion_no_exceptions( async def _async_completion_no_exceptions(