phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat(utils.py): support async streaming for custom llm provider

Browse source
This commit is contained in:
Krrish Dholakia 2024-07-25 17:11:57 -07:00
parent bf23aac11d
commit 9b1c7066b7
3 changed files with 38 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/llms/custom_llm.py
View file

@ -17,8 +17,10 @@ from enum import Enum
from functools import partial
from typing import (
Any,
AsyncGenerator,
AsyncIterator,
Callable,
Coroutine,
Iterator,
List,
Literal,