phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

feat(utils.py): support async streaming for custom llm provider

Browse source
This commit is contained in:
Krrish Dholakia 2024-07-25 17:11:57 -07:00
parent b4e3a77ad0
commit 060249c7e0
3 changed files with 38 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/llms/custom_llm.py
View file

@ -17,8 +17,10 @@ from enum import Enum
from functools import partial
from typing import (
Any,
AsyncGenerator,
AsyncIterator,
Callable,
Coroutine,
Iterator,
List,
Literal,