phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix(bedrock.py): support claude 3 function calling when stream=true

Browse source 
https://github.com/BerriAI/litellm/issues/2615
This commit is contained in:
Krrish Dholakia 2024-03-21 18:39:03 -07:00
parent 425165dda9
commit 94f55aa6d9
2 changed files with 70 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

6
litellm/main.py
View file

@ -1753,7 +1753,11 @@ def completion(
timeout=timeout,
)
if "stream" in optional_params and optional_params["stream"] == True:
if (
"stream" in optional_params
and optional_params["stream"] == True
and not isinstance(response, CustomStreamWrapper)
):
# don't try to access stream object,
if "ai21" in model:
response = CustomStreamWrapper(