phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge pull request #2472 from BerriAI/litellm_anthropic_streaming_tool_calling

Browse source 
fix(anthropic.py): support claude-3 streaming with function calling
This commit is contained in:
Krish Dholakia 2024-03-12 21:36:01 -07:00 • committed by GitHub
commit ce3c865adb
5 changed files with 150 additions and 27 deletions
Download patch file Download diff file Expand all files Collapse all files

6
litellm/main.py
View file

@ -1144,7 +1144,11 @@ def completion(
logging_obj=logging,
headers=headers,
)
if "stream" in optional_params and optional_params["stream"] == True:
if (
"stream" in optional_params
and optional_params["stream"] == True
and not isinstance(response, CustomStreamWrapper)
):
# don't try to access stream object,
response = CustomStreamWrapper(
response,