phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(fix) Ollama use new streaming format

Browse source
This commit is contained in:
ishaan-jaff 2023-10-11 16:59:59 -07:00
parent 960481a540
commit 1a7ffbe7b8
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/main.py
View file

@ -1040,7 +1040,7 @@ def completion(
else:
response_string = ""
for chunk in generator:
response_string+=chunk['choices'][0]['delta']['content']
response_string+=chunk['content']
## RESPONSE OBJECT
model_response["choices"][0]["message"]["content"] = response_string