phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 11:14:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(fix) Ollama use new streaming format

Browse source
This commit is contained in:
ishaan-jaff 2023-10-11 16:59:59 -07:00
parent 7b3ee8d129
commit fabad3dc42
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/main.py
View file

@ -1040,7 +1040,7 @@ def completion(
else: else:
response_string = "" response_string = ""
for chunk in generator: for chunk in generator:
response_string+=chunk['choices'][0]['delta']['content'] response_string+=chunk['content']
## RESPONSE OBJECT ## RESPONSE OBJECT
model_response["choices"][0]["message"]["content"] = response_string model_response["choices"][0]["message"]["content"] = response_string