phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix(utils.py): add new special token for cleanup

Browse source
This commit is contained in:
Krrish Dholakia 2024-06-26 22:52:50 -07:00
parent 31dc3cd84f
commit 23a1f21f86
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/utils.py
View file

@ -7805,6 +7805,7 @@ class CustomStreamWrapper:
"<s>", "<s>",
"</s>", "</s>",
"<|im_end|>", "<|im_end|>",
"<|im_start|>",
] ]
self.holding_chunk = "" self.holding_chunk = ""
self.complete_response = "" self.complete_response = ""