fix: now supports single tokens prediction

This commit is contained in:
fracapuano 2024-07-25 19:06:07 +02:00 committed by Krrish Dholakia
parent a190bc750f
commit c86f8e1eb4

View file

@ -387,7 +387,7 @@ def process_response(
result = " " result = " "
## Building RESPONSE OBJECT ## Building RESPONSE OBJECT
if len(result) > 1: if len(result) >= 1:
model_response.choices[0].message.content = result # type: ignore model_response.choices[0].message.content = result # type: ignore
# Calculate usage # Calculate usage