phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 10:44:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(feat) textcompletion - transform hf log probs to openai text completion

Browse source
This commit is contained in:
ishaan-jaff 2023-10-31 17:14:37 -07:00
parent b32cedeb28
commit 9223f7cc7a
2 changed files with 11 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/llms/huggingface_restapi.py
View file

@ -348,6 +348,7 @@ def completion(
model_response.usage.completion_tokens = completion_tokens
model_response.usage.prompt_tokens = prompt_tokens
model_response.usage.total_tokens = prompt_tokens + completion_tokens
model_response._hidden_params["original_response"] = completion_response
return model_response