phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 03:04:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix: bug fix when n>1 passed in

Browse source
This commit is contained in:
Krrish Dholakia 2023-10-09 16:46:18 -07:00
parent 2004b449e8
commit 253e8d27db
8 changed files with 119 additions and 43 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/llms/together_ai.py
View file

@ -161,7 +161,7 @@ def completion(
raise TogetherAIError(
message=json.dumps(completion_response["output"]), status_code=response.status_code
)
completion_text = completion_response["output"]["choices"][0]["text"]
## CALCULATING USAGE - baseten charges on time, not tokens - have some mapping of cost here.