phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix(router.py): gracefully handle scenario where completion response doesn't have total tokens

Browse source 
Closes https://github.com/BerriAI/litellm/issues/4968
This commit is contained in:
Krrish Dholakia 2024-07-30 15:14:03 -07:00
parent 311521e56e
commit ec6db03c41
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/router.py
View file

@ -2944,7 +2944,7 @@ class Router:
elif isinstance(id, int):
id = str(id)
total_tokens = completion_response["usage"]["total_tokens"]
total_tokens = completion_response["usage"].get("total_tokens", 0)
# ------------
# Setup values