phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix(utils.py): fix select tokenizer for custom tokenizer (#7599)

Browse source 
* fix(utils.py): fix select tokenizer for custom tokenizer

* fix(router.py): fix 'utils/token_counter' endpoint
This commit is contained in:
Krish Dholakia 2025-01-07 22:37:09 -08:00 • committed by GitHub
parent a6fd407e7c
commit 0cf32ed2f3
4 changed files with 16 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/proxy/proxy_server.py
View file

@ -5606,6 +5606,7 @@ async def token_counter(request: TokenCountRequest):
_tokenizer_used = litellm.utils._select_tokenizer(
model=model_to_use, custom_tokenizer=custom_tokenizer
)
tokenizer_used = str(_tokenizer_used["type"])
total_tokens = token_counter(
model=model_to_use,