phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix(utils.py): fix model registeration to model cost map

Browse source 
Fixes https://github.com/BerriAI/litellm/issues/4972
This commit is contained in:
Krrish Dholakia 2024-07-30 18:15:00 -07:00
parent 142f4fefd0
commit 46634af06f
5 changed files with 73 additions and 14 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/types/utils.py
View file

@ -40,6 +40,8 @@ class ModelInfo(TypedDict, total=False):
Model info for a given model, this is information found in litellm.model_prices_and_context_window.json
"""
key: Required[str] # the key in litellm.model_cost which is returned
max_tokens: Required[Optional[int]]
max_input_tokens: Required[Optional[int]]
max_output_tokens: Required[Optional[int]]