phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix(fix-'get_model_group_info'-to-return-a-default-value-if-unmapped-model-group): allows model hub to return all model groupss

Browse source
This commit is contained in:
Krrish Dholakia 2024-05-27 13:53:01 -07:00
parent 54e4a2f7ac
commit 67da24f144
2 changed files with 44 additions and 15 deletions
Download patch file Download diff file Expand all files Collapse all files

12
litellm/types/utils.py
View file

@ -19,11 +19,13 @@ class ModelInfo(TypedDict):
Model info for a given model, this is information found in litellm.model_prices_and_context_window.json
"""
max_tokens: int
max_input_tokens: int
max_output_tokens: int
max_tokens: Optional[int]
max_input_tokens: Optional[int]
max_output_tokens: Optional[int]
input_cost_per_token: float
output_cost_per_token: float
litellm_provider: str
mode: str
supported_openai_params: List[str]
mode: Literal[
"completion", "embedding", "image_generation", "chat", "audio_transcription"
]
supported_openai_params: Optional[List[str]]