phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to model info map

Browse source 
Closes https://github.com/BerriAI/litellm/issues/4881
This commit is contained in:
Krrish Dholakia 2024-08-10 14:14:24 -07:00
parent e861d97bf2
commit 19bb95f781
5 changed files with 125 additions and 52 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/types/utils.py
View file

@ -77,6 +77,7 @@ class ModelInfo(TypedDict, total=False):
supports_response_schema: Optional[bool]
supports_vision: Optional[bool]
supports_function_calling: Optional[bool]
supports_assistant_prefill: Optional[bool]
class GenericStreamingChunk(TypedDict):