phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix(utils.py): move to using litellm.modify_params to enable max output token trimming fix

Browse source
This commit is contained in:
Krrish Dholakia 2024-03-14 12:17:56 -07:00
parent bdd2004691
commit a634424fb2
2 changed files with 2 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/utils.py
View file

@ -2589,7 +2589,7 @@ def client(original_function):
if (
kwargs.get("max_tokens", None) is not None
and model is not None
and litellm.drop_params
and litellm.modify_params
== True # user is okay with params being modified
and (
call_type == CallTypes.acompletion.value