phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fixes to get optional params

Browse source
This commit is contained in:
Krrish Dholakia 2023-10-02 14:44:11 -07:00
parent 0ae93d1112
commit 8c48af11c2
9 changed files with 86 additions and 90 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/main.py
View file

@ -977,7 +977,6 @@ def completion(
encoding=encoding,
logging_obj=logging
)
if "stream" in optional_params and optional_params["stream"]==True: ## [BETA]
# sagemaker does not support streaming as of now so we're faking streaming:
# https://discuss.huggingface.co/t/streaming-output-text-when-deploying-on-sagemaker/39611