phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix(factory.py): support 'add_generation_prompt' field for hf chat templates

Browse source 
Fixes https://github.com/BerriAI/litellm/pull/5178#issuecomment-2306362008
This commit is contained in:
Krrish Dholakia 2024-08-23 08:06:21 -07:00
parent afb00a27cb
commit 874d58fe8a
3 changed files with 84 additions and 7 deletions
Download patch file Download diff file Expand all files Collapse all files

3
litellm/llms/huggingface_restapi.py
View file

@ -179,6 +179,9 @@ class HuggingfaceConfig:
optional_params["decoder_input_details"] = True
return optional_params
def get_hf_api_key(self) -> Optional[str]:
return litellm.utils.get_secret("HUGGINGFACE_API_KEY")
def output_parser(generated_text: str):
"""