phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

improvement to hf docs

Browse source
This commit is contained in:
Krrish Dholakia 2023-08-30 16:27:05 -07:00
parent cad7a9b28b
commit 9cc0a094c0
1 changed files with 12 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

13
docs/my-website/docs/providers/huggingface.md
View file

@ -65,4 +65,15 @@ Same as the OpenAI format, but also includes logprobs. [See the code](https://gi
"total_tokens": 25 "total_tokens": 25
} }
} }
``` ```
# FAQ
**Does this support stop sequences?**
Yes, we support stop sequences - and you can pass as many as allowed by Huggingface (or any provider!)
**How do you deal with repetition penalty?**
We map the presence penalty parameter in openai to the repetition penalty parameter on Huggingface. [See code](https://github.com/BerriAI/litellm/blob/b4b2dbf005142e0a483d46a07a88a19814899403/litellm/utils.py#L757).
We welcome any suggestions for improving our Huggingface integration - Create an [issue](https://github.com/BerriAI/litellm/issues/new/choose)/[Join the Discord](https://discord.com/invite/wuPM9dRgDw)!