diff --git a/docs/my-website/docs/providers/huggingface.md b/docs/my-website/docs/providers/huggingface.md index 033c7129f..14d31b7eb 100644 --- a/docs/my-website/docs/providers/huggingface.md +++ b/docs/my-website/docs/providers/huggingface.md @@ -65,4 +65,15 @@ Same as the OpenAI format, but also includes logprobs. [See the code](https://gi "total_tokens": 25 } } -``` \ No newline at end of file +``` + +# FAQ +**Does this support stop sequences?** + +Yes, we support stop sequences - and you can pass as many as allowed by Huggingface (or any provider!) + +**How do you deal with repetition penalty?** + +We map the presence penalty parameter in openai to the repetition penalty parameter on Huggingface. [See code](https://github.com/BerriAI/litellm/blob/b4b2dbf005142e0a483d46a07a88a19814899403/litellm/utils.py#L757). + +We welcome any suggestions for improving our Huggingface integration - Create an [issue](https://github.com/BerriAI/litellm/issues/new/choose)/[Join the Discord](https://discord.com/invite/wuPM9dRgDw)! \ No newline at end of file