diff --git a/docs/my-website/docs/tutorials/model_config_proxy.md b/docs/my-website/docs/tutorials/model_config_proxy.md index 32f0528a9..eaa81d213 100644 --- a/docs/my-website/docs/tutorials/model_config_proxy.md +++ b/docs/my-website/docs/tutorials/model_config_proxy.md @@ -28,7 +28,8 @@ This will return the most recent log (by default logs are stored in a local file As we can see, this is the formatting sent to huggingface: -- + + This follows [our formatting](https://github.com/BerriAI/litellm/blob/9932371f883c55fd0f3142f91d9c40279e8fe241/litellm/llms/prompt_templates/factory.py#L10) for CodeLlama (based on the [Huggingface's documentation](https://huggingface.co/blog/codellama#conversational-instructions)). But this lacks BOS(``) and EOS(``) tokens. @@ -92,6 +93,7 @@ $ litellm --test ``` See our new input prompt to Huggingface! - + + Congratulations 🎉 \ No newline at end of file