From f74a43aa78052af0924e9d88fb93cee9fb8343cf Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Sun, 28 Apr 2024 09:48:03 -0700 Subject: [PATCH] docs(vllm.md): update docs to tell people to check openai-compatible endpoint docs for vllm --- docs/my-website/docs/providers/vllm.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/docs/my-website/docs/providers/vllm.md b/docs/my-website/docs/providers/vllm.md index b8285da71..8c8f363f8 100644 --- a/docs/my-website/docs/providers/vllm.md +++ b/docs/my-website/docs/providers/vllm.md @@ -4,6 +4,13 @@ LiteLLM supports all models on VLLM. 🚀[Code Tutorial](https://github.com/BerriAI/litellm/blob/main/cookbook/VLLM_Model_Testing.ipynb) + +:::info + +To call a HOSTED VLLM Endpoint use [these docs](./openai_compatible.md) + +::: + ### Quick Start ``` pip install litellm vllm