From 8be8022914575a3b40e477ca4341ae1274b999a4 Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Wed, 16 Apr 2025 22:25:16 -0700 Subject: [PATCH] docs(vertex_ai.md): document new vertex passthrough route --- docs/my-website/docs/pass_through/vertex_ai.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/docs/my-website/docs/pass_through/vertex_ai.md b/docs/my-website/docs/pass_through/vertex_ai.md index 4918d889ed..f40dfa70eb 100644 --- a/docs/my-website/docs/pass_through/vertex_ai.md +++ b/docs/my-website/docs/pass_through/vertex_ai.md @@ -13,6 +13,15 @@ Pass-through endpoints for Vertex AI - call provider-specific endpoint, in nativ | End-user Tracking | ❌ | [Tell us if you need this](https://github.com/BerriAI/litellm/issues/new) | | Streaming | ✅ | | +## Supported Endpoints + +LiteLLM supports 2 vertex ai passthrough routes: + +1. `/vertex_ai` → routes to `https://{vertex_location}-aiplatform.googleapis.com/` +2. `/vertex_ai/discovery` → routes to [`https://discoveryengine.googleapis.com`](https://discoveryengine.googleapis.com/) + +## How to use + Just replace `https://REGION-aiplatform.googleapis.com` with `LITELLM_PROXY_BASE_URL/vertex_ai` LiteLLM supports 3 flows for calling Vertex AI endpoints via pass-through: