litellm-mirror/docs/my-website/docs/pass_through/intro.md
2025-01-23 16:59:17 -08:00

617 B

Why Pass-Through Endpoints?

These endpoints are useful for 2 scenarios:

  1. Migrate existing projects to litellm proxy. E.g: If you have users already in production with Anthropic's SDK, you just need to change the base url to get cost tracking/logging/budgets/etc.

  2. Use provider-specific endpoints E.g: If you want to use Vertex AI's token counting endpoint

How is your request handled?

The request is passed through to the provider's endpoint. The response is then passed back to the client. No translation is done.