From d1a40ecacf1dd6f12d9626aa486572edd41bc5d4 Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Fri, 23 Feb 2024 08:34:08 -0800 Subject: [PATCH] docs(load_balancing.md): have proxy routing docs point to sdk routing docs --- docs/my-website/docs/proxy/load_balancing.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/my-website/docs/proxy/load_balancing.md b/docs/my-website/docs/proxy/load_balancing.md index bc40ff2c77..e83b79486b 100644 --- a/docs/my-website/docs/proxy/load_balancing.md +++ b/docs/my-website/docs/proxy/load_balancing.md @@ -2,6 +2,14 @@ Load balance multiple instances of the same model The proxy will handle routing requests (using LiteLLM's Router). **Set `rpm` in the config if you want maximize throughput** + + +:::info + +For more details on routing strategies / params, see [Routing](../routing.md) + +::: + ## Quick Start - Load Balancing ### Step 1 - Set deployments on config