From dca23aaa3e7a550f6fa86a9b67d0e5e9fc3971e8 Mon Sep 17 00:00:00 2001 From: Krrish Dholakia Date: Fri, 14 Jun 2024 21:55:27 -0700 Subject: [PATCH] docs(routing.md): improve docs --- docs/my-website/docs/routing.md | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+) diff --git a/docs/my-website/docs/routing.md b/docs/my-website/docs/routing.md index 1ecac52b7..63fac9456 100644 --- a/docs/my-website/docs/routing.md +++ b/docs/my-website/docs/routing.md @@ -798,6 +798,13 @@ There are 3 types of fallbacks: - `fallbacks`: For all remaining errors - e.g. litellm.RateLimitError **Content Policy Violation Fallback** + +Key change: + +```python +content_policy_fallbacks=[{"claude-2": ["my-fallback-model"]}] +``` + @@ -856,6 +863,12 @@ litellm --config /path/to/config.yaml **Context Window Exceeded Fallback** +Key change: + +```python +context_window_fallbacks=[{"claude-2": ["my-fallback-model"]}] +``` + @@ -914,6 +927,11 @@ litellm --config /path/to/config.yaml **Regular Fallbacks** +Key change: + +```python +fallbacks=[{"claude-2": ["my-fallback-model"]}] +```