forked from phoenix/litellm-mirror
docs(routing.md): improve docs
This commit is contained in:
parent
a7a63f8392
commit
dca23aaa3e
1 changed files with 18 additions and 0 deletions
|
@ -798,6 +798,13 @@ There are 3 types of fallbacks:
|
|||
- `fallbacks`: For all remaining errors - e.g. litellm.RateLimitError
|
||||
|
||||
**Content Policy Violation Fallback**
|
||||
|
||||
Key change:
|
||||
|
||||
```python
|
||||
content_policy_fallbacks=[{"claude-2": ["my-fallback-model"]}]
|
||||
```
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="sdk" label="SDK">
|
||||
|
||||
|
@ -856,6 +863,12 @@ litellm --config /path/to/config.yaml
|
|||
|
||||
**Context Window Exceeded Fallback**
|
||||
|
||||
Key change:
|
||||
|
||||
```python
|
||||
context_window_fallbacks=[{"claude-2": ["my-fallback-model"]}]
|
||||
```
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="sdk" label="SDK">
|
||||
|
||||
|
@ -914,6 +927,11 @@ litellm --config /path/to/config.yaml
|
|||
|
||||
**Regular Fallbacks**
|
||||
|
||||
Key change:
|
||||
|
||||
```python
|
||||
fallbacks=[{"claude-2": ["my-fallback-model"]}]
|
||||
```
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="sdk" label="SDK">
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue