mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-24 18:24:20 +00:00
(docs) routing
This commit is contained in:
parent
f299120394
commit
c1914a01bc
1 changed files with 2 additions and 0 deletions
|
@ -78,6 +78,8 @@ Router provides 2 strategies for routing your calls across multiple deployments:
|
|||
|
||||
**Default** Picks a deployment based on the provided **Requests per minute (rpm) or Tokens per minute (tpm)**
|
||||
|
||||
If `rpm` or `tpm` is not provided, it randomly picks a deployment
|
||||
|
||||
```python
|
||||
from litellm import Router
|
||||
import asyncio
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue