phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-24 18:24:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(docs) routing

Browse source
This commit is contained in:
ishaan-jaff 2023-11-29 18:09:39 -08:00
parent f299120394
commit c1914a01bc
1 changed files with 2 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/my-website/docs/routing.md
View file

@ -78,6 +78,8 @@ Router provides 2 strategies for routing your calls across multiple deployments:
**Default** Picks a deployment based on the provided **Requests per minute (rpm) or Tokens per minute (tpm)** **Default** Picks a deployment based on the provided **Requests per minute (rpm) or Tokens per minute (tpm)**
If `rpm` or `tpm` is not provided, it randomly picks a deployment
```python ```python
from litellm import Router from litellm import Router
import asyncio import asyncio