phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix comment

Browse source
This commit is contained in:
Ishaan Jaff 2024-11-19 17:53:34 -08:00
parent f4369f0427
commit fdd9dda2d9
1 changed files with 1 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

3
litellm/router_strategy/provider_budgets.py
View file

@ -3,7 +3,7 @@ Provider budget limiting
Use this if you want to set $ budget limits for each provider.
Note: This is a filter, like tag-routing
Note: This is a filter, like tag-routing. Meaning it will accept healthy deployments and then filter out deployments that have exceeded their budget limit.
This means you can use this with weighted-pick, lowest-latency, simple-shuffle, routing etc
@ -18,7 +18,6 @@ anthropic:
```
"""
import random
from typing import TYPE_CHECKING, Any, Dict, List, Optional, TypedDict, Union
import litellm