litellm-mirror/litellm/router_strategy
Krish Dholakia bd0ba63ac0 Litellm dev 12 26 2024 p4 (#7439)
* fix(model_dashboard.tsx): support setting model_info params - e.g. mode on ui

Closes https://github.com/BerriAI/litellm/issues/5270

* fix(lowest_tpm_rpm_v2.py): deployment rpm over limit check

fixes selection error when getting potential deployments below known tpm/rpm limit

 Fixes https://github.com/BerriAI/litellm/issues/7395

* fix(test_tpm_rpm_routing_v2.py): add unit test for https://github.com/BerriAI/litellm/issues/7395

* fix(lowest_tpm_rpm_v2.py): fix tpm key name in dict post rpm update

* test: rename test to run earlier

* test: skip flaky test
2024-12-27 12:01:42 -08:00
..
budget_limiter.py Support budget/rate limit tiers for keys (#7429) 2024-12-26 19:05:27 -08:00
least_busy.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
lowest_cost.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
lowest_latency.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
lowest_tpm_rpm.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
lowest_tpm_rpm_v2.py Litellm dev 12 26 2024 p4 (#7439) 2024-12-27 12:01:42 -08:00
simple_shuffle.py (refactor router.py ) - PR 3 - Ensure all functions under 100 lines (#6181) 2024-10-14 21:27:54 +05:30
tag_based_routing.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00