Ishaan Jaff
|
6261ec3599
|
(feat proxy) v2 - model max budgets (#7302)
* clean up unused code
* add _PROXY_VirtualKeyModelMaxBudgetLimiter
* adjust type imports
* working _PROXY_VirtualKeyModelMaxBudgetLimiter
* fix user_api_key_model_max_budget
* fix user_api_key_model_max_budget
* update naming
* update naming
* fix changes to RouterBudgetLimiting
* test_call_with_key_over_model_budget
* test_call_with_key_over_model_budget
* handle _get_request_model_budget_config
* e2e test for test_call_with_key_over_model_budget
* clean up test
* run ci/cd again
* add validate_model_max_budget
* docs fix
* update doc
* add e2e testing for _PROXY_VirtualKeyModelMaxBudgetLimiter
* test_unit_test_max_model_budget_limiter.py
|
2024-12-18 19:42:46 -08:00 |
|