litellm-mirror/litellm/proxy/auth
Krish Dholakia d6a2beb342 Support budget/rate limit tiers for keys (#7429)
* feat(proxy/utils.py): get associated litellm budget from db in combined_view for key

allows user to create rate limit tiers and associate those to keys

* feat(proxy/_types.py): update the value of key-level tpm/rpm/model max budget metrics with the associated budget table values if set

allows rate limit tiers to be easily applied to keys

* docs(rate_limit_tiers.md): add doc on setting rate limit / budget tiers

make feature discoverable

* feat(key_management_endpoints.py): return litellm_budget_table value in key generate

make it easy for user to know associated budget on key creation

* fix(key_management_endpoints.py): document 'budget_id' param in `/key/generate`

* docs(key_management_endpoints.py): document budget_id usage

* refactor(budget_management_endpoints.py): refactor budget endpoints into separate file - makes it easier to run documentation testing against it

* docs(test_api_docs.py): add budget endpoints to ci/cd doc test + add missing param info to docs

* fix(customer_endpoints.py): use new pydantic obj name

* docs(user_management_heirarchy.md): add simple doc explaining teams/keys/org/users on litellm

* Litellm dev 12 26 2024 p2 (#7432)

* (Feat) Add logging for `POST v1/fine_tuning/jobs`  (#7426)

* init commit ft jobs logging

* add ft logging

* add logging for FineTuningJob

* simple FT Job create test

* (docs) - show all supported Azure OpenAI endpoints in overview  (#7428)

* azure batches

* update doc

* docs azure endpoints

* docs endpoints on azure

* docs azure batches api

* docs azure batches api

* fix(key_management_endpoints.py): fix key update to actually work

* test(test_key_management.py): add e2e test asserting ui key update call works

* fix: proxy/_types - fix linting erros

* test: update test

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* fix: test

* fix(parallel_request_limiter.py): enforce tpm/rpm limits on key from tiers

* fix: fix linting errors

* test: fix test

* fix: remove unused import

* test: update test

* docs(customer_endpoints.py): document new model_max_budget param

* test: specify unique key alias

* docs(budget_management_endpoints.py): document new model_max_budget param

* test: fix test

* test: fix tests

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
2024-12-26 19:05:27 -08:00
..
auth_checks.py Litellm enforce enterprise features (#7357) 2024-12-21 19:14:13 -08:00
auth_checks_organization.py (feat proxy) [beta] add support for organization role based access controls (#6112) 2024-10-09 15:18:18 +05:30
auth_utils.py Support budget/rate limit tiers for keys (#7429) 2024-12-26 19:05:27 -08:00
handle_jwt.py Litellm dev 12 06 2024 (#7067) 2024-12-06 22:44:18 -08:00
litellm_license.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
model_checks.py (Admin UI) correctly render provider name in /models with wildcard routing (#7349) 2024-12-21 14:19:12 -08:00
oauth2_check.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
oauth2_proxy_hook.py add hook for oauth2 proxy 2024-08-28 15:51:20 -07:00
public_key.pem fix update public key 2024-07-27 09:45:58 -07:00
rds_iam_token.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
route_checks.py fix if "/openai/" in route: 2024-12-25 21:11:08 -08:00
service_account_checks.py [Feat-Proxy] add service accounts backend (#5852) 2024-09-23 16:37:02 -07:00
user_api_key_auth.py Litellm dev 12 20 2024 p3 (#7339) 2024-12-20 21:13:32 -08:00