litellm-mirror/litellm/proxy/hooks
Krish Dholakia b4e5c0de69
Improve rpm check on keys (#8301)
* fix(parallel_request_limiter.py): initial commit that solves the rpm limit check on keys

Fixes https://github.com/BerriAI/litellm/issues/6938

* fix(parallel_request_limiter.py): simpler approach - just increment RPM in pre call hook instead of on success

* fix(parallel_request_limiter.py): pass testing

* fix: fix linting error

* fix(parallel_request_limiter.py): fix parallel request check for keys
2025-02-05 20:23:08 -08:00
..
__init__.py fix(proxy_server.py): enable pre+post-call hooks and max parallel request limits 2023-12-08 17:11:30 -08:00
azure_content_safety.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
batch_redis_get.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
cache_control_check.py (minor latency fixes / proxy) - use verbose_proxy_logger.debug() instead of litellm.print_verbose (#7664) 2025-01-09 21:06:09 -08:00
dynamic_rate_limiter.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
example_presidio_ad_hoc_recognizer.json fix(presidio_pii_masking.py): enable user to pass ad hoc recognizer for pii masking 2024-02-20 16:01:15 -08:00
key_management_event_hooks.py Litellm dev 01 13 2025 p2 (#7758) 2025-01-14 17:04:01 -08:00
max_budget_limiter.py (minor latency fixes / proxy) - use verbose_proxy_logger.debug() instead of litellm.print_verbose (#7664) 2025-01-09 21:06:09 -08:00
model_max_budget_limiter.py fix - access metadata (#7523) 2025-01-03 10:02:10 -08:00
parallel_request_limiter.py Improve rpm check on keys (#8301) 2025-02-05 20:23:08 -08:00
prompt_injection_detection.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
proxy_failure_handler.py (feat) Allow disabling ErrorLogs written to the DB (#6940) 2024-11-27 19:34:51 -08:00
proxy_track_cost_callback.py Litellm dev 12 20 2024 p3 (#7339) 2024-12-20 21:13:32 -08:00