litellm-mirror/litellm/proxy/hooks
Krish Dholakia bf6c013de0 Litellm dev 02 18 2025 p2 (#8639)
* fix(parallel_request_limiter.py): improve single instance rate limiting by updating in-memory cache instantly

Fixes issue where parallel request limiter had a leak

* fix(parallel_request_limiter.py): fix parallel request limiter to not decrement val on max limit being reached

* test(test_parallel_request_limiter.py): fix test

* test: fix test

* fix(parallel_request_limiter.py): move to using common enum

* test: fix test
2025-02-18 19:12:16 -08:00
..
__init__.py fix(proxy_server.py): enable pre+post-call hooks and max parallel request limits 2023-12-08 17:11:30 -08:00
azure_content_safety.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
batch_redis_get.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
cache_control_check.py (minor latency fixes / proxy) - use verbose_proxy_logger.debug() instead of litellm.print_verbose (#7664) 2025-01-09 21:06:09 -08:00
dynamic_rate_limiter.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
example_presidio_ad_hoc_recognizer.json fix(presidio_pii_masking.py): enable user to pass ad hoc recognizer for pii masking 2024-02-20 16:01:15 -08:00
key_management_event_hooks.py Litellm dev 01 13 2025 p2 (#7758) 2025-01-14 17:04:01 -08:00
max_budget_limiter.py (minor latency fixes / proxy) - use verbose_proxy_logger.debug() instead of litellm.print_verbose (#7664) 2025-01-09 21:06:09 -08:00
model_max_budget_limiter.py fix - access metadata (#7523) 2025-01-03 10:02:10 -08:00
parallel_request_limiter.py Litellm dev 02 18 2025 p2 (#8639) 2025-02-18 19:12:16 -08:00
prompt_injection_detection.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
proxy_failure_handler.py (feat) Allow disabling ErrorLogs written to the DB (#6940) 2024-11-27 19:34:51 -08:00
proxy_track_cost_callback.py Litellm dev 12 20 2024 p3 (#7339) 2024-12-20 21:13:32 -08:00