mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-26 19:24:27 +00:00
* fix(parallel_request_limiter.py): improve single instance rate limiting by updating in-memory cache instantly Fixes issue where parallel request limiter had a leak * fix(parallel_request_limiter.py): fix parallel request limiter to not decrement val on max limit being reached * test(test_parallel_request_limiter.py): fix test * test: fix test * fix(parallel_request_limiter.py): move to using common enum * test: fix test |
||
---|---|---|
.. | ||
__init__.py | ||
azure_content_safety.py | ||
batch_redis_get.py | ||
cache_control_check.py | ||
dynamic_rate_limiter.py | ||
example_presidio_ad_hoc_recognizer.json | ||
key_management_event_hooks.py | ||
max_budget_limiter.py | ||
model_max_budget_limiter.py | ||
parallel_request_limiter.py | ||
prompt_injection_detection.py | ||
proxy_failure_handler.py | ||
proxy_track_cost_callback.py |