mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-26 11:14:04 +00:00
reduces number of redis requests. 85ms latency improvement over 3 minutes of load (19k requests). |
||
---|---|---|
.. | ||
__init__.py | ||
batch_redis_get.py | ||
cache_control_check.py | ||
example_presidio_ad_hoc_recognizer.json | ||
max_budget_limiter.py | ||
parallel_request_limiter.py | ||
presidio_pii_masking.py |