4 commits

Author	SHA1	Message	Date
Krrish Dholakia	b590e6607c	feat(scheduler.py): support redis caching for req. prioritization ... enables req. prioritization to work across multiple instances of litellm	2024-06-06 14:19:21 -07:00
Krrish Dholakia	5e85a5b208	fix(test_scheduler.py): simplify scheduler testing. fix race condition	2024-06-01 18:57:47 -07:00
Krrish Dholakia	7715267989	fix(router.py): simplify scheduler ... move the scheduler poll queuing logic into the router class, making it easier to use	2024-06-01 16:09:57 -07:00
Krrish Dholakia	f8d4be710e	docs(scheduler.md): add request prioritization to docs	2024-05-31 19:35:47 -07:00

Renamed from litellm/proxy/queue/scheduler.py (Browse further)