Commit graph

8 commits

Author SHA1 Message Date
Krrish Dholakia
5e85a5b208 fix(test_scheduler.py): simplify scheduler testing. fix race condition 2024-06-01 18:57:47 -07:00
Krrish Dholakia
2245ee1cc8 test(test_scheduler.py): fix testing 2024-06-01 16:21:02 -07:00
Krrish Dholakia
7715267989 fix(router.py): simplify scheduler
move the scheduler poll queuing logic into the router class, making it easier to use
2024-06-01 16:09:57 -07:00
Krrish Dholakia
d7160eb3ea fix(test_scheduler.py): fix test 2024-06-01 15:11:13 -07:00
Krrish Dholakia
c6559753c7 fix(test_scheduler.py): fix test 2024-06-01 11:30:26 -07:00
Krrish Dholakia
e49325b234 fix(router.py): fix cooldown logic for usage-based-routing-v2 pre-call-checks 2024-05-31 21:32:01 -07:00
Krrish Dholakia
f8d4be710e docs(scheduler.md): add request prioritization to docs 2024-05-31 19:35:47 -07:00
Krrish Dholakia
79287a7584 feat(scheduler.py): add request prioritization scheduler
allow user to set priority for a request
2024-05-31 18:51:13 -07:00