Commit graph

8 commits

Author SHA1 Message Date
Krrish Dholakia
d2bd83bdbe fix(test_scheduler.py): simplify scheduler testing. fix race condition 2024-06-01 18:57:47 -07:00
Krrish Dholakia
814329c6d7 test(test_scheduler.py): fix testing 2024-06-01 16:21:02 -07:00
Krrish Dholakia
4ffbd80584 fix(router.py): simplify scheduler
move the scheduler poll queuing logic into the router class, making it easier to use
2024-06-01 16:09:57 -07:00
Krrish Dholakia
481516df2e fix(test_scheduler.py): fix test 2024-06-01 15:11:13 -07:00
Krrish Dholakia
ca82b82d4b fix(test_scheduler.py): fix test 2024-06-01 11:30:26 -07:00
Krrish Dholakia
6221fabecf fix(router.py): fix cooldown logic for usage-based-routing-v2 pre-call-checks 2024-05-31 21:32:01 -07:00
Krrish Dholakia
27c2753aaf docs(scheduler.md): add request prioritization to docs 2024-05-31 19:35:47 -07:00
Krrish Dholakia
8ff137bce3 feat(scheduler.py): add request prioritization scheduler
allow user to set priority for a request
2024-05-31 18:51:13 -07:00