9 commits

Author	SHA1	Message	Date
Krrish Dholakia	3560f0ef2c	refactor: move all testing to top-level of repo ... Closes https://github.com/BerriAI/litellm/issues/486	2024-09-28 21:08:14 -07:00
Krrish Dholakia	5e85a5b208	fix(test_scheduler.py): simplify scheduler testing. fix race condition	2024-06-01 18:57:47 -07:00
Krrish Dholakia	2245ee1cc8	test(test_scheduler.py): fix testing	2024-06-01 16:21:02 -07:00
Krrish Dholakia	7715267989	fix(router.py): simplify scheduler ... move the scheduler poll queuing logic into the router class, making it easier to use	2024-06-01 16:09:57 -07:00
Krrish Dholakia	d7160eb3ea	fix(test_scheduler.py): fix test	2024-06-01 15:11:13 -07:00
Krrish Dholakia	c6559753c7	fix(test_scheduler.py): fix test	2024-06-01 11:30:26 -07:00
Krrish Dholakia	e49325b234	fix(router.py): fix cooldown logic for usage-based-routing-v2 pre-call-checks	2024-05-31 21:32:01 -07:00
Krrish Dholakia	f8d4be710e	docs(scheduler.md): add request prioritization to docs	2024-05-31 19:35:47 -07:00
Krrish Dholakia	79287a7584	feat(scheduler.py): add request prioritization scheduler ... allow user to set priority for a request	2024-05-31 18:51:13 -07:00