9 commits

Author	SHA1	Message	Date
Krrish Dholakia	ea96eebe85	refactor: move all testing to top-level of repo ... Closes https://github.com/BerriAI/litellm/issues/486	2024-09-28 21:08:14 -07:00
Krrish Dholakia	d2bd83bdbe	fix(test_scheduler.py): simplify scheduler testing. fix race condition	2024-06-01 18:57:47 -07:00
Krrish Dholakia	814329c6d7	test(test_scheduler.py): fix testing	2024-06-01 16:21:02 -07:00
Krrish Dholakia	4ffbd80584	fix(router.py): simplify scheduler ... move the scheduler poll queuing logic into the router class, making it easier to use	2024-06-01 16:09:57 -07:00
Krrish Dholakia	481516df2e	fix(test_scheduler.py): fix test	2024-06-01 15:11:13 -07:00
Krrish Dholakia	ca82b82d4b	fix(test_scheduler.py): fix test	2024-06-01 11:30:26 -07:00
Krrish Dholakia	6221fabecf	fix(router.py): fix cooldown logic for usage-based-routing-v2 pre-call-checks	2024-05-31 21:32:01 -07:00
Krrish Dholakia	27c2753aaf	docs(scheduler.md): add request prioritization to docs	2024-05-31 19:35:47 -07:00
Krrish Dholakia	8ff137bce3	feat(scheduler.py): add request prioritization scheduler ... allow user to set priority for a request	2024-05-31 18:51:13 -07:00