12 commits

Author	SHA1	Message	Date
Ishaan Jaff	4eaeec2a2d	feat - set allowed fails policy	2024-06-01 17:39:44 -07:00
Krrish Dholakia	183dd81087	fix(router.py): fix should_retry logic	2024-05-31 23:27:43 -07:00
Ishaan Jaff	beac60ed12	test - router retry policy	2024-05-11 19:58:17 -07:00
Ishaan Jaff	32e445c59d	fix - unit tests for router retries	2024-05-11 19:10:33 -07:00
Ishaan Jaff	4e844d7438	test - unit tests for time to sleep when there are rate limit errors	2024-05-11 18:13:28 -07:00
Ishaan Jaff	ed8a25c630	tests - unit test router retry logic	2024-05-11 17:31:01 -07:00
Krrish Dholakia	e95be13f10	fix(router.py): fix router retry policy logic	2024-05-04 23:02:50 -07:00
Ishaan Jaff	f09da3f14c	test - test setting retry policies per model groups	2024-05-04 20:40:56 -07:00
Ishaan Jaff	495d3a9646	router set dynamic retry policies	2024-05-04 18:13:43 -07:00
Ishaan Jaff	8d128a4b91	test - router retry policy	2024-05-04 17:30:30 -07:00
Ishaan Jaff	9e4e467039	test router - retry policy	2024-05-04 17:06:34 -07:00
Krrish Dholakia	1baad80c7d	fix(router.py): cooldown deployments, for 401 errors	2024-04-30 17:54:00 -07:00