Commit graph

19 commits

Author SHA1 Message Date
Ishaan Jaff
cae9245b33 fix router retries tests 2024-08-20 13:02:24 -07:00
Ishaan Jaff
e28b240a5b fix don't retry errors when no healthy deployments available 2024-08-20 12:17:05 -07:00
Ishaan Jaff
19c3a82d1b test + never retry on 404 errors 2024-08-20 11:59:43 -07:00
Krrish Dholakia
5f99938cb8 test(test_amazing_vertex_completion.py): add retries for 'Content has no parts.' error in vertex test 2024-06-03 14:06:36 -07:00
Krrish Dholakia
a019fd05e3 fix(router.py): fix should_retry logic for authentication errors 2024-06-03 13:12:00 -07:00
Ishaan Jaff
054456c50e
Merge pull request #3963 from BerriAI/litellm_set_allowed_fail_policy
[FEAT]- set custom AllowedFailsPolicy on litellm.Router
2024-06-01 17:57:11 -07:00
Ishaan Jaff
4eaeec2a2d feat - set allowed fails policy 2024-06-01 17:39:44 -07:00
Ishaan Jaff
3caa9dfec6 add test 2024-06-01 17:03:53 -07:00
Krrish Dholakia
183dd81087 fix(router.py): fix should_retry logic 2024-05-31 23:27:43 -07:00
Ishaan Jaff
beac60ed12 test - router retry policy 2024-05-11 19:58:17 -07:00
Ishaan Jaff
32e445c59d fix - unit tests for router retries 2024-05-11 19:10:33 -07:00
Ishaan Jaff
4e844d7438 test - unit tests for time to sleep when there are rate limit errors 2024-05-11 18:13:28 -07:00
Ishaan Jaff
ed8a25c630 tests - unit test router retry logic 2024-05-11 17:31:01 -07:00
Krrish Dholakia
e95be13f10 fix(router.py): fix router retry policy logic 2024-05-04 23:02:50 -07:00
Ishaan Jaff
f09da3f14c test - test setting retry policies per model groups 2024-05-04 20:40:56 -07:00
Ishaan Jaff
495d3a9646 router set dynamic retry policies 2024-05-04 18:13:43 -07:00
Ishaan Jaff
8d128a4b91 test - router retry policy 2024-05-04 17:30:30 -07:00
Ishaan Jaff
9e4e467039 test router - retry policy 2024-05-04 17:06:34 -07:00
Krrish Dholakia
1baad80c7d fix(router.py): cooldown deployments, for 401 errors 2024-04-30 17:54:00 -07:00