14 commits

Author	SHA1	Message	Date
sumanth	4bbd9c866c	addressed comments	2024-05-14 10:05:19 +05:30
sumanth	dce55bab76	usage-based-routing-ttl-on-cache	2024-05-03 10:50:45 +05:30
Krrish Dholakia	dff9f37e24	test(test_router_caching.py): remove unstable test ... test would fail due to timing issues	2024-04-29 18:37:31 -07:00
sumanth	480a77996f	usage based routing RPM count fix	2024-04-30 00:29:38 +05:30
Krrish Dholakia	1a031e0046	fix: fix tests	2024-04-19 16:21:15 -07:00
Krrish Dholakia	7065e4ee12	fix(caching.py): remove url parsing logic - causing redis ssl connections to fail ... this reverts a change that was causing redis url w/ ssl to fail. this also adds unit testing for this sc enario, to prevent future regressions	2024-04-19 14:01:13 -07:00
Krrish Dholakia	6f7d3080af	test(test_router_caching.py): add more verbose logs	2024-03-07 08:37:00 -08:00
Krrish Dholakia	4f988058a1	refactor(test_router_caching.py): move tpm/rpm routing tests to separate file	2024-01-02 11:10:11 +05:30
Krrish Dholakia	1933d44cbd	fix(router.py): fix int logic	2023-12-29 20:41:56 +05:30
Krrish Dholakia	b25a8c3b42	fix(main.py): support ttl being set for completion, embedding, image generation calls	2023-12-26 17:22:40 +05:30
Krrish Dholakia	79978c44ba	refactor: add black formatting	2023-12-25 14:11:20 +05:30
sumanth	64dfd0d9a6	fix	2023-12-19 13:15:48 +05:30
Krrish Dholakia	e76ed6be7d	feat(router.py): support caching groups	2023-12-15 21:45:51 -08:00
Krrish Dholakia	0a20b92c12	refactor(test_router_caching.py): add tests for router caching	2023-12-15 20:38:51 -08:00