16 commits

Author	SHA1	Message	Date
Ishaan Jaff	97c82225b1	test fix - test_acompletion_caching_on_router	2024-06-04 07:55:53 -07:00
Krrish Dholakia	bfde1357dd	test(test_router_caching.py): fix test	2024-05-21 18:05:05 -07:00
sumanth	71e0294485	addressed comments	2024-05-14 10:05:19 +05:30
sumanth	3bc6b5d119	usage-based-routing-ttl-on-cache	2024-05-03 10:50:45 +05:30
Krrish Dholakia	1e53c06064	test(test_router_caching.py): remove unstable test ... test would fail due to timing issues	2024-04-29 18:37:31 -07:00
sumanth	89e655c79e	usage based routing RPM count fix	2024-04-30 00:29:38 +05:30
Krrish Dholakia	41c81f6335	fix: fix tests	2024-04-19 16:21:15 -07:00
Krrish Dholakia	08cf77623b	fix(caching.py): remove url parsing logic - causing redis ssl connections to fail ... this reverts a change that was causing redis url w/ ssl to fail. this also adds unit testing for this sc enario, to prevent future regressions	2024-04-19 14:01:13 -07:00
Krrish Dholakia	a89d0db625	test(test_router_caching.py): add more verbose logs	2024-03-07 08:37:00 -08:00
Krrish Dholakia	dff4c172d0	refactor(test_router_caching.py): move tpm/rpm routing tests to separate file	2024-01-02 11:10:11 +05:30
Krrish Dholakia	2fc264ca04	fix(router.py): fix int logic	2023-12-29 20:41:56 +05:30
Krrish Dholakia	f0b6b9dce2	fix(main.py): support ttl being set for completion, embedding, image generation calls	2023-12-26 17:22:40 +05:30
Krrish Dholakia	4905929de3	refactor: add black formatting	2023-12-25 14:11:20 +05:30
sumanth	96e23daf4d	fix	2023-12-19 13:15:48 +05:30
Krrish Dholakia	84ad9f441e	feat(router.py): support caching groups	2023-12-15 21:45:51 -08:00
Krrish Dholakia	5fe5149070	refactor(test_router_caching.py): add tests for router caching	2023-12-15 20:38:51 -08:00