16 commits

Author	SHA1	Message	Date
seva	5e1e8820b4	Router & Caching fixes: ... - Add optional TTL to Cache parameters - Fix tpm and rpm caching in Router	2023-10-30 13:29:35 +01:00
ishaan-jaff	5bd1b3968e	(feat) Redis caching print exception statements when it fails	2023-10-25 11:29:48 -07:00
Krrish Dholakia	e35562d188	fix(router.py): completing redis support work for router	2023-10-18 12:13:00 -07:00
ishaan-jaff	69065e9864	(feat) add docstring for caching	2023-10-14 16:08:42 -07:00
ishaan-jaff	6f6d5fae3a	add hosted api.litellm.ai for caching	2023-10-02 10:27:18 -07:00
Krrish Dholakia	bdc6ef1df8	add contributor message to code	2023-09-25 10:00:10 -07:00
ishaan-jaff	0ab62f13e8	caching updates	2023-09-08 18:06:47 -07:00
ishaan-jaff	8f7f9ca932	fix redis caching	2023-08-28 22:10:15 -07:00
ishaan-jaff	3726270d95	with new caching	2023-08-28 21:57:00 -07:00
ishaan-jaff	fbef73d043	add streaming_caching support	2023-08-28 19:17:53 -07:00
ishaan-jaff	8af6d967eb	working write to cache with streaming	2023-08-28 18:46:26 -07:00
ishaan-jaff	1799f1bfe9	cache improvements	2023-08-28 14:44:42 -07:00
ishaan-jaff	43fea52d7c	fix import	2023-08-28 14:21:25 -07:00
ishaan-jaff	ecec028f38	fix redis import	2023-08-28 14:13:03 -07:00
ishaan-jaff	71ff0c69ab	working with embeddings	2023-08-28 14:07:51 -07:00
ishaan-jaff	8b43917792	v0 of caching	2023-08-28 13:11:56 -07:00