152 commits

Author	SHA1	Message	Date
Krrish Dholakia	0940fadca3	docs: adds redis url to router + proxy docs	2023-12-05 15:08:00 -08:00
ishaan-jaff	b95d3acb12	(feat) init redis cache with **kwargs	2023-12-04 20:50:08 -08:00
Krrish Dholakia	e6a28881a2	fix(utils.py): fix embedding response object conversion	2023-11-25 14:25:06 -08:00
ishaan-jaff	375e7e8e6e	(test) caching	2023-11-23 21:23:41 -08:00
ishaan-jaff	8cad5e0c44	(test) caching	2023-11-23 18:17:12 -08:00
ishaan-jaff	9dee7df307	(test) caching ensure we always test add/get caching redis	2023-11-23 08:27:44 -08:00
Krrish Dholakia	bd87e30058	test(test_caching.py): cleaning up tests	2023-11-22 13:43:48 -08:00
ishaan-jaff	b397719709	(chore) remove bloat caching tests	2023-11-15 17:58:58 -08:00
Krrish Dholakia	d8121737d6	test(test_completion.py): cleanup tests	2023-11-13 11:23:38 -08:00
Krrish Dholakia	4c103592e3	test(test_streaming.py): set cache to none	2023-11-10 15:04:01 -08:00
Krrish Dholakia	b9d343e634	fix(test_caching.py): flaky test	2023-11-09 18:54:21 -08:00
ishaan-jaff	1da2704690	(test) add num retries to caching testing	2023-11-01 11:42:40 -07:00
Krrish Dholakia	53cb0f3974	fix(caching.py): fixing pr issues	2023-10-31 18:32:40 -07:00
seva	bac6f41eb7	Add tests for cache with TTL	2023-10-30 13:35:55 +01:00
Krrish Dholakia	3e8af9f807	test(test_caching.py): reset to none	2023-10-24 15:02:20 -07:00
Krrish Dholakia	e55b20b1e4	test(test_async_fn.py): adding additional logging for tests	2023-10-24 12:54:18 -07:00
Krrish Dholakia	98c25b08cd	fix(vertex_ai.py): fix output parsing	2023-10-24 12:08:22 -07:00
ishaan-jaff	ab2d078c88	(test) retry testing	2023-10-20 17:42:48 -07:00
ishaan-jaff	94c1b517ba	(test) caching tests	2023-10-20 15:00:40 -07:00
ishaan-jaff	2d00738386	(test) fix azure test	2023-10-13 22:18:53 -07:00
ishaan-jaff	0edf4d6ea5	(tests) add	2023-10-13 21:16:41 -07:00
ishaan-jaff	715e9e5e08	update caching tests	2023-10-02 11:48:35 -07:00
ishaan-jaff	915afd2157	add litellm hosted cache test	2023-10-02 10:28:19 -07:00
ishaan-jaff	1855315b59	update test_caching to use mock redis	2023-09-11 10:36:17 -07:00
ishaan-jaff	a86786dea5	fix redis caching test	2023-09-08 20:58:44 -07:00
ishaan-jaff	028fed5bf2	updating caching tests	2023-09-08 20:15:15 -07:00
ishaan-jaff	da87721a20	caching updates	2023-09-08 18:06:47 -07:00
Krrish Dholakia	e24e60cd74	commenting out flaky circle ci test	2023-09-06 12:07:47 -07:00
ishaan-jaff	66ca76928e	[temp] remove cache streaming flaky test	2023-09-04 09:50:45 -07:00
Krrish Dholakia	5cd84b709e	fix streaming cache logic	2023-09-01 16:56:07 -07:00
ishaan-jaff	27377d70ce	updates to caching tutorial	2023-08-30 11:31:10 -07:00
ishaan-jaff	ee68836684	fix redis caching	2023-08-28 22:10:15 -07:00
ishaan-jaff	309e5e7046	with new caching	2023-08-28 21:57:00 -07:00
ishaan-jaff	d26df210f6	add streaming_caching support	2023-08-28 19:17:53 -07:00
ishaan-jaff	8454e2d436	working write to cache with streaming	2023-08-28 18:46:26 -07:00
ishaan-jaff	7274fa7729	test updates with streaming	2023-08-28 15:32:53 -07:00
ishaan-jaff	fe1acf759c	fix caching	2023-08-28 14:53:41 -07:00
ishaan-jaff	d0fe961e59	cache improvements	2023-08-28 14:44:42 -07:00
ishaan-jaff	c93f5e3def	working with embeddings	2023-08-28 14:07:51 -07:00
ishaan-jaff	db69c3660a	linting fix	2023-08-28 13:14:58 -07:00
ishaan-jaff	6fa2e578d4	v0 of caching	2023-08-28 13:11:56 -07:00
ishaan-jaff	a69b7ffcfa	formatting improvements	2023-08-28 09:20:50 -07:00
ishaan-jaff	467009076b	fix caching	2023-08-26 21:05:35 -07:00
ishaan-jaff	f29d2ecd3b	move caching	2023-08-26 16:16:58 -07:00
ishaan-jaff	c153550c59	add litellm caching	2023-08-26 16:08:48 -07:00
ishaan-jaff	be16250840	failing gpt cache test	2023-08-26 15:43:00 -07:00
ishaan-jaff	c67e59cd10	formatting fixes	2023-08-22 15:07:07 -07:00
ishaan-jaff	e46aa470b4	caching with model names	2023-08-18 13:48:32 -07:00
ishaan-jaff	2c7ffb7c75	add linting	2023-08-18 11:05:05 -07:00
ishaan-jaff	701dd83853	fixes to caching, testing caching	2023-08-17 10:41:14 -07:00