70 commits

Author	SHA1	Message	Date
ishaan-jaff	e35f17ca3c	(test) caching - context managers	2023-12-30 19:33:47 +05:30
Krrish Dholakia	1e07f0fce8	fix(caching.py): hash the cache key to prevent key too long errors	2023-12-29 15:03:33 +05:30
Krrish Dholakia	f0b6b9dce2	fix(main.py): support ttl being set for completion, embedding, image generation calls	2023-12-26 17:22:40 +05:30
Krrish Dholakia	4905929de3	refactor: add black formatting	2023-12-25 14:11:20 +05:30
ishaan-jaff	9a35f347ab	(test) - caching - override when caching = False	2023-12-14 16:20:29 +05:30
ishaan-jaff	008df34ddc	(feat) use async_cache for acompletion/aembedding	2023-12-14 16:04:45 +05:30
ishaan-jaff	ee6b936377	(test) caching - get cache key for embedding	2023-12-14 14:08:58 +05:30
Krrish Dholakia	6cb4ef5659	test(test_caching.py): reset cache values at the end of test	2023-12-11 18:10:53 -08:00
ishaan-jaff	070ca682cf	bump: version 1.12.3 → 1.12.4	2023-12-11 09:19:07 -08:00
ishaan-jaff	4b26c550c5	(test) bedrock caching + stream	2023-12-11 08:43:50 -08:00
ishaan-jaff	bf1044444c	(test) caching	2023-12-09 16:58:56 -08:00
ishaan-jaff	8a52e17300	(test) caching - get cache key	2023-12-09 16:42:59 -08:00
ishaan-jaff	6f8a35d539	(test) cache async + stream test	2023-12-09 14:22:10 -08:00
ishaan-jaff	8cbd6010c8	(test) redis caching init calbacks to be empty	2023-12-09 11:32:35 -08:00
ishaan-jaff	d7265a84c9	(test) caching reset success_callback	2023-12-08 19:10:35 -08:00
ishaan-jaff	fcc9f3c504	(ci/cd) q up another test	2023-12-08 18:55:18 -08:00
ishaan-jaff	b8e9e1edc9	(fix) test caching	2023-12-08 13:15:00 -08:00
ishaan-jaff	fa8ba9dd4e	(test) cache + streaming	2023-12-08 11:50:37 -08:00
Krrish Dholakia	68ca2a28d4	docs: adds redis url to router + proxy docs	2023-12-05 15:08:00 -08:00
ishaan-jaff	9ba17657ad	(feat) init redis cache with **kwargs	2023-12-04 20:50:08 -08:00
Krrish Dholakia	2eb7386095	fix(utils.py): fix embedding response object conversion	2023-11-25 14:25:06 -08:00
ishaan-jaff	0c210cc96c	(test) caching	2023-11-23 21:23:41 -08:00
ishaan-jaff	b6f8dbbc0e	(test) caching	2023-11-23 18:17:12 -08:00
ishaan-jaff	fbd2ab4c71	(test) caching ensure we always test add/get caching redis	2023-11-23 08:27:44 -08:00
Krrish Dholakia	b0801f61e6	test(test_caching.py): cleaning up tests	2023-11-22 13:43:48 -08:00
ishaan-jaff	3945bfadb7	(chore) remove bloat caching tests	2023-11-15 17:58:58 -08:00
Krrish Dholakia	aa8ca781ba	test(test_completion.py): cleanup tests	2023-11-13 11:23:38 -08:00
Krrish Dholakia	40edb546dc	test(test_streaming.py): set cache to none	2023-11-10 15:04:01 -08:00
Krrish Dholakia	7769abe432	fix(test_caching.py): flaky test	2023-11-09 18:54:21 -08:00
ishaan-jaff	317c290b69	(test) add num retries to caching testing	2023-11-01 11:42:40 -07:00
Krrish Dholakia	6ead8d8c18	fix(caching.py): fixing pr issues	2023-10-31 18:32:40 -07:00
seva	f4d65cf23d	Add tests for cache with TTL	2023-10-30 13:35:55 +01:00
Krrish Dholakia	3ec103f712	test(test_caching.py): reset to none	2023-10-24 15:02:20 -07:00
Krrish Dholakia	1eca893d2f	test(test_async_fn.py): adding additional logging for tests	2023-10-24 12:54:18 -07:00
Krrish Dholakia	f12dc5df21	fix(vertex_ai.py): fix output parsing	2023-10-24 12:08:22 -07:00
ishaan-jaff	2a351eab8d	(test) retry testing	2023-10-20 17:42:48 -07:00
ishaan-jaff	d8ab3ec2b9	(test) caching tests	2023-10-20 15:00:40 -07:00
ishaan-jaff	5e5c314bec	(test) fix azure test	2023-10-13 22:18:53 -07:00
ishaan-jaff	5d2881a2ce	(tests) add	2023-10-13 21:16:41 -07:00
ishaan-jaff	606b787842	update caching tests	2023-10-02 11:48:35 -07:00
ishaan-jaff	49f65b7eb8	add litellm hosted cache test	2023-10-02 10:28:19 -07:00
ishaan-jaff	578ad50547	update test_caching to use mock redis	2023-09-11 10:36:17 -07:00
ishaan-jaff	ba70ad766d	fix redis caching test	2023-09-08 20:58:44 -07:00
ishaan-jaff	8180ba273b	updating caching tests	2023-09-08 20:15:15 -07:00
ishaan-jaff	0ab62f13e8	caching updates	2023-09-08 18:06:47 -07:00
Krrish Dholakia	4bcfa71e11	commenting out flaky circle ci test	2023-09-06 12:07:47 -07:00
ishaan-jaff	46857577fa	[temp] remove cache streaming flaky test	2023-09-04 09:50:45 -07:00
Krrish Dholakia	0e445e6e69	fix streaming cache logic	2023-09-01 16:56:07 -07:00
ishaan-jaff	cd9b9abde3	updates to caching tutorial	2023-08-30 11:31:10 -07:00
ishaan-jaff	8f7f9ca932	fix redis caching	2023-08-28 22:10:15 -07:00