122 commits

Author	SHA1	Message	Date
Krrish Dholakia	04014c752b	fix(utils.py): fix 'no-cache': true when caching is turned on	2024-04-23 12:58:30 -07:00
Krish Dholakia	a9dc93e860	Merge branch 'main' into litellm_ssl_caching_fix	2024-04-19 17:20:27 -07:00
Krrish Dholakia	be0a30e196	test(test_caching.py): add sleep	2024-04-19 17:02:15 -07:00
Krrish Dholakia	5da934099f	fix(caching.py): dual cache async_batch_get_cache fix + testing ... this fixes a bug in usage-based-routing-v2 which was caused b/c of how the result was being returned from dual cache async_batch_get_cache. it also adds unit testing for that function (and it's sync equivalent)	2024-04-19 15:03:25 -07:00
Ishaan Jaff	966356721b	fix - test caching atext_completion	2024-04-12 20:37:56 -07:00
Ishaan Jaff	204573f3f2	test - atext_completion + caching	2024-04-12 12:32:21 -07:00
Ishaan Jaff	4058327b43	test -base64 cache hits	2024-04-10 16:46:56 -07:00
Krrish Dholakia	075c96a408	fix(utils.py): fix reordering of items for cached embeddings ... ensures cached embedding item is returned in correct order	2024-04-08 12:18:24 -07:00
Krrish Dholakia	9b8e1fe052	test(test_caching.py): skip test - aws suspended account ... will need to recreate these objects on a new aws account	2024-04-04 15:07:19 -07:00
Krish Dholakia	d620d94134	Merge pull request #2692 from BerriAI/litellm_streaming_fixes ... fix(utils.py): ensure last chunk is always empty delta w/ finish reason	2024-03-25 21:57:04 -07:00
Krrish Dholakia	eda65a25e3	test(test_caching.py): fix test_redis_cache_acompletion_stream	2024-03-25 21:36:47 -07:00
Ishaan Jaff	dd6dedd0aa	(test) no cache hit	2024-03-25 18:56:36 -07:00
Ishaan Jaff	a0601723e5	(test) batch writing to cache	2024-03-25 18:04:04 -07:00
Krrish Dholakia	fec92767bb	fix(caching.py): support default ttl for caching	2024-03-25 13:40:17 -07:00
Krrish Dholakia	dfcf16eb4d	fix(caching.py): pass redis kwargs to connection pool init	2024-03-18 08:21:36 -07:00
Krrish Dholakia	45582d2fa5	test(test_caching.py): fix async tests	2024-03-15 18:09:25 -07:00
Krrish Dholakia	807bf854c3	test: reintegrate s3 testing	2024-03-07 08:56:59 -08:00
Krish Dholakia	d0dec7fc71	Merge pull request #2379 from BerriAI/litellm_s3_bucket_folder_path ... fix(caching.py): add s3 path as a top-level param	2024-03-06 19:35:46 -08:00
Krrish Dholakia	12d663d693	fix(caching.py): add s3 path as a top-level param	2024-03-06 18:07:28 -08:00
Krrish Dholakia	ee2fc1e5e8	test(test_caching.py): fix test to check on id	2024-03-05 21:12:50 -08:00
Krrish Dholakia	dad65ca602	fix(bedrock.py): support anthropic messages api on bedrock (claude-3)	2024-03-04 17:15:47 -08:00
ishaan-jaff	f9bc8e2a76	(test) our AWS account is Suspended	2024-02-28 18:32:27 -08:00
Krrish Dholakia	129e84f0c5	test: removing aws tests - account suspended - pending their approval	2024-02-28 13:46:20 -08:00
Krrish Dholakia	0166c2f54b	test: removing bedrock claude-v1 testing - bedrock removed this	2024-02-28 11:08:17 -08:00
ishaan-jaff	d211693ae9	(test) async s3 cache	2024-02-08 10:04:10 -08:00
ishaan-jaff	be53cbc45f	(ci/cd) run again	2024-02-06 13:26:48 -08:00
ishaan-jaff	01f2ae4e54	(fix) mark semantic caching as beta test	2024-02-06 11:04:19 -08:00
ishaan-jaff	2df1872e5d	(fix) semantic caching	2024-02-06 10:55:15 -08:00
ishaan-jaff	167b60ace7	(fix) test-semantic caching	2024-02-06 10:39:44 -08:00
ishaan-jaff	33f5ab8ba5	(test) async semantic cache	2024-02-06 08:14:54 -08:00
ishaan-jaff	6c6db6f1e6	(test) semantic caching	2024-02-05 18:22:50 -08:00
ishaan-jaff	3ee691b9d8	(test) semantic cache	2024-02-05 17:58:32 -08:00
ishaan-jaff	1689d5790f	(feat )add semantic cache	2024-02-05 12:28:21 -08:00
Krish Dholakia	45cbb3cf3d	Merge branch 'main' into litellm_embedding_caching_updates	2024-02-03 18:08:47 -08:00
Krrish Dholakia	aee54eb684	test(test_caching.py): fix test to check id	2024-02-02 18:01:43 -08:00
ishaan-jaff	3836ba4e65	(test) caching, swap out unstable model	2024-01-29 11:00:15 -08:00
Krrish Dholakia	c07d471272	test(test_caching.py): fix cache test if embedding call is fast	2024-01-26 23:00:59 -08:00
ishaan-jaff	d84e4680db	(fix) test caching	2024-01-19 20:45:10 -08:00
Krrish Dholakia	79cc739b53	fix(caching.py): fix async in-memory caching	2024-01-13 15:33:57 +05:30
Krrish Dholakia	cdadac1649	fix(caching.py): return updated kwargs from get_cache helper function	2024-01-13 15:04:34 +05:30
Krrish Dholakia	813fb19620	fix: support async redis caching	2024-01-12 21:46:41 +05:30
Krrish Dholakia	4ed9f2b712	fix(utils.py): bug fixes	2024-01-11 19:02:17 +05:30
Krrish Dholakia	1472dc3f54	fix: n	2024-01-11 16:30:05 +05:30
ishaan-jaff	ca2c3a0a84	(fix) s3 + os.environ/ cache test	2024-01-06 16:33:29 +05:30
ishaan-jaff	87aa3c2985	(test) using os.environ/ on cache + proxy	2024-01-06 15:54:50 +05:30
ishaan-jaff	accbaebbf0	(ci/cd) run test again	2024-01-05 16:40:56 +05:30
ishaan-jaff	eb8dba100d	(fix) caching use same "created" in response_object	2024-01-05 16:03:56 +05:30
ishaan-jaff	50313b5bfc	(fix) test caching- use azure, instead of bedrock	2024-01-05 10:51:56 +05:30
Krrish Dholakia	a5bac8ae15	fix(caching.py): support s-maxage param for cache controls	2024-01-04 11:41:23 +05:30
ishaan-jaff	70d0a26419	(test) s3 cache with setting s3_bucket_name	2024-01-03 15:42:23 +05:30