117 commits

Author	SHA1	Message	Date
Ishaan Jaff	11cd1ec6cf	test - atext_completion + caching	2024-04-12 12:32:21 -07:00
Ishaan Jaff	8bc02b34c2	test -base64 cache hits	2024-04-10 16:46:56 -07:00
Krrish Dholakia	48bfc45cb0	fix(utils.py): fix reordering of items for cached embeddings ... ensures cached embedding item is returned in correct order	2024-04-08 12:18:24 -07:00
Krrish Dholakia	2472311a3f	test(test_caching.py): skip test - aws suspended account ... will need to recreate these objects on a new aws account	2024-04-04 15:07:19 -07:00
Krish Dholakia	eb859f5dba	Merge pull request #2692 from BerriAI/litellm_streaming_fixes ... fix(utils.py): ensure last chunk is always empty delta w/ finish reason	2024-03-25 21:57:04 -07:00
Krrish Dholakia	643fd6ac96	test(test_caching.py): fix test_redis_cache_acompletion_stream	2024-03-25 21:36:47 -07:00
Ishaan Jaff	07fe08d8b5	(test) no cache hit	2024-03-25 18:56:36 -07:00
Ishaan Jaff	3fcab0137a	(test) batch writing to cache	2024-03-25 18:04:04 -07:00
Krrish Dholakia	591a0a376e	fix(caching.py): support default ttl for caching	2024-03-25 13:40:17 -07:00
Krrish Dholakia	03acc07380	fix(caching.py): pass redis kwargs to connection pool init	2024-03-18 08:21:36 -07:00
Krrish Dholakia	3072137739	test(test_caching.py): fix async tests	2024-03-15 18:09:25 -07:00
Krrish Dholakia	4885bff9e3	test: reintegrate s3 testing	2024-03-07 08:56:59 -08:00
Krish Dholakia	06bde2b8c0	Merge pull request #2379 from BerriAI/litellm_s3_bucket_folder_path ... fix(caching.py): add s3 path as a top-level param	2024-03-06 19:35:46 -08:00
Krrish Dholakia	726dad5756	fix(caching.py): add s3 path as a top-level param	2024-03-06 18:07:28 -08:00
Krrish Dholakia	8a4a14cc95	test(test_caching.py): fix test to check on id	2024-03-05 21:12:50 -08:00
Krrish Dholakia	478307d4cf	fix(bedrock.py): support anthropic messages api on bedrock (claude-3)	2024-03-04 17:15:47 -08:00
ishaan-jaff	957da9fbeb	(test) our AWS account is Suspended	2024-02-28 18:32:27 -08:00
Krrish Dholakia	4c951d20bc	test: removing aws tests - account suspended - pending their approval	2024-02-28 13:46:20 -08:00
Krrish Dholakia	a042092faa	test: removing bedrock claude-v1 testing - bedrock removed this	2024-02-28 11:08:17 -08:00
ishaan-jaff	8a615cd125	(test) async s3 cache	2024-02-08 10:04:10 -08:00
ishaan-jaff	79c225a60f	(ci/cd) run again	2024-02-06 13:26:48 -08:00
ishaan-jaff	8175fb4deb	(fix) mark semantic caching as beta test	2024-02-06 11:04:19 -08:00
ishaan-jaff	1afdf5cf36	(fix) semantic caching	2024-02-06 10:55:15 -08:00
ishaan-jaff	c8a83bb745	(fix) test-semantic caching	2024-02-06 10:39:44 -08:00
ishaan-jaff	a125ffe190	(test) async semantic cache	2024-02-06 08:14:54 -08:00
ishaan-jaff	81f8ac00b2	(test) semantic caching	2024-02-05 18:22:50 -08:00
ishaan-jaff	cf4bd1cf4e	(test) semantic cache	2024-02-05 17:58:32 -08:00
ishaan-jaff	d4a799a3ca	(feat )add semantic cache	2024-02-05 12:28:21 -08:00
Krish Dholakia	9ab59045a3	Merge branch 'main' into litellm_embedding_caching_updates	2024-02-03 18:08:47 -08:00
Krrish Dholakia	93e8a9ff91	test(test_caching.py): fix test to check id	2024-02-02 18:01:43 -08:00
ishaan-jaff	336c8af01e	(test) caching, swap out unstable model	2024-01-29 11:00:15 -08:00
Krrish Dholakia	8d4749b94a	test(test_caching.py): fix cache test if embedding call is fast	2024-01-26 23:00:59 -08:00
ishaan-jaff	ccbc47122c	(fix) test caching	2024-01-19 20:45:10 -08:00
Krrish Dholakia	40c952f7c2	fix(caching.py): fix async in-memory caching	2024-01-13 15:33:57 +05:30
Krrish Dholakia	7f83cca62c	fix(caching.py): return updated kwargs from get_cache helper function	2024-01-13 15:04:34 +05:30
Krrish Dholakia	007870390d	fix: support async redis caching	2024-01-12 21:46:41 +05:30
Krrish Dholakia	f8d1720690	fix(utils.py): bug fixes	2024-01-11 19:02:17 +05:30
Krrish Dholakia	df9df7b040	fix: n	2024-01-11 16:30:05 +05:30
ishaan-jaff	edac4130bb	(fix) s3 + os.environ/ cache test	2024-01-06 16:33:29 +05:30
ishaan-jaff	f999b63d05	(test) using os.environ/ on cache + proxy	2024-01-06 15:54:50 +05:30
ishaan-jaff	76b2db4492	(ci/cd) run test again	2024-01-05 16:40:56 +05:30
ishaan-jaff	4679c7b99a	(fix) caching use same "created" in response_object	2024-01-05 16:03:56 +05:30
ishaan-jaff	d1865591aa	(fix) test caching- use azure, instead of bedrock	2024-01-05 10:51:56 +05:30
Krrish Dholakia	b0827a87b2	fix(caching.py): support s-maxage param for cache controls	2024-01-04 11:41:23 +05:30
ishaan-jaff	d14a41863f	(test) s3 cache with setting s3_bucket_name	2024-01-03 15:42:23 +05:30
ishaan-jaff	fea0a933ae	(test) use s3 buckets cache	2024-01-03 15:13:43 +05:30
Krrish Dholakia	8cee267a5b	fix(caching.py): support ttl, s-max-age, and no-cache cache controls ... https://github.com/BerriAI/litellm/issues/1306	2024-01-03 12:42:43 +05:30
ishaan-jaff	e35f17ca3c	(test) caching - context managers	2023-12-30 19:33:47 +05:30
Krrish Dholakia	1e07f0fce8	fix(caching.py): hash the cache key to prevent key too long errors	2023-12-29 15:03:33 +05:30
Krrish Dholakia	f0b6b9dce2	fix(main.py): support ttl being set for completion, embedding, image generation calls	2023-12-26 17:22:40 +05:30