Commit graph

107 commits

Author SHA1 Message Date
Krrish Dholakia
3072137739 test(test_caching.py): fix async tests 2024-03-15 18:09:25 -07:00
Krrish Dholakia
4885bff9e3 test: reintegrate s3 testing 2024-03-07 08:56:59 -08:00
Krish Dholakia
06bde2b8c0
Merge pull request #2379 from BerriAI/litellm_s3_bucket_folder_path
fix(caching.py): add s3 path as a top-level param
2024-03-06 19:35:46 -08:00
Krrish Dholakia
726dad5756 fix(caching.py): add s3 path as a top-level param 2024-03-06 18:07:28 -08:00
Krrish Dholakia
8a4a14cc95 test(test_caching.py): fix test to check on id 2024-03-05 21:12:50 -08:00
Krrish Dholakia
478307d4cf fix(bedrock.py): support anthropic messages api on bedrock (claude-3) 2024-03-04 17:15:47 -08:00
ishaan-jaff
957da9fbeb (test) our AWS account is Suspended 2024-02-28 18:32:27 -08:00
Krrish Dholakia
4c951d20bc test: removing aws tests - account suspended - pending their approval 2024-02-28 13:46:20 -08:00
Krrish Dholakia
a042092faa test: removing bedrock claude-v1 testing - bedrock removed this 2024-02-28 11:08:17 -08:00
ishaan-jaff
8a615cd125 (test) async s3 cache 2024-02-08 10:04:10 -08:00
ishaan-jaff
79c225a60f (ci/cd) run again 2024-02-06 13:26:48 -08:00
ishaan-jaff
8175fb4deb (fix) mark semantic caching as beta test 2024-02-06 11:04:19 -08:00
ishaan-jaff
1afdf5cf36 (fix) semantic caching 2024-02-06 10:55:15 -08:00
ishaan-jaff
c8a83bb745 (fix) test-semantic caching 2024-02-06 10:39:44 -08:00
ishaan-jaff
a125ffe190 (test) async semantic cache 2024-02-06 08:14:54 -08:00
ishaan-jaff
81f8ac00b2 (test) semantic caching 2024-02-05 18:22:50 -08:00
ishaan-jaff
cf4bd1cf4e (test) semantic cache 2024-02-05 17:58:32 -08:00
ishaan-jaff
d4a799a3ca (feat )add semantic cache 2024-02-05 12:28:21 -08:00
Krish Dholakia
9ab59045a3
Merge branch 'main' into litellm_embedding_caching_updates 2024-02-03 18:08:47 -08:00
Krrish Dholakia
93e8a9ff91 test(test_caching.py): fix test to check id 2024-02-02 18:01:43 -08:00
ishaan-jaff
336c8af01e (test) caching, swap out unstable model 2024-01-29 11:00:15 -08:00
Krrish Dholakia
8d4749b94a test(test_caching.py): fix cache test if embedding call is fast 2024-01-26 23:00:59 -08:00
ishaan-jaff
ccbc47122c (fix) test caching 2024-01-19 20:45:10 -08:00
Krrish Dholakia
40c952f7c2 fix(caching.py): fix async in-memory caching 2024-01-13 15:33:57 +05:30
Krrish Dholakia
7f83cca62c fix(caching.py): return updated kwargs from get_cache helper function 2024-01-13 15:04:34 +05:30
Krrish Dholakia
007870390d fix: support async redis caching 2024-01-12 21:46:41 +05:30
Krrish Dholakia
f8d1720690 fix(utils.py): bug fixes 2024-01-11 19:02:17 +05:30
Krrish Dholakia
df9df7b040 fix: n 2024-01-11 16:30:05 +05:30
ishaan-jaff
edac4130bb (fix) s3 + os.environ/ cache test 2024-01-06 16:33:29 +05:30
ishaan-jaff
f999b63d05 (test) using os.environ/ on cache + proxy 2024-01-06 15:54:50 +05:30
ishaan-jaff
76b2db4492 (ci/cd) run test again 2024-01-05 16:40:56 +05:30
ishaan-jaff
4679c7b99a (fix) caching use same "created" in response_object 2024-01-05 16:03:56 +05:30
ishaan-jaff
d1865591aa (fix) test caching- use azure, instead of bedrock 2024-01-05 10:51:56 +05:30
Krrish Dholakia
b0827a87b2 fix(caching.py): support s-maxage param for cache controls 2024-01-04 11:41:23 +05:30
ishaan-jaff
d14a41863f (test) s3 cache with setting s3_bucket_name 2024-01-03 15:42:23 +05:30
ishaan-jaff
fea0a933ae (test) use s3 buckets cache 2024-01-03 15:13:43 +05:30
Krrish Dholakia
8cee267a5b fix(caching.py): support ttl, s-max-age, and no-cache cache controls
https://github.com/BerriAI/litellm/issues/1306
2024-01-03 12:42:43 +05:30
ishaan-jaff
e35f17ca3c (test) caching - context managers 2023-12-30 19:33:47 +05:30
Krrish Dholakia
1e07f0fce8 fix(caching.py): hash the cache key to prevent key too long errors 2023-12-29 15:03:33 +05:30
Krrish Dholakia
f0b6b9dce2 fix(main.py): support ttl being set for completion, embedding, image generation calls 2023-12-26 17:22:40 +05:30
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
ishaan-jaff
9a35f347ab (test) - caching - override when caching = False 2023-12-14 16:20:29 +05:30
ishaan-jaff
008df34ddc (feat) use async_cache for acompletion/aembedding 2023-12-14 16:04:45 +05:30
ishaan-jaff
ee6b936377 (test) caching - get cache key for embedding 2023-12-14 14:08:58 +05:30
Krrish Dholakia
6cb4ef5659 test(test_caching.py): reset cache values at the end of test 2023-12-11 18:10:53 -08:00
ishaan-jaff
070ca682cf bump: version 1.12.3 → 1.12.4 2023-12-11 09:19:07 -08:00
ishaan-jaff
4b26c550c5 (test) bedrock caching + stream 2023-12-11 08:43:50 -08:00
ishaan-jaff
bf1044444c (test) caching 2023-12-09 16:58:56 -08:00
ishaan-jaff
8a52e17300 (test) caching - get cache key 2023-12-09 16:42:59 -08:00
ishaan-jaff
6f8a35d539 (test) cache async + stream test 2023-12-09 14:22:10 -08:00