Commit graph

79 commits

Author SHA1 Message Date
ishaan-jaff
edac4130bb (fix) s3 + os.environ/ cache test 2024-01-06 16:33:29 +05:30
ishaan-jaff
f999b63d05 (test) using os.environ/ on cache + proxy 2024-01-06 15:54:50 +05:30
ishaan-jaff
76b2db4492 (ci/cd) run test again 2024-01-05 16:40:56 +05:30
ishaan-jaff
4679c7b99a (fix) caching use same "created" in response_object 2024-01-05 16:03:56 +05:30
ishaan-jaff
d1865591aa (fix) test caching- use azure, instead of bedrock 2024-01-05 10:51:56 +05:30
Krrish Dholakia
b0827a87b2 fix(caching.py): support s-maxage param for cache controls 2024-01-04 11:41:23 +05:30
ishaan-jaff
d14a41863f (test) s3 cache with setting s3_bucket_name 2024-01-03 15:42:23 +05:30
ishaan-jaff
fea0a933ae (test) use s3 buckets cache 2024-01-03 15:13:43 +05:30
Krrish Dholakia
8cee267a5b fix(caching.py): support ttl, s-max-age, and no-cache cache controls
https://github.com/BerriAI/litellm/issues/1306
2024-01-03 12:42:43 +05:30
ishaan-jaff
e35f17ca3c (test) caching - context managers 2023-12-30 19:33:47 +05:30
Krrish Dholakia
1e07f0fce8 fix(caching.py): hash the cache key to prevent key too long errors 2023-12-29 15:03:33 +05:30
Krrish Dholakia
f0b6b9dce2 fix(main.py): support ttl being set for completion, embedding, image generation calls 2023-12-26 17:22:40 +05:30
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
ishaan-jaff
9a35f347ab (test) - caching - override when caching = False 2023-12-14 16:20:29 +05:30
ishaan-jaff
008df34ddc (feat) use async_cache for acompletion/aembedding 2023-12-14 16:04:45 +05:30
ishaan-jaff
ee6b936377 (test) caching - get cache key for embedding 2023-12-14 14:08:58 +05:30
Krrish Dholakia
6cb4ef5659 test(test_caching.py): reset cache values at the end of test 2023-12-11 18:10:53 -08:00
ishaan-jaff
070ca682cf bump: version 1.12.3 → 1.12.4 2023-12-11 09:19:07 -08:00
ishaan-jaff
4b26c550c5 (test) bedrock caching + stream 2023-12-11 08:43:50 -08:00
ishaan-jaff
bf1044444c (test) caching 2023-12-09 16:58:56 -08:00
ishaan-jaff
8a52e17300 (test) caching - get cache key 2023-12-09 16:42:59 -08:00
ishaan-jaff
6f8a35d539 (test) cache async + stream test 2023-12-09 14:22:10 -08:00
ishaan-jaff
8cbd6010c8 (test) redis caching init calbacks to be empty 2023-12-09 11:32:35 -08:00
ishaan-jaff
d7265a84c9 (test) caching reset success_callback 2023-12-08 19:10:35 -08:00
ishaan-jaff
fcc9f3c504 (ci/cd) q up another test 2023-12-08 18:55:18 -08:00
ishaan-jaff
b8e9e1edc9 (fix) test caching 2023-12-08 13:15:00 -08:00
ishaan-jaff
fa8ba9dd4e (test) cache + streaming 2023-12-08 11:50:37 -08:00
Krrish Dholakia
68ca2a28d4 docs: adds redis url to router + proxy docs 2023-12-05 15:08:00 -08:00
ishaan-jaff
9ba17657ad (feat) init redis cache with **kwargs 2023-12-04 20:50:08 -08:00
Krrish Dholakia
2eb7386095 fix(utils.py): fix embedding response object conversion 2023-11-25 14:25:06 -08:00
ishaan-jaff
0c210cc96c (test) caching 2023-11-23 21:23:41 -08:00
ishaan-jaff
b6f8dbbc0e (test) caching 2023-11-23 18:17:12 -08:00
ishaan-jaff
fbd2ab4c71 (test) caching ensure we always test add/get caching redis 2023-11-23 08:27:44 -08:00
Krrish Dholakia
b0801f61e6 test(test_caching.py): cleaning up tests 2023-11-22 13:43:48 -08:00
ishaan-jaff
3945bfadb7 (chore) remove bloat caching tests 2023-11-15 17:58:58 -08:00
Krrish Dholakia
aa8ca781ba test(test_completion.py): cleanup tests 2023-11-13 11:23:38 -08:00
Krrish Dholakia
40edb546dc test(test_streaming.py): set cache to none 2023-11-10 15:04:01 -08:00
Krrish Dholakia
7769abe432 fix(test_caching.py): flaky test 2023-11-09 18:54:21 -08:00
ishaan-jaff
317c290b69 (test) add num retries to caching testing 2023-11-01 11:42:40 -07:00
Krrish Dholakia
6ead8d8c18 fix(caching.py): fixing pr issues 2023-10-31 18:32:40 -07:00
seva
f4d65cf23d Add tests for cache with TTL 2023-10-30 13:35:55 +01:00
Krrish Dholakia
3ec103f712 test(test_caching.py): reset to none 2023-10-24 15:02:20 -07:00
Krrish Dholakia
1eca893d2f test(test_async_fn.py): adding additional logging for tests 2023-10-24 12:54:18 -07:00
Krrish Dholakia
f12dc5df21 fix(vertex_ai.py): fix output parsing 2023-10-24 12:08:22 -07:00
ishaan-jaff
2a351eab8d (test) retry testing 2023-10-20 17:42:48 -07:00
ishaan-jaff
d8ab3ec2b9 (test) caching tests 2023-10-20 15:00:40 -07:00
ishaan-jaff
5e5c314bec (test) fix azure test 2023-10-13 22:18:53 -07:00
ishaan-jaff
5d2881a2ce (tests) add 2023-10-13 21:16:41 -07:00
ishaan-jaff
606b787842 update caching tests 2023-10-02 11:48:35 -07:00
ishaan-jaff
49f65b7eb8 add litellm hosted cache test 2023-10-02 10:28:19 -07:00