Commit graph

81 commits

Author SHA1 Message Date
Krrish Dholakia
4ed9f2b712 fix(utils.py): bug fixes 2024-01-11 19:02:17 +05:30
Krrish Dholakia
1472dc3f54 fix: n 2024-01-11 16:30:05 +05:30
ishaan-jaff
ca2c3a0a84 (fix) s3 + os.environ/ cache test 2024-01-06 16:33:29 +05:30
ishaan-jaff
87aa3c2985 (test) using os.environ/ on cache + proxy 2024-01-06 15:54:50 +05:30
ishaan-jaff
accbaebbf0 (ci/cd) run test again 2024-01-05 16:40:56 +05:30
ishaan-jaff
eb8dba100d (fix) caching use same "created" in response_object 2024-01-05 16:03:56 +05:30
ishaan-jaff
50313b5bfc (fix) test caching- use azure, instead of bedrock 2024-01-05 10:51:56 +05:30
Krrish Dholakia
a5bac8ae15 fix(caching.py): support s-maxage param for cache controls 2024-01-04 11:41:23 +05:30
ishaan-jaff
70d0a26419 (test) s3 cache with setting s3_bucket_name 2024-01-03 15:42:23 +05:30
ishaan-jaff
93d3c7e332 (test) use s3 buckets cache 2024-01-03 15:13:43 +05:30
Krrish Dholakia
176af67aac fix(caching.py): support ttl, s-max-age, and no-cache cache controls
https://github.com/BerriAI/litellm/issues/1306
2024-01-03 12:42:43 +05:30
ishaan-jaff
8d6a805312 (test) caching - context managers 2023-12-30 19:33:47 +05:30
Krrish Dholakia
3c50177314 fix(caching.py): hash the cache key to prevent key too long errors 2023-12-29 15:03:33 +05:30
Krrish Dholakia
b25a8c3b42 fix(main.py): support ttl being set for completion, embedding, image generation calls 2023-12-26 17:22:40 +05:30
Krrish Dholakia
79978c44ba refactor: add black formatting 2023-12-25 14:11:20 +05:30
ishaan-jaff
ec0c284a4c (test) - caching - override when caching = False 2023-12-14 16:20:29 +05:30
ishaan-jaff
25efd43551 (feat) use async_cache for acompletion/aembedding 2023-12-14 16:04:45 +05:30
ishaan-jaff
5501e7af12 (test) caching - get cache key for embedding 2023-12-14 14:08:58 +05:30
Krrish Dholakia
d34a8184c5 test(test_caching.py): reset cache values at the end of test 2023-12-11 18:10:53 -08:00
ishaan-jaff
509eb4a228 bump: version 1.12.3 → 1.12.4 2023-12-11 09:19:07 -08:00
ishaan-jaff
4a9b133266 (test) bedrock caching + stream 2023-12-11 08:43:50 -08:00
ishaan-jaff
8ad84517d0 (test) caching 2023-12-09 16:58:56 -08:00
ishaan-jaff
c9588795fe (test) caching - get cache key 2023-12-09 16:42:59 -08:00
ishaan-jaff
a1209154dd (test) cache async + stream test 2023-12-09 14:22:10 -08:00
ishaan-jaff
db91b06da1 (test) redis caching init calbacks to be empty 2023-12-09 11:32:35 -08:00
ishaan-jaff
25f4436c8d (test) caching reset success_callback 2023-12-08 19:10:35 -08:00
ishaan-jaff
a2e0c87472 (ci/cd) q up another test 2023-12-08 18:55:18 -08:00
ishaan-jaff
4566210a07 (fix) test caching 2023-12-08 13:15:00 -08:00
ishaan-jaff
a07659a7c2 (test) cache + streaming 2023-12-08 11:50:37 -08:00
Krrish Dholakia
0940fadca3 docs: adds redis url to router + proxy docs 2023-12-05 15:08:00 -08:00
ishaan-jaff
b95d3acb12 (feat) init redis cache with **kwargs 2023-12-04 20:50:08 -08:00
Krrish Dholakia
e6a28881a2 fix(utils.py): fix embedding response object conversion 2023-11-25 14:25:06 -08:00
ishaan-jaff
375e7e8e6e (test) caching 2023-11-23 21:23:41 -08:00
ishaan-jaff
8cad5e0c44 (test) caching 2023-11-23 18:17:12 -08:00
ishaan-jaff
9dee7df307 (test) caching ensure we always test add/get caching redis 2023-11-23 08:27:44 -08:00
Krrish Dholakia
bd87e30058 test(test_caching.py): cleaning up tests 2023-11-22 13:43:48 -08:00
ishaan-jaff
b397719709 (chore) remove bloat caching tests 2023-11-15 17:58:58 -08:00
Krrish Dholakia
d8121737d6 test(test_completion.py): cleanup tests 2023-11-13 11:23:38 -08:00
Krrish Dholakia
4c103592e3 test(test_streaming.py): set cache to none 2023-11-10 15:04:01 -08:00
Krrish Dholakia
b9d343e634 fix(test_caching.py): flaky test 2023-11-09 18:54:21 -08:00
ishaan-jaff
1da2704690 (test) add num retries to caching testing 2023-11-01 11:42:40 -07:00
Krrish Dholakia
53cb0f3974 fix(caching.py): fixing pr issues 2023-10-31 18:32:40 -07:00
seva
bac6f41eb7 Add tests for cache with TTL 2023-10-30 13:35:55 +01:00
Krrish Dholakia
3e8af9f807 test(test_caching.py): reset to none 2023-10-24 15:02:20 -07:00
Krrish Dholakia
e55b20b1e4 test(test_async_fn.py): adding additional logging for tests 2023-10-24 12:54:18 -07:00
Krrish Dholakia
98c25b08cd fix(vertex_ai.py): fix output parsing 2023-10-24 12:08:22 -07:00
ishaan-jaff
ab2d078c88 (test) retry testing 2023-10-20 17:42:48 -07:00
ishaan-jaff
94c1b517ba (test) caching tests 2023-10-20 15:00:40 -07:00
ishaan-jaff
2d00738386 (test) fix azure test 2023-10-13 22:18:53 -07:00
ishaan-jaff
0edf4d6ea5 (tests) add 2023-10-13 21:16:41 -07:00