139 commits

Author	SHA1	Message	Date
Krish Dholakia	45cbb3cf3d	Merge branch 'main' into litellm_embedding_caching_updates	2024-02-03 18:08:47 -08:00
Krrish Dholakia	aee54eb684	test(test_caching.py): fix test to check id	2024-02-02 18:01:43 -08:00
ishaan-jaff	3836ba4e65	(test) caching, swap out unstable model	2024-01-29 11:00:15 -08:00
Krrish Dholakia	c07d471272	test(test_caching.py): fix cache test if embedding call is fast	2024-01-26 23:00:59 -08:00
ishaan-jaff	d84e4680db	(fix) test caching	2024-01-19 20:45:10 -08:00
Krrish Dholakia	79cc739b53	fix(caching.py): fix async in-memory caching	2024-01-13 15:33:57 +05:30
Krrish Dholakia	cdadac1649	fix(caching.py): return updated kwargs from get_cache helper function	2024-01-13 15:04:34 +05:30
Krrish Dholakia	813fb19620	fix: support async redis caching	2024-01-12 21:46:41 +05:30
Krrish Dholakia	4ed9f2b712	fix(utils.py): bug fixes	2024-01-11 19:02:17 +05:30
Krrish Dholakia	1472dc3f54	fix: n	2024-01-11 16:30:05 +05:30
ishaan-jaff	ca2c3a0a84	(fix) s3 + os.environ/ cache test	2024-01-06 16:33:29 +05:30
ishaan-jaff	87aa3c2985	(test) using os.environ/ on cache + proxy	2024-01-06 15:54:50 +05:30
ishaan-jaff	accbaebbf0	(ci/cd) run test again	2024-01-05 16:40:56 +05:30
ishaan-jaff	eb8dba100d	(fix) caching use same "created" in response_object	2024-01-05 16:03:56 +05:30
ishaan-jaff	50313b5bfc	(fix) test caching- use azure, instead of bedrock	2024-01-05 10:51:56 +05:30
Krrish Dholakia	a5bac8ae15	fix(caching.py): support s-maxage param for cache controls	2024-01-04 11:41:23 +05:30
ishaan-jaff	70d0a26419	(test) s3 cache with setting s3_bucket_name	2024-01-03 15:42:23 +05:30
ishaan-jaff	93d3c7e332	(test) use s3 buckets cache	2024-01-03 15:13:43 +05:30
Krrish Dholakia	176af67aac	fix(caching.py): support ttl, s-max-age, and no-cache cache controls ... https://github.com/BerriAI/litellm/issues/1306	2024-01-03 12:42:43 +05:30
ishaan-jaff	8d6a805312	(test) caching - context managers	2023-12-30 19:33:47 +05:30
Krrish Dholakia	3c50177314	fix(caching.py): hash the cache key to prevent key too long errors	2023-12-29 15:03:33 +05:30
Krrish Dholakia	b25a8c3b42	fix(main.py): support ttl being set for completion, embedding, image generation calls	2023-12-26 17:22:40 +05:30
Krrish Dholakia	79978c44ba	refactor: add black formatting	2023-12-25 14:11:20 +05:30
ishaan-jaff	ec0c284a4c	(test) - caching - override when caching = False	2023-12-14 16:20:29 +05:30
ishaan-jaff	25efd43551	(feat) use async_cache for acompletion/aembedding	2023-12-14 16:04:45 +05:30
ishaan-jaff	5501e7af12	(test) caching - get cache key for embedding	2023-12-14 14:08:58 +05:30
Krrish Dholakia	d34a8184c5	test(test_caching.py): reset cache values at the end of test	2023-12-11 18:10:53 -08:00
ishaan-jaff	509eb4a228	bump: version 1.12.3 → 1.12.4	2023-12-11 09:19:07 -08:00
ishaan-jaff	4a9b133266	(test) bedrock caching + stream	2023-12-11 08:43:50 -08:00
ishaan-jaff	8ad84517d0	(test) caching	2023-12-09 16:58:56 -08:00
ishaan-jaff	c9588795fe	(test) caching - get cache key	2023-12-09 16:42:59 -08:00
ishaan-jaff	a1209154dd	(test) cache async + stream test	2023-12-09 14:22:10 -08:00
ishaan-jaff	db91b06da1	(test) redis caching init calbacks to be empty	2023-12-09 11:32:35 -08:00
ishaan-jaff	25f4436c8d	(test) caching reset success_callback	2023-12-08 19:10:35 -08:00
ishaan-jaff	a2e0c87472	(ci/cd) q up another test	2023-12-08 18:55:18 -08:00
ishaan-jaff	4566210a07	(fix) test caching	2023-12-08 13:15:00 -08:00
ishaan-jaff	a07659a7c2	(test) cache + streaming	2023-12-08 11:50:37 -08:00
Krrish Dholakia	0940fadca3	docs: adds redis url to router + proxy docs	2023-12-05 15:08:00 -08:00
ishaan-jaff	b95d3acb12	(feat) init redis cache with **kwargs	2023-12-04 20:50:08 -08:00
Krrish Dholakia	e6a28881a2	fix(utils.py): fix embedding response object conversion	2023-11-25 14:25:06 -08:00
ishaan-jaff	375e7e8e6e	(test) caching	2023-11-23 21:23:41 -08:00
ishaan-jaff	8cad5e0c44	(test) caching	2023-11-23 18:17:12 -08:00
ishaan-jaff	9dee7df307	(test) caching ensure we always test add/get caching redis	2023-11-23 08:27:44 -08:00
Krrish Dholakia	bd87e30058	test(test_caching.py): cleaning up tests	2023-11-22 13:43:48 -08:00
ishaan-jaff	b397719709	(chore) remove bloat caching tests	2023-11-15 17:58:58 -08:00
Krrish Dholakia	d8121737d6	test(test_completion.py): cleanup tests	2023-11-13 11:23:38 -08:00
Krrish Dholakia	4c103592e3	test(test_streaming.py): set cache to none	2023-11-10 15:04:01 -08:00
Krrish Dholakia	b9d343e634	fix(test_caching.py): flaky test	2023-11-09 18:54:21 -08:00
ishaan-jaff	1da2704690	(test) add num retries to caching testing	2023-11-01 11:42:40 -07:00
Krrish Dholakia	53cb0f3974	fix(caching.py): fixing pr issues	2023-10-31 18:32:40 -07:00