182 commits

Author	SHA1	Message	Date
ishaan-jaff	e430255794	(feat) caching - streaming caching support	2023-12-08 11:50:37 -08:00
ishaan-jaff	991d37f10e	(fix) bug - caching: gen cache key in order	2023-12-08 11:50:37 -08:00
ishaan-jaff	f744445db4	(fix) make print_verbose non blocking	2023-12-07 17:31:32 -08:00
Krrish Dholakia	94abb14b99	fix(_redis.py): support additional params for redis	2023-12-05 12:16:51 -08:00
ishaan-jaff	b95d3acb12	(feat) init redis cache with **kwargs	2023-12-04 20:50:08 -08:00
Krrish Dholakia	6f40fd8ee2	fix(proxy_server.py): fix linting issues	2023-11-24 11:39:01 -08:00
ishaan-jaff	48f1ad05a3	(fix) caching use model, messages, temp, max_tokens as cache_key	2023-11-23 20:56:41 -08:00
Krrish Dholakia	3a8d7ec835	fix(router.py): add modelgroup to call metadata	2023-11-23 20:55:49 -08:00
ishaan-jaff	95b0b904cf	(feat) caching: Use seed, max_tokens etc in cache key	2023-11-23 18:17:12 -08:00
ishaan-jaff	6934c08785	(chore) remove bloat: deprecated api.litellm cache	2023-11-23 17:20:22 -08:00
Krrish Dholakia	c290be69f6	fix(caching.py): fix linting issues	2023-11-23 13:21:45 -08:00
Krrish Dholakia	0e3064ac8c	fix(router.py): fix caching for tracking cooldowns + usage	2023-11-23 11:13:32 -08:00
Krrish Dholakia	497419a766	fix(router.py): add support for cooldowns with redis	2023-11-22 19:54:22 -08:00
Krrish Dholakia	8ba438b3a2	fix(caching.py): dump model response object as json	2023-11-13 10:41:04 -08:00
Krrish Dholakia	d0b23a2722	refactor(all-files): removing all print statements; adding pre-commit + flake8 to prevent future regressions	2023-11-04 12:50:15 -07:00
Krrish Dholakia	53cb0f3974	fix(caching.py): fixing pr issues	2023-10-31 18:32:40 -07:00
seva	f0a9f8c61e	Router & Caching fixes: ... - Add optional TTL to Cache parameters - Fix tpm and rpm caching in Router	2023-10-30 13:29:35 +01:00
ishaan-jaff	2a3da7e43c	(feat) Redis caching print exception statements when it fails	2023-10-25 11:29:48 -07:00
Krrish Dholakia	204218508d	fix(router.py): completing redis support work for router	2023-10-18 12:13:00 -07:00
ishaan-jaff	7708d45374	(feat) add docstring for caching	2023-10-14 16:08:42 -07:00
ishaan-jaff	7d9096ce37	add hosted api.litellm.ai for caching	2023-10-02 10:27:18 -07:00
Krrish Dholakia	7cf5be98a2	add contributor message to code	2023-09-25 10:00:10 -07:00
ishaan-jaff	da87721a20	caching updates	2023-09-08 18:06:47 -07:00
ishaan-jaff	ee68836684	fix redis caching	2023-08-28 22:10:15 -07:00
ishaan-jaff	309e5e7046	with new caching	2023-08-28 21:57:00 -07:00
ishaan-jaff	d26df210f6	add streaming_caching support	2023-08-28 19:17:53 -07:00
ishaan-jaff	8454e2d436	working write to cache with streaming	2023-08-28 18:46:26 -07:00
ishaan-jaff	d0fe961e59	cache improvements	2023-08-28 14:44:42 -07:00
ishaan-jaff	03d91f8106	fix import	2023-08-28 14:21:25 -07:00
ishaan-jaff	0e0fa1273b	fix redis import	2023-08-28 14:13:03 -07:00
ishaan-jaff	c93f5e3def	working with embeddings	2023-08-28 14:07:51 -07:00
ishaan-jaff	6fa2e578d4	v0 of caching	2023-08-28 13:11:56 -07:00