3222 commits

Author	SHA1	Message	Date
Krrish Dholakia	f10bb708c0	fix: fix run_ollama_serve to only run if api base is none	2023-12-09 21:31:46 -08:00
Krrish Dholakia	82484691cb	fix: minor bug fixes	2023-12-09 21:24:52 -08:00
ishaan-jaff	bf1044444c	(test) caching	2023-12-09 16:58:56 -08:00
ishaan-jaff	8a52e17300	(test) caching - get cache key	2023-12-09 16:42:59 -08:00
ishaan-jaff	2879b36636	(fix) setting cache keys	2023-12-09 16:42:59 -08:00
Krrish Dholakia	6ef0e8485e	fix(proxy_server.py): support for streaming	2023-12-09 16:23:04 -08:00
ishaan-jaff	0c8b8200b8	(ci/cd) run tests again	2023-12-09 16:02:02 -08:00
ishaan-jaff	1f1f749ad9	(feat) proxy - cache allow bool	2023-12-09 15:55:38 -08:00
ishaan-jaff	da08be1f43	(test) router + caching	2023-12-09 15:41:36 -08:00
ishaan-jaff	60bf552fe8	(fix) caching + proxy - use model group	2023-12-09 15:40:22 -08:00
ishaan-jaff	994c204e45	(fix) proxy - show logging when Cache created	2023-12-09 15:21:04 -08:00
ishaan-jaff	0b7f8265d6	(fix) router - only init cache when its none	2023-12-09 15:20:08 -08:00
ishaan-jaff	a9f103995d	(test) async completion + caching on router	2023-12-09 14:25:38 -08:00
ishaan-jaff	d18d5a3133	(feat) async completion caching	2023-12-09 14:22:10 -08:00
ishaan-jaff	67c730e264	(feat) async + stream cache	2023-12-09 14:22:10 -08:00
ishaan-jaff	6f8a35d539	(test) cache async + stream test	2023-12-09 14:22:10 -08:00
Krish Dholakia	cc4a1d2603	Merge pull request #985 from estill01/patch-1 ... Enable setting default `model` value for `LiteLLM`, `Chat`, `Completions`	2023-12-09 13:59:00 -08:00
ishaan-jaff	5e5ffc3d8a	(fix) use cache + custom logger	2023-12-09 12:41:26 -08:00
ishaan-jaff	0dcdf5f6ea	(fix) use cache + custom callbacks	2023-12-09 12:41:26 -08:00
Krrish Dholakia	b4aa9f0ae4	test(test_router.py): fix init issue	2023-12-09 12:28:51 -08:00
Krrish Dholakia	a250489405	test(test_router.py): run as asyncio.run	2023-12-09 12:28:28 -08:00
Krrish Dholakia	dd6caa8b55	fix(proxy_server.py): fix linting errors	2023-12-09 12:17:33 -08:00
Krrish Dholakia	ed50522863	fix(proxy_server.py): fix pydantic version errors	2023-12-09 12:09:49 -08:00
ishaan-jaff	0294e1119e	(fix) success_handler / logging	2023-12-09 11:38:42 -08:00
ishaan-jaff	8cbd6010c8	(test) redis caching init calbacks to be empty	2023-12-09 11:32:35 -08:00
Krrish Dholakia	c1c81af9d4	fix(proxy_server.py): add custom json helper func to work across multiple pydantic versions	2023-12-09 11:13:03 -08:00
Krrish Dholakia	9433c3c11b	test: trigger ci/cd build	2023-12-09 11:03:19 -08:00
ishaan-jaff	875b7d1c7f	(test) custom logger	2023-12-09 10:42:50 -08:00
Krrish Dholakia	c482c399ff	fix(proxy_server.py): add logging around /key/generate	2023-12-09 10:26:12 -08:00
ishaan-jaff	4643a9ac18	(test) custom logger + stream + sync compl()	2023-12-09 10:22:45 -08:00
ishaan-jaff	c8b699c0aa	(feat) custom logger: async stream,assemble chunks	2023-12-09 10:10:48 -08:00
ishaan-jaff	5d65550732	(test) custom logger print success handler	2023-12-09 10:04:10 -08:00
ishaan-jaff	8b144451e6	(test) model_info calback	2023-12-08 22:00:36 -08:00
Krrish Dholakia	4bf875d3ed	fix(router.py): fix least-busy routing	2023-12-08 20:29:49 -08:00
ishaan-jaff	d9b115b8fb	(ci/cd) run again	2023-12-08 19:26:55 -08:00
ishaan-jaff	db51a95a42	(test) init success_callback = [] for ci/cd	2023-12-08 19:16:12 -08:00
ishaan-jaff	04ec363788	(test) redis cache	2023-12-08 19:14:46 -08:00
ishaan-jaff	d7265a84c9	(test) caching reset success_callback	2023-12-08 19:10:35 -08:00
ishaan-jaff	4cdada62c5	(ci/cd) run another test	2023-12-08 19:04:45 -08:00
ishaan-jaff	fcc9f3c504	(ci/cd) q up another test	2023-12-08 18:55:18 -08:00
ishaan-jaff	c7eebf75a8	(ci/cd) test proxy custom logger	2023-12-08 18:46:19 -08:00
ishaan-jaff	0dc7d538b5	(docs) proxy - OTEL + traceloop	2023-12-08 18:39:52 -08:00
ishaan-jaff	13731f4bd8	(test) fix	2023-12-08 18:25:11 -08:00
ishaan-jaff	1ca50c5fa2	(ci/cd) run again	2023-12-08 18:11:01 -08:00
ishaan-jaff	ccee0cefe4	(ci/cd) run tests	2023-12-08 17:50:14 -08:00
ishaan-jaff	5efe336968	(fix) linting	2023-12-08 17:26:14 -08:00
ishaan-jaff	8c628b64e0	(test) proxy - custom logger	2023-12-08 17:25:05 -08:00
ishaan-jaff	88c1d6649f	(fix) asyc callback + stream-stop dbl cnt chunk	2023-12-08 17:25:05 -08:00
ishaan-jaff	e237361891	(test) async logger + streaming	2023-12-08 17:25:05 -08:00
ishaan-jaff	b50faed5ab	(test) callback - strict test - async callback resp	2023-12-08 17:25:05 -08:00