1556 commits

Author	SHA1	Message	Date
ishaan-jaff	a9f103995d	(test) async completion + caching on router	2023-12-09 14:25:38 -08:00
ishaan-jaff	6f8a35d539	(test) cache async + stream test	2023-12-09 14:22:10 -08:00
ishaan-jaff	0dcdf5f6ea	(fix) use cache + custom callbacks	2023-12-09 12:41:26 -08:00
Krrish Dholakia	b4aa9f0ae4	test(test_router.py): fix init issue	2023-12-09 12:28:51 -08:00
Krrish Dholakia	a250489405	test(test_router.py): run as asyncio.run	2023-12-09 12:28:28 -08:00
ishaan-jaff	8cbd6010c8	(test) redis caching init calbacks to be empty	2023-12-09 11:32:35 -08:00
Krrish Dholakia	9433c3c11b	test: trigger ci/cd build	2023-12-09 11:03:19 -08:00
ishaan-jaff	875b7d1c7f	(test) custom logger	2023-12-09 10:42:50 -08:00
Krrish Dholakia	c482c399ff	fix(proxy_server.py): add logging around /key/generate	2023-12-09 10:26:12 -08:00
ishaan-jaff	4643a9ac18	(test) custom logger + stream + sync compl()	2023-12-09 10:22:45 -08:00
ishaan-jaff	5d65550732	(test) custom logger print success handler	2023-12-09 10:04:10 -08:00
ishaan-jaff	8b144451e6	(test) model_info calback	2023-12-08 22:00:36 -08:00
Krrish Dholakia	4bf875d3ed	fix(router.py): fix least-busy routing	2023-12-08 20:29:49 -08:00
ishaan-jaff	d9b115b8fb	(ci/cd) run again	2023-12-08 19:26:55 -08:00
ishaan-jaff	db51a95a42	(test) init success_callback = [] for ci/cd	2023-12-08 19:16:12 -08:00
ishaan-jaff	d7265a84c9	(test) caching reset success_callback	2023-12-08 19:10:35 -08:00
ishaan-jaff	4cdada62c5	(ci/cd) run another test	2023-12-08 19:04:45 -08:00
ishaan-jaff	fcc9f3c504	(ci/cd) q up another test	2023-12-08 18:55:18 -08:00
ishaan-jaff	c7eebf75a8	(ci/cd) test proxy custom logger	2023-12-08 18:46:19 -08:00
ishaan-jaff	13731f4bd8	(test) fix	2023-12-08 18:25:11 -08:00
ishaan-jaff	1ca50c5fa2	(ci/cd) run again	2023-12-08 18:11:01 -08:00
ishaan-jaff	ccee0cefe4	(ci/cd) run tests	2023-12-08 17:50:14 -08:00
ishaan-jaff	8c628b64e0	(test) proxy - custom logger	2023-12-08 17:25:05 -08:00
ishaan-jaff	e237361891	(test) async logger + streaming	2023-12-08 17:25:05 -08:00
ishaan-jaff	b50faed5ab	(test) callback - strict test - async callback resp	2023-12-08 17:25:05 -08:00
Krrish Dholakia	5fa2b6e5ad	fix(proxy_server.py): enable pre+post-call hooks and max parallel request limits	2023-12-08 17:11:30 -08:00
ishaan-jaff	76d0c50523	(ci/cd) comment beta test	2023-12-08 14:27:53 -08:00
ishaan-jaff	73984504e9	(test) proxy: access model_info and request_obj	2023-12-08 14:26:18 -08:00
Krrish Dholakia	9f0b83248a	fix(proxy/utils.py): add backoff/retry logic to db read/writes	2023-12-08 13:34:31 -08:00
ishaan-jaff	b8e9e1edc9	(fix) test caching	2023-12-08 13:15:00 -08:00
ishaan-jaff	fa8ba9dd4e	(test) cache + streaming	2023-12-08 11:50:37 -08:00
Krrish Dholakia	7aec95ed7c	feat(proxy_server.py): add sentry logging for db read/writes	2023-12-08 11:40:19 -08:00
Krrish Dholakia	4e6a8d09d0	fix(proxy/utils.py): tracking db failed writes	2023-12-08 10:40:02 -08:00
Krrish Dholakia	1b35736797	fix(utils.py): fix cost calculation to handle tool input	2023-12-08 09:53:46 -08:00
Krrish Dholakia	dfba305508	test: test_router.py ... fix router testing n	2023-12-07 20:10:36 -08:00
ishaan-jaff	b8b15435b7	(test) undo fd04b48	2023-12-07 18:38:51 -08:00
ishaan-jaff	3f4fe668a8	(ci/cd) vertex ai test	2023-12-07 18:20:58 -08:00
ishaan-jaff	fd04b48764	(feat) async callbacks with litellm.completion()	2023-12-07 18:09:57 -08:00
Krrish Dholakia	4c0e95aec9	test: fix proxy custom logger test	2023-12-07 15:19:11 -08:00
Krrish Dholakia	b92f1af301	test: cleaning up local testing	2023-12-07 14:20:14 -08:00
Krrish Dholakia	3846ec6124	fix(utils.py): fix get_llm_provider to handle the ':' in anthropic/bedrock calls	2023-12-07 14:19:11 -08:00
Krrish Dholakia	2b04dc310a	test: skip local proxy test in circle ci	2023-12-07 13:56:23 -08:00
ishaan-jaff	f236dae79d	(test) async logger + proxy	2023-12-07 13:54:27 -08:00
ishaan-jaff	5ddfaa33f3	(feat) proxy - async logger class + embeddings	2023-12-07 13:54:08 -08:00
Krrish Dholakia	e5638e2c5d	fix(router.py): fix default caching response value	2023-12-07 13:44:31 -08:00
ishaan-jaff	418099085c	(test) proxy - async logger, strict check async_success	2023-12-07 13:44:17 -08:00
ishaan-jaff	2bc583c2a6	(test) proxy - async custom logger	2023-12-07 13:19:17 -08:00
ishaan-jaff	0354d6d48f	(ci/cd) vertex test	2023-12-07 12:41:39 -08:00
ishaan-jaff	19f1035f5a	(ci/cd) vertex ai testing	2023-12-07 11:36:20 -08:00
ishaan-jaff	077f6b1298	(ci/cd) vertex ai	2023-12-07 11:19:29 -08:00