1546 commits

Author	SHA1	Message	Date
ishaan-jaff	5d65550732	(test) custom logger print success handler	2023-12-09 10:04:10 -08:00
ishaan-jaff	8b144451e6	(test) model_info calback	2023-12-08 22:00:36 -08:00
Krrish Dholakia	4bf875d3ed	fix(router.py): fix least-busy routing	2023-12-08 20:29:49 -08:00
ishaan-jaff	d9b115b8fb	(ci/cd) run again	2023-12-08 19:26:55 -08:00
ishaan-jaff	db51a95a42	(test) init success_callback = [] for ci/cd	2023-12-08 19:16:12 -08:00
ishaan-jaff	d7265a84c9	(test) caching reset success_callback	2023-12-08 19:10:35 -08:00
ishaan-jaff	4cdada62c5	(ci/cd) run another test	2023-12-08 19:04:45 -08:00
ishaan-jaff	fcc9f3c504	(ci/cd) q up another test	2023-12-08 18:55:18 -08:00
ishaan-jaff	c7eebf75a8	(ci/cd) test proxy custom logger	2023-12-08 18:46:19 -08:00
ishaan-jaff	13731f4bd8	(test) fix	2023-12-08 18:25:11 -08:00
ishaan-jaff	1ca50c5fa2	(ci/cd) run again	2023-12-08 18:11:01 -08:00
ishaan-jaff	ccee0cefe4	(ci/cd) run tests	2023-12-08 17:50:14 -08:00
ishaan-jaff	8c628b64e0	(test) proxy - custom logger	2023-12-08 17:25:05 -08:00
ishaan-jaff	e237361891	(test) async logger + streaming	2023-12-08 17:25:05 -08:00
ishaan-jaff	b50faed5ab	(test) callback - strict test - async callback resp	2023-12-08 17:25:05 -08:00
Krrish Dholakia	5fa2b6e5ad	fix(proxy_server.py): enable pre+post-call hooks and max parallel request limits	2023-12-08 17:11:30 -08:00
ishaan-jaff	76d0c50523	(ci/cd) comment beta test	2023-12-08 14:27:53 -08:00
ishaan-jaff	73984504e9	(test) proxy: access model_info and request_obj	2023-12-08 14:26:18 -08:00
Krrish Dholakia	9f0b83248a	fix(proxy/utils.py): add backoff/retry logic to db read/writes	2023-12-08 13:34:31 -08:00
ishaan-jaff	b8e9e1edc9	(fix) test caching	2023-12-08 13:15:00 -08:00
ishaan-jaff	fa8ba9dd4e	(test) cache + streaming	2023-12-08 11:50:37 -08:00
Krrish Dholakia	7aec95ed7c	feat(proxy_server.py): add sentry logging for db read/writes	2023-12-08 11:40:19 -08:00
Krrish Dholakia	4e6a8d09d0	fix(proxy/utils.py): tracking db failed writes	2023-12-08 10:40:02 -08:00
Krrish Dholakia	1b35736797	fix(utils.py): fix cost calculation to handle tool input	2023-12-08 09:53:46 -08:00
Krrish Dholakia	dfba305508	test: test_router.py ... fix router testing n	2023-12-07 20:10:36 -08:00
ishaan-jaff	b8b15435b7	(test) undo fd04b48	2023-12-07 18:38:51 -08:00
ishaan-jaff	3f4fe668a8	(ci/cd) vertex ai test	2023-12-07 18:20:58 -08:00
ishaan-jaff	fd04b48764	(feat) async callbacks with litellm.completion()	2023-12-07 18:09:57 -08:00
Krrish Dholakia	4c0e95aec9	test: fix proxy custom logger test	2023-12-07 15:19:11 -08:00
Krrish Dholakia	b92f1af301	test: cleaning up local testing	2023-12-07 14:20:14 -08:00
Krrish Dholakia	3846ec6124	fix(utils.py): fix get_llm_provider to handle the ':' in anthropic/bedrock calls	2023-12-07 14:19:11 -08:00
Krrish Dholakia	2b04dc310a	test: skip local proxy test in circle ci	2023-12-07 13:56:23 -08:00
ishaan-jaff	f236dae79d	(test) async logger + proxy	2023-12-07 13:54:27 -08:00
ishaan-jaff	5ddfaa33f3	(feat) proxy - async logger class + embeddings	2023-12-07 13:54:08 -08:00
Krrish Dholakia	e5638e2c5d	fix(router.py): fix default caching response value	2023-12-07 13:44:31 -08:00
ishaan-jaff	418099085c	(test) proxy - async logger, strict check async_success	2023-12-07 13:44:17 -08:00
ishaan-jaff	2bc583c2a6	(test) proxy - async custom logger	2023-12-07 13:19:17 -08:00
ishaan-jaff	0354d6d48f	(ci/cd) vertex test	2023-12-07 12:41:39 -08:00
ishaan-jaff	19f1035f5a	(ci/cd) vertex ai testing	2023-12-07 11:36:20 -08:00
ishaan-jaff	077f6b1298	(ci/cd) vertex ai	2023-12-07 11:19:29 -08:00
ishaan-jaff	90d474ff21	(ci/cd) vertex ai	2023-12-07 10:50:58 -08:00
ishaan-jaff	85668ff415	(ci/cd) vertex ai	2023-12-07 10:44:45 -08:00
ishaan-jaff	8dd6786123	(ci/cd) vertex ai	2023-12-07 10:39:24 -08:00
ishaan-jaff	0f8225c3eb	(ci/cd) use relative path for vertex	2023-12-07 10:38:06 -08:00
ishaan-jaff	378f211a29	(ci/cd) debugging	2023-12-07 10:36:58 -08:00
ishaan-jaff	01c7dc197a	(ci/cd) vertex ai	2023-12-07 10:31:32 -08:00
ishaan-jaff	e823e8d99e	(test) add vertex ai to ci/cd	2023-12-07 10:20:21 -08:00
Krrish Dholakia	6fae3fde22	test(test_embeddings.py): improve testing for titan embeddings	2023-12-06 22:47:01 -08:00
Krrish Dholakia	c1e95740b0	fix(bedrock.py): fix output format for cohere embeddings	2023-12-06 22:47:01 -08:00
ishaan-jaff	7ddc0dad24	(test) fix test_model_group_aliases	2023-12-06 21:25:30 -08:00