10 commits

Author	SHA1	Message	Date
Krrish Dholakia	fc922bc300	fix multithreading issue with response objects	2023-09-20 19:36:08 -07:00
ishaan-jaff	eeeb95a6ac	add batch testing	2023-09-20 08:17:48 -07:00
ishaan-jaff	4b636a3578	new test for batch_completion_models_all_responses	2023-09-20 08:02:59 -07:00
ishaan-jaff	a230d08795	test batch_completion_models	2023-09-19 13:29:41 -07:00
Krrish Dholakia	08132975f4	update test_batch_completions	2023-09-11 08:44:23 -07:00
Krrish Dholakia	fb8f2bac37	don't fail pytest due to timeout error in batch completions	2023-09-10 08:46:27 -07:00
Krrish Dholakia	35cf6ef0a1	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
ishaan-jaff	15b1da9dc8	add linting	2023-08-18 11:05:05 -07:00
Krrish Dholakia	a2efd32f5c	fixing test for circle ci	2023-08-11 17:12:47 -07:00
Krrish Dholakia	fb285c8c9f	update	2023-08-11 09:51:14 -07:00