10 commits

Author	SHA1	Message	Date
Krrish Dholakia	f075646dee	fix multithreading issue with response objects	2023-09-20 19:36:08 -07:00
ishaan-jaff	fc7bcf3d77	add batch testing	2023-09-20 08:17:48 -07:00
ishaan-jaff	864b244e15	new test for batch_completion_models_all_responses	2023-09-20 08:02:59 -07:00
ishaan-jaff	4048f10a07	test batch_completion_models	2023-09-19 13:29:41 -07:00
Krrish Dholakia	530f639b68	update test_batch_completions	2023-09-11 08:44:23 -07:00
Krrish Dholakia	7b6836bb4f	don't fail pytest due to timeout error in batch completions	2023-09-10 08:46:27 -07:00
Krrish Dholakia	14fa57c185	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
ishaan-jaff	2c7ffb7c75	add linting	2023-08-18 11:05:05 -07:00
Krrish Dholakia	24f7f7d648	fixing test for circle ci	2023-08-11 17:12:47 -07:00
Krrish Dholakia	0dc9c2a4c3	update	2023-08-11 09:51:14 -07:00