6 commits

Author	SHA1	Message	Date
ishaan-jaff	485a7ff136	(feat) use usage class for model responses for cohere, hf, tg ai, cohere	2023-10-27 09:58:47 -07:00
Krrish Dholakia	e5279ef99d	style: fix linting errors	2023-10-16 17:35:08 -07:00
ishaan-jaff	6e0aa579eb	raise vllm error	2023-09-08 15:27:01 -07:00
Krrish Dholakia	e6a65695eb	fix linting issues	2023-09-06 20:43:59 -07:00
Krrish Dholakia	14fa57c185	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
Krrish Dholakia	7290a972e5	adding support for vllm	2023-09-06 18:07:44 -07:00