6 commits

Author	SHA1	Message	Date
ishaan-jaff	63928fa166	(feat) use usage class for model responses for cohere, hf, tg ai, cohere	2023-10-27 09:58:47 -07:00
Krrish Dholakia	7572086231	style: fix linting errors	2023-10-16 17:35:08 -07:00
ishaan-jaff	599be6a374	raise vllm error	2023-09-08 15:27:01 -07:00
Krrish Dholakia	6b3cb18983	fix linting issues	2023-09-06 20:43:59 -07:00
Krrish Dholakia	35cf6ef0a1	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
Krrish Dholakia	4cfcabd919	adding support for vllm	2023-09-06 18:07:44 -07:00