8 commits

Author	SHA1	Message	Date
Krrish Dholakia	e5929f2f7e	fix(azure.py-+-proxy_server.py): fix function calling response object + support router on proxy	2023-11-15 13:15:16 -08:00
Krrish Dholakia	4b74ddcb17	refactor: fixing linting issues	2023-11-11 18:52:28 -08:00
ishaan-jaff	485a7ff136	(feat) use usage class for model responses for cohere, hf, tg ai, cohere	2023-10-27 09:58:47 -07:00
Krrish Dholakia	e5279ef99d	style: fix linting errors	2023-10-16 17:35:08 -07:00
ishaan-jaff	6e0aa579eb	raise vllm error	2023-09-08 15:27:01 -07:00
Krrish Dholakia	e6a65695eb	fix linting issues	2023-09-06 20:43:59 -07:00
Krrish Dholakia	14fa57c185	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
Krrish Dholakia	7290a972e5	adding support for vllm	2023-09-06 18:07:44 -07:00