5 commits

Author	SHA1	Message	Date
Ishaan Jaff	62c7a95a32	test_batch_completion_multiple_models_multiple_messages	2024-05-28 22:54:54 -07:00
Krrish Dholakia	98ebcad52d	fix(router.py): support batch completions fastest response streaming	2024-05-28 21:51:09 -07:00
Krrish Dholakia	012bde0b07	fix(router.py): support comma-separated model list for batch completion fastest response	2024-05-28 21:34:37 -07:00
Krrish Dholakia	3676c00235	feat(router.py): support fastest response batch completion call ... returns fastest response. cancels others.	2024-05-28 19:44:41 -07:00
Ishaan Jaff	30fef36fef	test - router.batch_acompletion	2024-05-11 13:09:17 -07:00