2 commits

Author	SHA1	Message	Date
Krish Dholakia	481645e49c	fix(acompletion): support fallbacks on acompletion (#7184) ... * fix(acompletion): support fallbacks on acompletion allows health checks for wildcard routes to use fallback models * test: update cohere generate api testing * add max tokens to health check (#7000) * fix: fix health check test * test: update testing --------- Co-authored-by: Cameron <561860+wallies@users.noreply.github.com>	2024-12-11 19:20:54 -08:00
Ishaan Jaff	5e016fe66a	(Refactor) Code Quality improvement - Use Common base handler for Cohere /generate API (#7122) ... * use validate_environment in common utils * use transform request / response for cohere * remove unused file * use cohere base_llm_http_handler * working cohere generate api on llm http handler * streaming cohere generate api * fix get_model_response_iterator * fix streaming handler * fix get_model_response_iterator * test_cohere_generate_api_completion * fix linting error * fix testing cohere raising error * fix get_model_response_iterator type * add testing cohere generate api	2024-12-10 10:44:42 -08:00