21 commits

Author	SHA1	Message	Date
Krrish Dholakia	478bd7def6	fix(router.py): introducing usage-based-routing	2023-11-17 17:56:26 -08:00
Krrish Dholakia	a99efc544e	fix(test_router.py): catch timeouts	2023-11-17 15:56:06 -08:00
Krrish Dholakia	0ab6b2451d	fix(acompletion): support client side timeouts + raise exceptions correctly for async calls	2023-11-17 15:39:47 -08:00
Krrish Dholakia	59eaeba92a	fix(router.py): enabling retrying with expo backoff (without tenacity) for router	2023-11-14 20:57:51 -08:00
Krrish Dholakia	a7222f257c	fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors	2023-11-14 16:26:05 -08:00
Krrish Dholakia	c6ce3fedcd	fix(main.py): fix caching for router	2023-11-11 17:45:23 -08:00
Krrish Dholakia	40edb546dc	test(test_streaming.py): set cache to none	2023-11-10 15:04:01 -08:00
Krrish Dholakia	18a8bd5543	fix(utils.py): return function call as part of response object	2023-11-10 11:02:10 -08:00
Krrish Dholakia	a4c9e6bd46	fix(utils.py): fix cached responses - translate dict to objects	2023-11-10 10:38:20 -08:00
ishaan-jaff	b8ebab5d4f	(test) router functionality	2023-11-08 09:48:48 -08:00
Krrish Dholakia	6a45879932	bump: version 0.13.6.dev3 → 0.13.6	2023-11-06 18:19:20 -08:00
Krrish Dholakia	65c01eae23	fix(huggingface_restapi.py): output parsing chat template models	2023-11-06 11:43:12 -08:00
mc-marcocheng	bf98d48bba	Feature: Router aembedding	2023-10-25 11:19:45 +08:00
Krrish Dholakia	0f08335edd	fix(router.py): adding support for async completion calls ... https://github.com/BerriAI/litellm/issues/676	2023-10-24 17:20:31 -07:00
Krrish Dholakia	653863f787	test(test_router.py): fixing router testing	2023-10-24 10:21:10 -07:00
mc-marcocheng	3c28ff6167	test_litellm_params_not_overwritten_by_function_calling	2023-10-24 22:04:45 +08:00
mc-marcocheng	8dad2eec83	test_litellm_params_not_overwritten_by_function_calling	2023-10-24 22:03:04 +08:00
Krrish Dholakia	05740fed9d	fix(router.py): enable additional params to be passe din	2023-10-23 20:41:18 -07:00
Krrish Dholakia	04f8840a92	test: fix linting testing	2023-10-19 18:40:33 -07:00
Krrish Dholakia	e35562d188	fix(router.py): completing redis support work for router	2023-10-18 12:13:00 -07:00
Krrish Dholakia	b20cf3171b	feat(router.py): add routing capabilities for multiple deployments	2023-10-17 22:28:31 -07:00