42 commits

Author	SHA1	Message	Date
Krrish Dholakia	094144de58	fix(router.py): removing model id before making call	2023-11-28 10:09:45 -08:00
Krrish Dholakia	ab0bc87427	fix(router.py): check if fallbacks is none	2023-11-25 14:58:07 -08:00
Krrish Dholakia	16e1070dbe	test: refactor testing order	2023-11-24 12:47:28 -08:00
Krrish Dholakia	3dcbf6197a	test(test_router.py): reintegrate router testing	2023-11-24 11:48:24 -08:00
Krrish Dholakia	c75e90663c	test(test_stream_chunk_builder.py): fix setting api key	2023-11-24 11:47:48 -08:00
Krrish Dholakia	4a5dae3941	fix(main.py): fix streaming_chunk_builder to return usage	2023-11-24 11:27:04 -08:00
ishaan-jaff	ba9dbbe6d5	(test) router: acompletion + caching	2023-11-23 21:05:48 -08:00
Krrish Dholakia	187403c5cc	fix(router.py): add modelgroup to call metadata	2023-11-23 20:55:49 -08:00
ishaan-jaff	db8ed601b5	(test) temp comment router to test ci/cd	2023-11-23 20:28:43 -08:00
Krrish Dholakia	7d221fe863	fix(utils.py): make failure logging sync	2023-11-23 20:19:27 -08:00
ishaan-jaff	704af2ca34	(test) testing fix	2023-11-23 17:20:22 -08:00
ishaan-jaff	3118101e2c	(test) router: raises exception	2023-11-23 17:09:36 -08:00
ishaan-jaff	60dab0d700	(test) router: azure pass key in model list	2023-11-23 16:51:52 -08:00
ishaan-jaff	a1bb880872	(test) router raise exceptions	2023-11-23 16:28:19 -08:00
ishaan-jaff	1365092c89	(test) router: ensure errors are raised	2023-11-23 16:08:59 -08:00
Krrish Dholakia	61fc76a8c4	fix(router.py): fix caching for tracking cooldowns + usage	2023-11-23 11:13:32 -08:00
ishaan-jaff	db146bc40a	(test) router with fallback deployments	2023-11-22 20:52:56 -08:00
Krrish Dholakia	5d5ca9f7ef	fix(router.py): add support for cooldowns with redis	2023-11-22 19:54:22 -08:00
Krrish Dholakia	3e76d4b422	feat(router.py): add server cooldown logic	2023-11-22 15:59:48 -08:00
Krrish Dholakia	10fe16c965	fix(utils.py): add param mapping for perplexity, anyscale, deepinfra ... n n	2023-11-22 10:04:27 -08:00
Krrish Dholakia	76f46902ed	feat(router.py): adding latency-based routing strategy	2023-11-21 21:19:27 -08:00
Krrish Dholakia	478bd7def6	fix(router.py): introducing usage-based-routing	2023-11-17 17:56:26 -08:00
Krrish Dholakia	a99efc544e	fix(test_router.py): catch timeouts	2023-11-17 15:56:06 -08:00
Krrish Dholakia	0ab6b2451d	fix(acompletion): support client side timeouts + raise exceptions correctly for async calls	2023-11-17 15:39:47 -08:00
Krrish Dholakia	59eaeba92a	fix(router.py): enabling retrying with expo backoff (without tenacity) for router	2023-11-14 20:57:51 -08:00
Krrish Dholakia	a7222f257c	fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors	2023-11-14 16:26:05 -08:00
Krrish Dholakia	c6ce3fedcd	fix(main.py): fix caching for router	2023-11-11 17:45:23 -08:00
Krrish Dholakia	40edb546dc	test(test_streaming.py): set cache to none	2023-11-10 15:04:01 -08:00
Krrish Dholakia	18a8bd5543	fix(utils.py): return function call as part of response object	2023-11-10 11:02:10 -08:00
Krrish Dholakia	a4c9e6bd46	fix(utils.py): fix cached responses - translate dict to objects	2023-11-10 10:38:20 -08:00
ishaan-jaff	b8ebab5d4f	(test) router functionality	2023-11-08 09:48:48 -08:00
Krrish Dholakia	6a45879932	bump: version 0.13.6.dev3 → 0.13.6	2023-11-06 18:19:20 -08:00
Krrish Dholakia	65c01eae23	fix(huggingface_restapi.py): output parsing chat template models	2023-11-06 11:43:12 -08:00
mc-marcocheng	bf98d48bba	Feature: Router aembedding	2023-10-25 11:19:45 +08:00
Krrish Dholakia	0f08335edd	fix(router.py): adding support for async completion calls ... https://github.com/BerriAI/litellm/issues/676	2023-10-24 17:20:31 -07:00
Krrish Dholakia	653863f787	test(test_router.py): fixing router testing	2023-10-24 10:21:10 -07:00
mc-marcocheng	3c28ff6167	test_litellm_params_not_overwritten_by_function_calling	2023-10-24 22:04:45 +08:00
mc-marcocheng	8dad2eec83	test_litellm_params_not_overwritten_by_function_calling	2023-10-24 22:03:04 +08:00
Krrish Dholakia	05740fed9d	fix(router.py): enable additional params to be passe din	2023-10-23 20:41:18 -07:00
Krrish Dholakia	04f8840a92	test: fix linting testing	2023-10-19 18:40:33 -07:00
Krrish Dholakia	e35562d188	fix(router.py): completing redis support work for router	2023-10-18 12:13:00 -07:00
Krrish Dholakia	b20cf3171b	feat(router.py): add routing capabilities for multiple deployments	2023-10-17 22:28:31 -07:00