21 commits

Author	SHA1	Message	Date
Krrish Dholakia	cf0a9f591c	fix(router.py): introducing usage-based-routing	2023-11-17 17:56:26 -08:00
Krrish Dholakia	237e6a4c32	fix(test_router.py): catch timeouts	2023-11-17 15:56:06 -08:00
Krrish Dholakia	02ed97d0b2	fix(acompletion): support client side timeouts + raise exceptions correctly for async calls	2023-11-17 15:39:47 -08:00
Krrish Dholakia	0f6713993d	fix(router.py): enabling retrying with expo backoff (without tenacity) for router	2023-11-14 20:57:51 -08:00
Krrish Dholakia	9b582b2c85	fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors	2023-11-14 16:26:05 -08:00
Krrish Dholakia	e7d1840d5f	fix(main.py): fix caching for router	2023-11-11 17:45:23 -08:00
Krrish Dholakia	4c103592e3	test(test_streaming.py): set cache to none	2023-11-10 15:04:01 -08:00
Krrish Dholakia	548605def8	fix(utils.py): return function call as part of response object	2023-11-10 11:02:10 -08:00
Krrish Dholakia	67e8b12a09	fix(utils.py): fix cached responses - translate dict to objects	2023-11-10 10:38:20 -08:00
ishaan-jaff	6d85d6486b	(test) router functionality	2023-11-08 09:48:48 -08:00
Krrish Dholakia	632533f2e2	bump: version 0.13.6.dev3 → 0.13.6	2023-11-06 18:19:20 -08:00
Krrish Dholakia	9baafd7dbf	fix(huggingface_restapi.py): output parsing chat template models	2023-11-06 11:43:12 -08:00
mc-marcocheng	bd43b96d8d	Feature: Router aembedding	2023-10-25 11:19:45 +08:00
Krrish Dholakia	3477486886	fix(router.py): adding support for async completion calls ... https://github.com/BerriAI/litellm/issues/676	2023-10-24 17:20:31 -07:00
Krrish Dholakia	c7e8bf3e80	test(test_router.py): fixing router testing	2023-10-24 10:21:10 -07:00
mc-marcocheng	c098d4a531	test_litellm_params_not_overwritten_by_function_calling	2023-10-24 22:04:45 +08:00
mc-marcocheng	b54d0ffe18	test_litellm_params_not_overwritten_by_function_calling	2023-10-24 22:03:04 +08:00
Krrish Dholakia	0aad58cf48	fix(router.py): enable additional params to be passe din	2023-10-23 20:41:18 -07:00
Krrish Dholakia	494b9bbc62	test: fix linting testing	2023-10-19 18:40:33 -07:00
Krrish Dholakia	204218508d	fix(router.py): completing redis support work for router	2023-10-18 12:13:00 -07:00
Krrish Dholakia	f23431fdc4	feat(router.py): add routing capabilities for multiple deployments	2023-10-17 22:28:31 -07:00