79 commits

Author	SHA1	Message	Date
Krrish Dholakia	2cea8b0e83	fix(router.py): periodically re-initialize azure/openai clients to solve max conn issue	2023-12-30 15:48:34 +05:30
Krrish Dholakia	79978c44ba	refactor: add black formatting	2023-12-25 14:11:20 +05:30
Krrish Dholakia	158325497d	feat(proxy_server.py): add new images/generation endpoint	2023-12-21 15:39:09 +05:30
Krrish Dholakia	c084f04a35	fix(router.py): add support for async image generation endpoints	2023-12-21 14:38:44 +05:30
Krrish Dholakia	b873833340	fix(router.py): only do sync image gen fallbacks for now ... The customhttptransport we use for dall-e-2 only works for sync httpx calls, not async. Will need to spend some time writing the async version n	2023-12-20 19:10:59 +05:30
Krrish Dholakia	89b808d767	feat(router.py): support async image generation on router	2023-12-20 17:24:20 +05:30
Krrish Dholakia	0a20b92c12	refactor(test_router_caching.py): add tests for router caching	2023-12-15 20:38:51 -08:00
Krrish Dholakia	6081602bf8	fix(router.py): support openai-compatible endpoints	2023-12-15 14:47:54 -08:00
ishaan-jaff	b8d51ee3ab	(test) router - acompletion + cache	2023-12-14 19:46:56 +05:30
Krrish Dholakia	fa74447cc8	test: testing fixes	2023-12-12 10:57:51 -08:00
Krrish Dholakia	bbf094dcf5	fix(router.py): reset caching correctly	2023-12-11 19:57:34 -08:00
ishaan-jaff	96c0f1495b	(test) router + caching	2023-12-09 15:41:36 -08:00
ishaan-jaff	db750475c3	(test) async completion + caching on router	2023-12-09 14:25:38 -08:00
Krrish Dholakia	f5dbddef39	test(test_router.py): fix init issue	2023-12-09 12:28:51 -08:00
Krrish Dholakia	3f045501c2	test(test_router.py): run as asyncio.run	2023-12-09 12:28:28 -08:00
Krrish Dholakia	a65c8919fc	fix(router.py): fix least-busy routing	2023-12-08 20:29:49 -08:00
Krrish Dholakia	461788636f	test: test_router.py ... fix router testing n	2023-12-07 20:10:36 -08:00
ishaan-jaff	f5d9eb773e	(test) router - read os.environ/ OpenAI	2023-12-06 10:56:27 -08:00
ishaan-jaff	dd474dfb5a	(chore) linting fix	2023-12-06 10:48:01 -08:00
ishaan-jaff	52a95a755e	(test) router - set sync stream client	2023-12-06 10:08:37 -08:00
ishaan-jaff	179db2a1a7	(test) router - reading os.environ/ with client	2023-12-06 09:26:21 -08:00
ishaan-jaff	7b88420223	(test) router - reading os.environ/ variables	2023-12-06 09:19:51 -08:00
ishaan-jaff	1fd1396f06	(test) router - explcitly call one deployment	2023-12-05 21:57:00 -08:00
ishaan-jaff	e851892dcb	(test) router: call 1 deployment	2023-12-05 17:35:35 -08:00
ishaan-jaff	66dc4784d2	(chore) linting fix	2023-12-05 17:29:09 -08:00
ishaan-jaff	7bee766b65	(test) call 1 deployment on router	2023-12-05 16:56:38 -08:00
ishaan-jaff	8b9206ae51	(test) router: test async embedding + embedding	2023-12-05 14:28:23 -08:00
ishaan-jaff	a1ac6aad8d	(test) router: openai async, sync, stream, no stream	2023-12-05 14:21:37 -08:00
ishaan-jaff	e9ae3234e4	(test) router: add tests for azure completion, acompletion	2023-12-05 13:59:27 -08:00
ishaan-jaff	842c91ee31	(test) azure - test async + sync embedding	2023-12-05 13:35:05 -08:00
ishaan-jaff	1622a3e4fa	(test) router Azure regular chat completion call	2023-12-05 13:28:07 -08:00
ishaan-jaff	0729770390	(test) Router: Test Azure acompletion, stream	2023-12-05 13:22:27 -08:00
ishaan-jaff	0b3ea42af9	(test) router streaming + azure	2023-12-05 12:54:00 -08:00
ishaan-jaff	8759a2f463	(test) test bedrock on router	2023-12-05 09:35:08 -08:00
ishaan-jaff	cf9f3d0005	(fix) router: azure/embedding support	2023-11-29 19:06:36 -08:00
ishaan-jaff	54678d5f9c	(test) router:get_available_deployment	2023-11-29 17:54:41 -08:00
ishaan-jaff	871614c154	(test) test weighted selection router	2023-11-29 17:30:18 -08:00
Krrish Dholakia	32a14e6cf0	fix(router.py): removing model id before making call	2023-11-28 10:09:45 -08:00
Krrish Dholakia	2b9c5bf706	fix(router.py): check if fallbacks is none	2023-11-25 14:58:07 -08:00
Krrish Dholakia	9618718080	test: refactor testing order	2023-11-24 12:47:28 -08:00
Krrish Dholakia	d17a19cb0a	test(test_router.py): reintegrate router testing	2023-11-24 11:48:24 -08:00
Krrish Dholakia	e3766b01a0	test(test_stream_chunk_builder.py): fix setting api key	2023-11-24 11:47:48 -08:00
Krrish Dholakia	5a9a3aa89c	fix(main.py): fix streaming_chunk_builder to return usage	2023-11-24 11:27:04 -08:00
ishaan-jaff	f41683011a	(test) router: acompletion + caching	2023-11-23 21:05:48 -08:00
Krrish Dholakia	3a8d7ec835	fix(router.py): add modelgroup to call metadata	2023-11-23 20:55:49 -08:00
ishaan-jaff	b6fe6b2839	(test) temp comment router to test ci/cd	2023-11-23 20:28:43 -08:00
Krrish Dholakia	1b26a0931e	fix(utils.py): make failure logging sync	2023-11-23 20:19:27 -08:00
ishaan-jaff	7fda40e2be	(test) testing fix	2023-11-23 17:20:22 -08:00
ishaan-jaff	b2bde6ef56	(test) router: raises exception	2023-11-23 17:09:36 -08:00
ishaan-jaff	f1df76e55e	(test) router: azure pass key in model list	2023-11-23 16:51:52 -08:00