3232 commits

Author	SHA1	Message	Date
ishaan-jaff	0354d6d48f	(ci/cd) vertex test	2023-12-07 12:41:39 -08:00
ishaan-jaff	19f1035f5a	(ci/cd) vertex ai testing	2023-12-07 11:36:20 -08:00
Krrish Dholakia	d77e0cc716	docs(config.md): adding docs on parallel request rate limiting	2023-12-07 11:27:48 -08:00
ishaan-jaff	077f6b1298	(ci/cd) vertex ai	2023-12-07 11:19:29 -08:00
James4Ever0	69fc2694bb	Update factory.py ... Fixing issue when calling from write-the -> langchain -> litellm served ollama	2023-12-08 02:58:28 +08:00
ishaan-jaff	90d474ff21	(ci/cd) vertex ai	2023-12-07 10:50:58 -08:00
ishaan-jaff	85668ff415	(ci/cd) vertex ai	2023-12-07 10:44:45 -08:00
ishaan-jaff	8dd6786123	(ci/cd) vertex ai	2023-12-07 10:39:24 -08:00
ishaan-jaff	0f8225c3eb	(ci/cd) use relative path for vertex	2023-12-07 10:38:06 -08:00
ishaan-jaff	378f211a29	(ci/cd) debugging	2023-12-07 10:36:58 -08:00
ishaan-jaff	01c7dc197a	(ci/cd) vertex ai	2023-12-07 10:31:32 -08:00
ishaan-jaff	e823e8d99e	(test) add vertex ai to ci/cd	2023-12-07 10:20:21 -08:00
ishaan-jaff	d2eee342fb	(feat) vertex ai - better debugging	2023-12-07 09:38:37 -08:00
ishaan-jaff	e9d93c624c	(fix) vertex ai - streaming chunks	2023-12-07 09:38:37 -08:00
Krrish Dholakia	c7aaa4adf8	docs(deploy.md): add docker instructions to deploy docs	2023-12-07 09:22:54 -08:00
Krrish Dholakia	8cc0e8e5c5	ci(pre-commit-config.yaml): adding mypy linting as a pre-commit hook	2023-12-06 22:57:14 -08:00
Krrish Dholakia	bd8d59e693	refactor(proxy_server.py): linting fix	2023-12-06 22:49:30 -08:00
Krrish Dholakia	6fae3fde22	test(test_embeddings.py): improve testing for titan embeddings	2023-12-06 22:47:01 -08:00
Krrish Dholakia	c1e95740b0	fix(bedrock.py): fix output format for cohere embeddings	2023-12-06 22:47:01 -08:00
ishaan-jaff	7ddc0dad24	(test) fix test_model_group_aliases	2023-12-06 21:25:30 -08:00
ishaan-jaff	fa70b1f85b	(test) unset model_group_alias_map after test	2023-12-06 20:35:14 -08:00
ishaan-jaff	7b389d10ca	(linting) fix	2023-12-06 20:30:33 -08:00
ishaan-jaff	095aa94e71	(fix) linting	2023-12-06 20:26:57 -08:00
ishaan-jaff	900b8d66f3	(feat) proxy use model_group_alias_map	2023-12-06 20:23:24 -08:00
ishaan-jaff	ee70c4e822	(feat) router - add model_group_alias_map	2023-12-06 20:13:33 -08:00
Krrish Dholakia	d3e179e5ad	test: fix testing	2023-12-06 19:35:12 -08:00
Krrish Dholakia	ac7d0a1632	fix(together_ai.py): improve together ai custom prompt templating	2023-12-06 19:34:49 -08:00
ishaan-jaff	04eecaa493	(test) custom logger on fail	2023-12-06 19:15:08 -08:00
ishaan-jaff	f3469fdef8	(test) aembedding on custom logger	2023-12-06 19:09:06 -08:00
ishaan-jaff	7fcd17cbbe	(feat) aembedding callback	2023-12-06 19:09:06 -08:00
ishaan-jaff	e3b24ec797	(feat) aembedding - add custom logging support	2023-12-06 19:09:06 -08:00
Krrish Dholakia	fff0228c20	fix(factory.py): support togethercomputer codellama pt	2023-12-06 19:02:58 -08:00
Krrish Dholakia	d4c6cc3920	test: fix testing	2023-12-06 18:52:49 -08:00
Krrish Dholakia	c0eedf28fc	test: fix proxy server testing	2023-12-06 18:38:53 -08:00
ishaan-jaff	19b1deb200	(feat) proxy: protect health endpoint	2023-12-06 18:14:54 -08:00
ishaan-jaff	1b43c7120c	(test) custom logger - check kwargs passed all the way	2023-12-06 18:08:48 -08:00
Krrish Dholakia	0295509b3b	fix(factory.py): fix claude 2.1 prompt template to handle system, assistant, user prompt	2023-12-06 18:02:06 -08:00
ishaan-jaff	c8c45ef9c4	(test) async custom logger	2023-12-06 17:53:06 -08:00
Krrish Dholakia	45b4140615	test: fix config import for proxy testing	2023-12-06 17:40:38 -08:00
Krrish Dholakia	c789865c87	fix(langfuse.py): metadata none error	2023-12-06 17:24:59 -08:00
Krrish Dholakia	d814184bc3	test: fix test imports	2023-12-06 17:21:47 -08:00
Krrish Dholakia	d2de7ffe27	test(test_proxy_server_langfuse.py): add langfuse proxy testing	2023-12-06 17:19:17 -08:00
ishaan-jaff	b60dc20f4b	(fix) proxy edit custom logger	2023-12-06 17:16:24 -08:00
ishaan-jaff	8adbf35623	(feat) add async loggers under custom logger	2023-12-06 17:16:24 -08:00
ishaan-jaff	b482b9002c	(feat) Custom_logger add async success & async failure	2023-12-06 17:16:24 -08:00
ishaan-jaff	1bac052eca	(fix) proxy use async logging	2023-12-06 17:16:24 -08:00
ishaan-jaff	dfb30d38fa	(feat) proxy print set callbacks	2023-12-06 17:16:24 -08:00
Krrish Dholakia	58848841e1	fix(proxy_server.py): make headers json serializable	2023-12-06 17:09:02 -08:00
Krrish Dholakia	51492125b5	test: skip flaky test	2023-12-06 16:50:02 -08:00
Krrish Dholakia	ad922b205b	fix(proxy_server.py): enable rate limiting concurrent user requests	2023-12-06 15:11:05 -08:00