Commit graph

4260 commits

Author SHA1 Message Date
Krrish Dholakia
d77e0cc716 docs(config.md): adding docs on parallel request rate limiting 2023-12-07 11:27:48 -08:00
ishaan-jaff
077f6b1298 (ci/cd) vertex ai 2023-12-07 11:19:29 -08:00
ishaan-jaff
90d474ff21 (ci/cd) vertex ai 2023-12-07 10:50:58 -08:00
ishaan-jaff
85668ff415 (ci/cd) vertex ai 2023-12-07 10:44:45 -08:00
ishaan-jaff
8dd6786123 (ci/cd) vertex ai 2023-12-07 10:39:24 -08:00
ishaan-jaff
0f8225c3eb (ci/cd) use relative path for vertex 2023-12-07 10:38:06 -08:00
ishaan-jaff
378f211a29 (ci/cd) debugging 2023-12-07 10:36:58 -08:00
ishaan-jaff
01c7dc197a (ci/cd) vertex ai 2023-12-07 10:31:32 -08:00
ishaan-jaff
a2b89b212c (ci/cd) pip install google-cloud-aiplatform 2023-12-07 10:30:29 -08:00
ishaan-jaff
f32e55780a (ci/cd) add google-cloud-aiplatform 2023-12-07 10:21:09 -08:00
ishaan-jaff
e823e8d99e (test) add vertex ai to ci/cd 2023-12-07 10:20:21 -08:00
ishaan-jaff
d2eee342fb (feat) vertex ai - better debugging 2023-12-07 09:38:37 -08:00
ishaan-jaff
e9d93c624c (fix) vertex ai - streaming chunks 2023-12-07 09:38:37 -08:00
Krrish Dholakia
c7aaa4adf8 docs(deploy.md): add docker instructions to deploy docs 2023-12-07 09:22:54 -08:00
Krish Dholakia
ed07012874
Merge pull request #1042 from Manouchehri/patch-4
(pricing) Add Claude v2.1 for Bedrock
2023-12-06 23:53:51 -08:00
Krrish Dholakia
d18a5e8a11 docs(quick_start.md): adding langchain embedding tutorials to docs 2023-12-06 23:14:02 -08:00
Krrish Dholakia
8cc0e8e5c5 ci(pre-commit-config.yaml): adding mypy linting as a pre-commit hook 2023-12-06 22:57:14 -08:00
Krrish Dholakia
bd8d59e693 refactor(proxy_server.py): linting fix 2023-12-06 22:49:30 -08:00
Krrish Dholakia
e8f526e45f bump: version 1.11.0 → 1.11.1 2023-12-06 22:47:01 -08:00
Krrish Dholakia
6fae3fde22 test(test_embeddings.py): improve testing for titan embeddings 2023-12-06 22:47:01 -08:00
Krrish Dholakia
c1e95740b0 fix(bedrock.py): fix output format for cohere embeddings 2023-12-06 22:47:01 -08:00
David Manouchehri
f1779ff4c8
(pricing) Fix Claude on Bedrock prices 2023-12-07 01:19:59 -05:00
David Manouchehri
a4c79fd116
(pricing) Add Claude v2.1 for Bedrock 2023-12-07 01:12:25 -05:00
ishaan-jaff
7ddc0dad24 (test) fix test_model_group_aliases 2023-12-06 21:25:30 -08:00
ishaan-jaff
fa70b1f85b (test) unset model_group_alias_map after test 2023-12-06 20:35:14 -08:00
ishaan-jaff
7b389d10ca (linting) fix 2023-12-06 20:30:33 -08:00
ishaan-jaff
095aa94e71 (fix) linting 2023-12-06 20:26:57 -08:00
ishaan-jaff
900b8d66f3 (feat) proxy use model_group_alias_map 2023-12-06 20:23:24 -08:00
ishaan-jaff
ee70c4e822 (feat) router - add model_group_alias_map 2023-12-06 20:13:33 -08:00
Krrish Dholakia
9573123e2b bump: version 1.10.11 → 1.11.0 2023-12-06 19:50:09 -08:00
Krrish Dholakia
d3e179e5ad test: fix testing 2023-12-06 19:35:12 -08:00
Krrish Dholakia
ac7d0a1632 fix(together_ai.py): improve together ai custom prompt templating 2023-12-06 19:34:49 -08:00
ishaan-jaff
04eecaa493 (test) custom logger on fail 2023-12-06 19:15:08 -08:00
ishaan-jaff
f3469fdef8 (test) aembedding on custom logger 2023-12-06 19:09:06 -08:00
ishaan-jaff
7fcd17cbbe (feat) aembedding callback 2023-12-06 19:09:06 -08:00
ishaan-jaff
e3b24ec797 (feat) aembedding - add custom logging support 2023-12-06 19:09:06 -08:00
Krrish Dholakia
fff0228c20 fix(factory.py): support togethercomputer codellama pt 2023-12-06 19:02:58 -08:00
Krrish Dholakia
d4c6cc3920 test: fix testing 2023-12-06 18:52:49 -08:00
Krrish Dholakia
c0eedf28fc test: fix proxy server testing 2023-12-06 18:38:53 -08:00
ishaan-jaff
19b1deb200 (feat) proxy: protect health endpoint 2023-12-06 18:14:54 -08:00
ishaan-jaff
1b43c7120c (test) custom logger - check kwargs passed all the way 2023-12-06 18:08:48 -08:00
Krrish Dholakia
0295509b3b fix(factory.py): fix claude 2.1 prompt template to handle system, assistant, user prompt 2023-12-06 18:02:06 -08:00
ishaan-jaff
c8c45ef9c4 (test) async custom logger 2023-12-06 17:53:06 -08:00
Krrish Dholakia
45b4140615 test: fix config import for proxy testing 2023-12-06 17:40:38 -08:00
Krrish Dholakia
c789865c87 fix(langfuse.py): metadata none error 2023-12-06 17:24:59 -08:00
ishaan-jaff
8cd9f18b61 (docs) add async success + fail custom logger 2023-12-06 17:24:39 -08:00
Krrish Dholakia
d814184bc3 test: fix test imports 2023-12-06 17:21:47 -08:00
Krrish Dholakia
d2de7ffe27 test(test_proxy_server_langfuse.py): add langfuse proxy testing 2023-12-06 17:19:17 -08:00
ishaan-jaff
b60dc20f4b (fix) proxy edit custom logger 2023-12-06 17:16:24 -08:00
ishaan-jaff
8adbf35623 (feat) add async loggers under custom logger 2023-12-06 17:16:24 -08:00