Commit graph

4251 commits

Author SHA1 Message Date
ishaan-jaff
f32e55780a (ci/cd) add google-cloud-aiplatform 2023-12-07 10:21:09 -08:00
ishaan-jaff
e823e8d99e (test) add vertex ai to ci/cd 2023-12-07 10:20:21 -08:00
ishaan-jaff
d2eee342fb (feat) vertex ai - better debugging 2023-12-07 09:38:37 -08:00
ishaan-jaff
e9d93c624c (fix) vertex ai - streaming chunks 2023-12-07 09:38:37 -08:00
Krrish Dholakia
c7aaa4adf8 docs(deploy.md): add docker instructions to deploy docs 2023-12-07 09:22:54 -08:00
Krish Dholakia
ed07012874
Merge pull request #1042 from Manouchehri/patch-4
(pricing) Add Claude v2.1 for Bedrock
2023-12-06 23:53:51 -08:00
Krrish Dholakia
d18a5e8a11 docs(quick_start.md): adding langchain embedding tutorials to docs 2023-12-06 23:14:02 -08:00
Krrish Dholakia
8cc0e8e5c5 ci(pre-commit-config.yaml): adding mypy linting as a pre-commit hook 2023-12-06 22:57:14 -08:00
Krrish Dholakia
bd8d59e693 refactor(proxy_server.py): linting fix 2023-12-06 22:49:30 -08:00
Krrish Dholakia
e8f526e45f bump: version 1.11.0 → 1.11.1 2023-12-06 22:47:01 -08:00
Krrish Dholakia
6fae3fde22 test(test_embeddings.py): improve testing for titan embeddings 2023-12-06 22:47:01 -08:00
Krrish Dholakia
c1e95740b0 fix(bedrock.py): fix output format for cohere embeddings 2023-12-06 22:47:01 -08:00
David Manouchehri
f1779ff4c8
(pricing) Fix Claude on Bedrock prices 2023-12-07 01:19:59 -05:00
David Manouchehri
a4c79fd116
(pricing) Add Claude v2.1 for Bedrock 2023-12-07 01:12:25 -05:00
ishaan-jaff
7ddc0dad24 (test) fix test_model_group_aliases 2023-12-06 21:25:30 -08:00
ishaan-jaff
fa70b1f85b (test) unset model_group_alias_map after test 2023-12-06 20:35:14 -08:00
ishaan-jaff
7b389d10ca (linting) fix 2023-12-06 20:30:33 -08:00
ishaan-jaff
095aa94e71 (fix) linting 2023-12-06 20:26:57 -08:00
ishaan-jaff
900b8d66f3 (feat) proxy use model_group_alias_map 2023-12-06 20:23:24 -08:00
ishaan-jaff
ee70c4e822 (feat) router - add model_group_alias_map 2023-12-06 20:13:33 -08:00
Krrish Dholakia
9573123e2b bump: version 1.10.11 → 1.11.0 2023-12-06 19:50:09 -08:00
Krrish Dholakia
d3e179e5ad test: fix testing 2023-12-06 19:35:12 -08:00
Krrish Dholakia
ac7d0a1632 fix(together_ai.py): improve together ai custom prompt templating 2023-12-06 19:34:49 -08:00
ishaan-jaff
04eecaa493 (test) custom logger on fail 2023-12-06 19:15:08 -08:00
ishaan-jaff
f3469fdef8 (test) aembedding on custom logger 2023-12-06 19:09:06 -08:00
ishaan-jaff
7fcd17cbbe (feat) aembedding callback 2023-12-06 19:09:06 -08:00
ishaan-jaff
e3b24ec797 (feat) aembedding - add custom logging support 2023-12-06 19:09:06 -08:00
Krrish Dholakia
fff0228c20 fix(factory.py): support togethercomputer codellama pt 2023-12-06 19:02:58 -08:00
Krrish Dholakia
d4c6cc3920 test: fix testing 2023-12-06 18:52:49 -08:00
Krrish Dholakia
c0eedf28fc test: fix proxy server testing 2023-12-06 18:38:53 -08:00
ishaan-jaff
19b1deb200 (feat) proxy: protect health endpoint 2023-12-06 18:14:54 -08:00
ishaan-jaff
1b43c7120c (test) custom logger - check kwargs passed all the way 2023-12-06 18:08:48 -08:00
Krrish Dholakia
0295509b3b fix(factory.py): fix claude 2.1 prompt template to handle system, assistant, user prompt 2023-12-06 18:02:06 -08:00
ishaan-jaff
c8c45ef9c4 (test) async custom logger 2023-12-06 17:53:06 -08:00
Krrish Dholakia
45b4140615 test: fix config import for proxy testing 2023-12-06 17:40:38 -08:00
Krrish Dholakia
c789865c87 fix(langfuse.py): metadata none error 2023-12-06 17:24:59 -08:00
ishaan-jaff
8cd9f18b61 (docs) add async success + fail custom logger 2023-12-06 17:24:39 -08:00
Krrish Dholakia
d814184bc3 test: fix test imports 2023-12-06 17:21:47 -08:00
Krrish Dholakia
d2de7ffe27 test(test_proxy_server_langfuse.py): add langfuse proxy testing 2023-12-06 17:19:17 -08:00
ishaan-jaff
b60dc20f4b (fix) proxy edit custom logger 2023-12-06 17:16:24 -08:00
ishaan-jaff
8adbf35623 (feat) add async loggers under custom logger 2023-12-06 17:16:24 -08:00
ishaan-jaff
b482b9002c (feat) Custom_logger add async success & async failure 2023-12-06 17:16:24 -08:00
ishaan-jaff
1bac052eca (fix) proxy use async logging 2023-12-06 17:16:24 -08:00
ishaan-jaff
dfb30d38fa (feat) proxy print set callbacks 2023-12-06 17:16:24 -08:00
Krrish Dholakia
58848841e1 fix(proxy_server.py): make headers json serializable 2023-12-06 17:09:02 -08:00
Krrish Dholakia
51492125b5 test: skip flaky test 2023-12-06 16:50:02 -08:00
Krrish Dholakia
caac4f1779 docs(virtual_keys.md): fix import line 2023-12-06 15:12:23 -08:00
Krrish Dholakia
ad922b205b fix(proxy_server.py): enable rate limiting concurrent user requests 2023-12-06 15:11:05 -08:00
ishaan-jaff
cf1df8204e (docs) proxy - custom async func 2023-12-06 15:04:24 -08:00
ishaan-jaff
0ea6241d3e (docs) use async callback functions 2023-12-06 15:00:16 -08:00