Commit graph

84 commits

Author SHA1 Message Date
ishaan-jaff
b5f8d0f60d fix tg ai stream check 2023-08-17 10:49:48 -07:00
ishaan-jaff
a13d15755b fix text-003 bug 2023-08-17 10:48:23 -07:00
ishaan-jaff
9a31de520a fix tg ai streaming 2023-08-16 21:53:39 -07:00
ishaan-jaff
66492ecab7 working petals implementation 2023-08-15 14:02:29 -07:00
ishaan-jaff
1140010413 fix import baseten + petals test 2023-08-15 13:57:13 -07:00
ishaan-jaff
9ce2a42d0c add baseten support 2023-08-15 12:15:41 -07:00
ishaan-jaff
b2a02e99ce with petals 2023-08-15 10:42:00 -07:00
ishaan-jaff
33fbf3d701 fix request_timeout_extra arg 2023-08-14 19:57:11 -07:00
ishaan-jaff
a3adcde8cc ai21 models 2023-08-14 16:41:50 -07:00
Krrish Dholakia
e642483eaf adding support for meta-llama-2 2023-08-14 14:35:21 -07:00
ishaan-jaff
27c9cd0256 check if json has error 2023-08-14 11:41:12 -07:00
ishaan-jaff
6f1749ac9e with text-bison 2023-08-14 10:34:01 -07:00
Krrish Dholakia
fb07d6b389 error handling for huggingface endpoints 2023-08-14 10:21:59 -07:00
Krish Dholakia
e90aed6def Merge branch 'main' into multi-class-krrish 2023-08-12 17:47:37 -07:00
Krrish Dholakia
eb89d92e5b adding azure flag back - prevent regressions 2023-08-12 17:41:25 -07:00
Krrish Dholakia
1c909707ad added exception mapping to anthropic class 2023-08-12 17:39:11 -07:00
Krrish Dholakia
b96f7aff07 code cleanup 2023-08-12 17:12:57 -07:00
Krrish Dholakia
209d1e4e1e replacing individual provider flags with 'custom_llm_provider' 2023-08-12 16:40:36 -07:00
Krrish Dholakia
411ba6a827 adding anthropic llm class - handles sync + stream 2023-08-12 16:34:32 -07:00
ishaan-jaff
be44a9b6b6 ollama with streaming 2023-08-12 14:49:50 -07:00
Krrish Dholakia
8052b86de8 coverage for custom api scenario in load testing 2023-08-11 18:20:24 -07:00
Krrish Dholakia
386536ce88 add model load testing functionality 2023-08-11 17:59:51 -07:00
ishaan-jaff
ad56d3d032 add config 2023-08-11 10:18:13 -07:00
Krrish Dholakia
0dc9c2a4c3 update 2023-08-11 09:51:14 -07:00
Krrish Dholakia
7fac7111f8 update version 2023-08-10 19:20:28 -07:00
Krrish Dholakia
7908e43645 allowing dynamic api base to be set for openai 2023-08-10 18:40:35 -07:00
ishaan-jaff
6224589611 add vertex AI 2023-08-10 18:37:25 -07:00
Krrish Dholakia
c2ecdf657f allow custom base to openai 2023-08-10 18:01:52 -07:00
Krrish Dholakia
91170fddcf code cleanup 2023-08-10 17:57:57 -07:00
Krrish Dholakia
6594bd8477 logging improvements 2023-08-10 17:40:17 -07:00
ishaan-jaff
8f38f61b76 add caching with chromDB - not a dependency 2023-08-10 13:21:06 -07:00
ishaan-jaff
ea34a26a65 add streaming for together-ai 2023-08-09 17:58:54 -07:00
ishaan-jaff
52848e78c6 add together-ai 2023-08-09 15:22:34 -07:00
ishaan-jaff
ab4fd34b01 fix OR test 2023-08-09 14:07:46 -07:00
Krish Dholakia
c4930f2ed5 Merge branch 'main' into main 2023-08-09 11:00:40 -07:00
ishaan-jaff
f4048886ab streaming replicate tests 2023-08-08 17:50:36 -07:00
ishaan-jaff
613df8942f add cohere streaming 2023-08-08 17:01:59 -07:00
ishaan-jaff
5040d08f79 fix anthropic streaming 2023-08-08 16:07:53 -07:00
ishaan-jaff
36a6ac9b08 streaming for anthropic 2023-08-08 15:57:24 -07:00
ishaan-jaff
a94dc9369f fix model response 2023-08-08 13:58:58 -07:00
ishaan-jaff
5c17f90173 add hf support 2023-08-08 13:35:37 -07:00
ishaan-jaff
3332cc2065 remove deps datalib, pytest, tenacity, infisical 2023-08-08 10:58:43 -07:00
ishaan-jaff
8e863120fe add import for co, anth 2023-08-08 10:46:20 -07:00
ishaan-jaff
03a43e158a add import manager - make package lighter 2023-08-08 10:37:41 -07:00
Zakhar Kogan
0a2ad8cea6 Added Openrouter support back 2023-08-08 08:22:03 +03:00
Krrish Dholakia
2bee550a69 fixing claude exception-mapping + set key bug 2023-08-07 12:07:33 -07:00
Krrish Dholakia
46fe03120e code cleanup 2023-08-07 10:44:04 -07:00
Krrish Dholakia
9a3211e5bf fixing azure bug 2023-08-05 22:39:00 -07:00
Krrish Dholakia
1761b6ca0d pass in org id 2023-08-05 22:13:36 -07:00
Krrish Dholakia
8c5118cae6 expose api_version 2023-08-05 21:57:12 -07:00