Commit graph

52 commits

Author SHA1 Message Date
Krrish Dholakia
512769e841 support n param for hf 2023-10-03 07:10:13 -07:00
Krrish Dholakia
0daf2e3880 fixes to get optional params 2023-10-02 14:44:11 -07:00
Krrish Dholakia
5ee4d10656 fix streaming test 2023-09-30 15:59:27 -07:00
Krrish Dholakia
16c755257b add support for custom hf prompt templates 2023-09-30 15:37:30 -07:00
Krrish Dholakia
905a3f08ee fix streaming tests 2023-09-29 22:41:04 -07:00
Krrish Dholakia
e8ec3e8795 add mistral prompt templating 2023-09-29 21:41:28 -07:00
ishaan-jaff
b5299d946d flaky bedrock test 2023-09-28 20:09:19 -07:00
ishaan-jaff
de6493afa0 flaky bedrock streaming test 2023-09-28 20:06:10 -07:00
ishaan-jaff
a364b36f9e new test for deep infra 2023-09-26 13:15:39 -07:00
ishaan-jaff
6dfe3febf4 add palm stream testing 2023-09-26 12:32:59 -07:00
Krrish Dholakia
5ec84059d9 bump version and fix testing issue 2023-09-23 23:07:41 -07:00
Krrish Dholakia
667242889f bump versions 2023-09-23 22:32:20 -07:00
Krrish Dholakia
5dbbfe2f7e fix linting bugs 2023-09-23 22:23:41 -07:00
Krrish Dholakia
889679a0dd fix exception mapping for streaming 2023-09-23 15:04:59 -07:00
Krrish Dholakia
633e36de42 handle llama 2 eos tokens in streaming 2023-09-18 13:44:19 -07:00
Krrish Dholakia
66a3c59ebe bump pyproject version 2023-09-16 20:45:16 -07:00
Krrish Dholakia
d2f8a7b2ae bug fixes 2023-09-16 16:32:12 -07:00
Krrish Dholakia
122c993e6f except custom openai proxy 2023-09-16 16:15:44 -07:00
Krrish Dholakia
15bc5f2bdc check function call + streaming format 2023-09-16 13:31:18 -07:00
Krrish Dholakia
265f966cab bump version and fix testing 2023-09-16 13:04:59 -07:00
Krrish Dholakia
01978c6ec1 bump version 2023-09-16 12:28:57 -07:00
Krrish Dholakia
ce827faa93 fixes to testing 2023-09-16 11:40:01 -07:00
ishaan-jaff
09d63a6e73 add extensive oi test 2023-09-16 11:27:22 -07:00
Krrish Dholakia
8a3844692c moving open interpreter tests 2023-09-16 11:04:35 -07:00
Krrish Dholakia
5470bc6fd0 improvements to streaming 2023-09-16 11:02:06 -07:00
Krrish Dholakia
21cd55ab26 ensure streaming format is exactly the same as openai 2023-09-16 10:35:20 -07:00
Krrish Dholakia
e1c1493db2 update testing 2023-09-15 17:32:10 -07:00
Krrish Dholakia
5b38f04524 fixes to streaming 2023-09-15 17:23:10 -07:00
Krrish Dholakia
7b19d62564 streaming fixes 2023-09-15 15:49:20 -07:00
Krrish Dholakia
34c676a8ec fix streaming error 2023-09-15 15:21:15 -07:00
Krrish Dholakia
46e86b7433 fixes to streaming 2023-09-14 19:27:12 -07:00
Krrish Dholakia
0b436cf767 fix streaming objects 2023-09-14 17:16:43 -07:00
Krrish Dholakia
3b4064a58f move cohere to http endpoint 2023-09-14 11:17:38 -07:00
Krrish Dholakia
b1fbe515fe return model name as part of streaming object 2023-09-13 09:48:49 -07:00
Krrish Dholakia
dc130efac6 update streaming docs to show it working for async completion calls 2023-09-05 09:18:37 -07:00
Krrish Dholakia
e2c143dfbc test async streaming 2023-09-04 15:42:24 -07:00
Krrish Dholakia
83b8af8567 adding support for aleph alpha 2023-09-02 13:15:41 -07:00
Krrish Dholakia
14d4c7ead2 update baseten handler to handle TGI calls 2023-08-30 19:14:48 -07:00
Krrish Dholakia
d542066d4b fixes to streaming for ai21, baseten, and openai text completions 2023-08-28 09:42:51 -07:00
ishaan-jaff
b713acb0a4 formatting improvements 2023-08-28 09:20:50 -07:00
Krrish Dholakia
60873abb41 further fixes to together ai streaming 2023-08-26 19:30:54 -07:00
Krrish Dholakia
bb3c2fefdb anthropic and together ai streaming no longer waits till completion to return response 2023-08-26 19:00:53 -07:00
Krrish Dholakia
0ac17646d9 fix anthropic streaming 2023-08-26 18:54:51 -07:00
Krrish Dholakia
9155ba068f fix anthropic and together ai streaming 2023-08-26 16:05:43 -07:00
ishaan-jaff
5a53909a0d fix linting tests 2023-08-26 11:56:52 -07:00
Krrish Dholakia
03d023e372 update testing for streaming to catch empty responses 2023-08-26 11:20:06 -07:00
Krrish Dholakia
9008973826 adding ability to turn off litedebugger but still use key manager 2023-08-26 11:03:40 -07:00
Krrish Dholakia
1192640fb9 show litedebugger for streaming objects 2023-08-26 10:28:27 -07:00
Krrish Dholakia
29daeddb41 updates 2023-08-21 15:16:58 -07:00
ishaan-jaff
15b1da9dc8 add linting 2023-08-18 11:05:05 -07:00