494 commits

Author	SHA1	Message	Date
ishaan-jaff	48a5ed621f	clean up azure implementation	2023-09-05 15:31:59 -07:00
ishaan-jaff	54a77ec457	remove install_and_import remove petals	2023-09-05 15:06:24 -07:00
ishaan-jaff	5cbe7a941d	add completion types	2023-09-05 14:57:03 -07:00
Krrish Dholakia	aa5d44dccb	fixing linting errors	2023-09-05 14:52:57 -07:00
ishaan-jaff	144ce4ec59	types completion()	2023-09-05 14:49:53 -07:00
Krrish Dholakia	dd0a373424	test parallelism on circle ci	2023-09-05 14:47:50 -07:00
ishaan-jaff	d0d5ef505d	add types to completion()	2023-09-05 14:42:10 -07:00
Krrish Dholakia	4b98feec36	bump version	2023-09-05 14:30:03 -07:00
Krrish Dholakia	4661f3dab9	only use tgai's prompt template for llama2 instruct models	2023-09-05 12:25:52 -07:00
Krrish Dholakia	cc59328d32	adding support for custom prompt templates to together ai	2023-09-05 12:20:09 -07:00
Krrish Dholakia	090ec35a4d	prompt formatting for together ai llama2 models	2023-09-05 11:57:13 -07:00
Krrish Dholakia	51b64c59f3	update streaming docs to show it working for async completion calls	2023-09-05 09:18:37 -07:00
Krrish Dholakia	d99b544a5a	update init with comments	2023-09-05 09:14:57 -07:00
Krrish Dholakia	548b419005	test async streaming	2023-09-04 15:42:24 -07:00
ishaan-jaff	db4f4c0191	baseten client mapping	2023-09-04 15:41:37 -07:00
Krrish Dholakia	3147bf1d99	fix linting errors	2023-09-04 15:16:13 -07:00
ishaan-jaff	b8b7d9bf44	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
Krrish Dholakia	5ae420317e	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
ishaan-jaff	c1fb3f19f5	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	493c89fcb3	bump version	2023-09-04 12:44:20 -07:00
ishaan-jaff	f5931a7235	v0 bedrock support	2023-09-04 12:40:40 -07:00
ishaan-jaff	262022f8e5	boto3 testing + docs	2023-09-04 12:14:24 -07:00
ishaan-jaff	f156733ed3	allow users to set AWS_REGION_NAME	2023-09-04 11:57:22 -07:00
Krrish Dholakia	57dcd1fee9	update exception mapping and get model cost map	2023-09-04 11:53:20 -07:00
ishaan-jaff	44f44ad5a3	add optional params for llama-2	2023-09-04 11:41:20 -07:00
ishaan-jaff	746001e32a	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	022c632ce4	v0 add sagemaker	2023-09-04 11:02:20 -07:00
ishaan-jaff	c0c499f7db	clean out AI21 Init Client calls	2023-09-04 10:08:53 -07:00
ishaan-jaff	31ebbf5208	remove init for together_ai completion calls	2023-09-04 09:59:24 -07:00
ishaan-jaff	66ca76928e	[temp] remove cache streaming flaky test	2023-09-04 09:50:45 -07:00
ishaan-jaff	898df9a9d3	remove init AnthropicClient for completion calls	2023-09-04 09:34:15 -07:00
yujong-lee	74c89c123a	Remove print	2023-09-03 17:47:36 +09:00
ishaan-jaff	3bea810d7c	bump version	2023-09-02 22:01:49 -07:00
ishaan-jaff	67d881acb4	thread safe azure	2023-09-02 18:05:05 -07:00
ishaan-jaff	96fce0a880	thread safe version, key and base for openai	2023-09-02 17:49:26 -07:00
ishaan-jaff	c08479d5ed	make api base thread safe	2023-09-02 17:41:59 -07:00
ishaan-jaff	4a994dc498	use api_base instead of custom_api_base	2023-09-02 17:11:30 -07:00
ishaan-jaff	bd0a118552	test without id	2023-09-02 16:54:04 -07:00
ishaan-jaff	ff69377d0f	fix embedding call	2023-09-02 16:48:33 -07:00
Krrish Dholakia	a07251a514	fix azure streaming	2023-09-02 16:10:19 -07:00
Krrish Dholakia	78cd8d6e27	update to logging	2023-09-02 15:45:45 -07:00
Krrish Dholakia	669b4bd08d	remove token	2023-09-02 15:24:18 -07:00
Krrish Dholakia	b0b2b58fc6	update split test logic	2023-09-02 14:32:18 -07:00
Krrish Dholakia	a972676655	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
Krrish Dholakia	5cd84b709e	fix streaming cache logic	2023-09-01 16:56:07 -07:00
Krrish Dholakia	4985f41fa9	updates to testing	2023-09-01 16:38:11 -07:00
Krrish Dholakia	234556b79b	circle ci please don't fail	2023-09-01 16:27:39 -07:00
Krrish Dholakia	a2c76eb614	update to litedebugger testing	2023-09-01 16:13:45 -07:00
Krrish Dholakia	deb2f89a49	updates to tests	2023-09-01 16:01:28 -07:00
Krrish Dholakia	e80fc6a7cd	fix linting error	2023-09-01 15:47:53 -07:00