824 commits

Author	SHA1	Message	Date
ishaan-jaff	6f6594113a	add test cases for checking role in streaming reqs	2023-09-15 14:57:26 -07:00
ishaan-jaff	8b60203aa8	added vertex ai streaming	2023-09-15 14:15:09 -07:00
ishaan-jaff	595dd46dbc	tests	2023-09-15 13:38:26 -07:00
ishaan-jaff	8540919e84	testing update	2023-09-14 14:22:29 -07:00
ishaan-jaff	7740fe7dda	add bedrock tests	2023-09-14 14:15:32 -07:00
ishaan-jaff	8af63b6ab0	bedrock test	2023-09-14 13:51:09 -07:00
Krrish Dholakia	22fb574009	move cohere to http endpoint	2023-09-14 11:17:38 -07:00
Krrish Dholakia	bd01f70257	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
Krrish Dholakia	da781a7caf	fixes to testing	2023-09-14 06:49:12 -07:00
Krrish Dholakia	c0e3a47650	fix test completion	2023-09-13 21:29:19 -07:00
Krrish Dholakia	f9e4c71ea7	adding finish reason mapping for aleph alpha and baseten	2023-09-13 19:39:11 -07:00
Krrish Dholakia	3496bebdc5	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	f493779a97	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	bbd2e0413a	completion test cleanup	2023-09-11 18:39:16 -07:00
Krrish Dholakia	0defdc8634	work for hf inference endpoint	2023-09-11 18:37:55 -07:00
ishaan-jaff	11c9206138	bump version	2023-09-11 08:47:37 -07:00
ishaan-jaff	38cf7d9966	cache pip deps	2023-09-11 08:27:09 -07:00
ishaan-jaff	2659b76ba5	parallelism tests	2023-09-11 08:21:07 -07:00
ishaan-jaff	21d541c9dd	fix linting	2023-09-11 08:19:38 -07:00
ishaan-jaff	712e2d0f63	fix circle ci test	2023-09-11 08:14:04 -07:00
ishaan-jaff	ca02426b50	fix redis cache testing and add new test for azure	2023-09-11 08:01:02 -07:00
ishaan-jaff	8bbb47f112	test for litellm.api_key	2023-09-11 07:55:01 -07:00
ishaan-jaff	995b0b525e	add finish reason to streamed responses	2023-09-09 19:36:38 -07:00
ishaan-jaff	f996cfd425	tests	2023-09-09 15:47:38 -07:00
ishaan-jaff	3db4bd749c	bump v	2023-09-08 17:47:03 -07:00
ishaan-jaff	6d80384ea4	bump version to 0.1.564	2023-09-08 17:46:30 -07:00
ishaan-jaff	9eae0dac26	hosted vllm usage	2023-09-08 13:58:06 -07:00
ishaan-jaff	5a047d8b7a	fix:completion fails when client=True&no email set	2023-09-08 12:36:33 -07:00
ishaan-jaff	794672c839	bug fix - issue 277	2023-09-07 14:11:10 -07:00
ishaan-jaff	43f240ff42	allow users to pass custom timing for replicate	2023-09-06 18:32:40 -07:00
Krrish Dholakia	7290a972e5	adding support for vllm	2023-09-06 18:07:44 -07:00
Krrish Dholakia	021512c60f	update custom prompt template function	2023-09-06 13:14:36 -07:00
ishaan-jaff	99d3f8be81	add vicuna translation	2023-09-06 11:14:24 -07:00
ishaan-jaff	89ebdab2b3	add replicate support for max_tokens	2023-09-06 10:38:21 -07:00
ishaan-jaff	74e0e90620	add replicate streaming	2023-09-06 10:23:13 -07:00
ishaan-jaff	6fb01ec257	use replicate http requests instead	2023-09-06 09:43:05 -07:00
ishaan-jaff	2691559e24	fix timeouts + tests + bump v	2023-09-05 17:17:58 -07:00
ishaan-jaff	b4d1992b20	custom api base	2023-09-05 16:50:32 -07:00
ishaan-jaff	48a5ed621f	clean up azure implementation	2023-09-05 15:31:59 -07:00
Krrish Dholakia	dd0a373424	test parallelism on circle ci	2023-09-05 14:47:50 -07:00
Krrish Dholakia	4b98feec36	bump version	2023-09-05 14:30:03 -07:00
Krrish Dholakia	cc59328d32	adding support for custom prompt templates to together ai	2023-09-05 12:20:09 -07:00
Krrish Dholakia	090ec35a4d	prompt formatting for together ai llama2 models	2023-09-05 11:57:13 -07:00
ishaan-jaff	b8b7d9bf44	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
ishaan-jaff	c1fb3f19f5	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	493c89fcb3	bump version	2023-09-04 12:44:20 -07:00
ishaan-jaff	262022f8e5	boto3 testing + docs	2023-09-04 12:14:24 -07:00
ishaan-jaff	f156733ed3	allow users to set AWS_REGION_NAME	2023-09-04 11:57:22 -07:00
ishaan-jaff	44f44ad5a3	add optional params for llama-2	2023-09-04 11:41:20 -07:00
ishaan-jaff	746001e32a	working sagemaker support	2023-09-04 11:30:34 -07:00