265 commits

Author	SHA1	Message	Date
Krrish Dholakia	c0e3a47650	fix test completion	2023-09-13 21:29:19 -07:00
Krrish Dholakia	f9e4c71ea7	adding finish reason mapping for aleph alpha and baseten	2023-09-13 19:39:11 -07:00
Krrish Dholakia	3496bebdc5	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	f493779a97	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	bbd2e0413a	completion test cleanup	2023-09-11 18:39:16 -07:00
Krrish Dholakia	0defdc8634	work for hf inference endpoint	2023-09-11 18:37:55 -07:00
ishaan-jaff	11c9206138	bump version	2023-09-11 08:47:37 -07:00
ishaan-jaff	38cf7d9966	cache pip deps	2023-09-11 08:27:09 -07:00
ishaan-jaff	2659b76ba5	parallelism tests	2023-09-11 08:21:07 -07:00
ishaan-jaff	21d541c9dd	fix linting	2023-09-11 08:19:38 -07:00
ishaan-jaff	712e2d0f63	fix circle ci test	2023-09-11 08:14:04 -07:00
ishaan-jaff	ca02426b50	fix redis cache testing and add new test for azure	2023-09-11 08:01:02 -07:00
ishaan-jaff	8bbb47f112	test for litellm.api_key	2023-09-11 07:55:01 -07:00
ishaan-jaff	995b0b525e	add finish reason to streamed responses	2023-09-09 19:36:38 -07:00
ishaan-jaff	f996cfd425	tests	2023-09-09 15:47:38 -07:00
ishaan-jaff	3db4bd749c	bump v	2023-09-08 17:47:03 -07:00
ishaan-jaff	6d80384ea4	bump version to 0.1.564	2023-09-08 17:46:30 -07:00
ishaan-jaff	9eae0dac26	hosted vllm usage	2023-09-08 13:58:06 -07:00
ishaan-jaff	5a047d8b7a	fix:completion fails when client=True&no email set	2023-09-08 12:36:33 -07:00
ishaan-jaff	794672c839	bug fix - issue 277	2023-09-07 14:11:10 -07:00
ishaan-jaff	43f240ff42	allow users to pass custom timing for replicate	2023-09-06 18:32:40 -07:00
Krrish Dholakia	7290a972e5	adding support for vllm	2023-09-06 18:07:44 -07:00
Krrish Dholakia	021512c60f	update custom prompt template function	2023-09-06 13:14:36 -07:00
ishaan-jaff	99d3f8be81	add vicuna translation	2023-09-06 11:14:24 -07:00
ishaan-jaff	89ebdab2b3	add replicate support for max_tokens	2023-09-06 10:38:21 -07:00
ishaan-jaff	74e0e90620	add replicate streaming	2023-09-06 10:23:13 -07:00
ishaan-jaff	6fb01ec257	use replicate http requests instead	2023-09-06 09:43:05 -07:00
ishaan-jaff	2691559e24	fix timeouts + tests + bump v	2023-09-05 17:17:58 -07:00
ishaan-jaff	b4d1992b20	custom api base	2023-09-05 16:50:32 -07:00
ishaan-jaff	48a5ed621f	clean up azure implementation	2023-09-05 15:31:59 -07:00
Krrish Dholakia	dd0a373424	test parallelism on circle ci	2023-09-05 14:47:50 -07:00
Krrish Dholakia	4b98feec36	bump version	2023-09-05 14:30:03 -07:00
Krrish Dholakia	cc59328d32	adding support for custom prompt templates to together ai	2023-09-05 12:20:09 -07:00
Krrish Dholakia	090ec35a4d	prompt formatting for together ai llama2 models	2023-09-05 11:57:13 -07:00
ishaan-jaff	b8b7d9bf44	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
ishaan-jaff	c1fb3f19f5	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	493c89fcb3	bump version	2023-09-04 12:44:20 -07:00
ishaan-jaff	262022f8e5	boto3 testing + docs	2023-09-04 12:14:24 -07:00
ishaan-jaff	f156733ed3	allow users to set AWS_REGION_NAME	2023-09-04 11:57:22 -07:00
ishaan-jaff	44f44ad5a3	add optional params for llama-2	2023-09-04 11:41:20 -07:00
ishaan-jaff	746001e32a	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	3bea810d7c	bump version	2023-09-02 22:01:49 -07:00
Krrish Dholakia	a972676655	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
ishaan-jaff	98e0010df1	litellm call id's in responses when client true	2023-08-31 10:09:10 -07:00
Krrish Dholakia	4927e5879f	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	5cd98965e0	updates	2023-08-30 16:05:42 -07:00
Krrish Dholakia	fd7b7b998b	add huggingface	2023-08-30 16:05:33 -07:00
Krrish Dholakia	1385c26aff	return logprobs for hf models	2023-08-30 15:16:26 -07:00
Krrish Dholakia	581221339e	updates	2023-08-30 09:55:45 -07:00
Krrish Dholakia	eb33e1fa71	adding testing to make sure litedebugger is opt-in only	2023-08-30 09:55:33 -07:00