846 commits

Author	SHA1	Message	Date
ishaan-jaff	794672c839	bug fix - issue 277	2023-09-07 14:11:10 -07:00
ishaan-jaff	43f240ff42	allow users to pass custom timing for replicate	2023-09-06 18:32:40 -07:00
Krrish Dholakia	7290a972e5	adding support for vllm	2023-09-06 18:07:44 -07:00
Krrish Dholakia	021512c60f	update custom prompt template function	2023-09-06 13:14:36 -07:00
ishaan-jaff	99d3f8be81	add vicuna translation	2023-09-06 11:14:24 -07:00
ishaan-jaff	89ebdab2b3	add replicate support for max_tokens	2023-09-06 10:38:21 -07:00
ishaan-jaff	74e0e90620	add replicate streaming	2023-09-06 10:23:13 -07:00
ishaan-jaff	6fb01ec257	use replicate http requests instead	2023-09-06 09:43:05 -07:00
ishaan-jaff	2691559e24	fix timeouts + tests + bump v	2023-09-05 17:17:58 -07:00
ishaan-jaff	b4d1992b20	custom api base	2023-09-05 16:50:32 -07:00
ishaan-jaff	48a5ed621f	clean up azure implementation	2023-09-05 15:31:59 -07:00
Krrish Dholakia	dd0a373424	test parallelism on circle ci	2023-09-05 14:47:50 -07:00
Krrish Dholakia	4b98feec36	bump version	2023-09-05 14:30:03 -07:00
Krrish Dholakia	cc59328d32	adding support for custom prompt templates to together ai	2023-09-05 12:20:09 -07:00
Krrish Dholakia	090ec35a4d	prompt formatting for together ai llama2 models	2023-09-05 11:57:13 -07:00
ishaan-jaff	b8b7d9bf44	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
ishaan-jaff	c1fb3f19f5	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	493c89fcb3	bump version	2023-09-04 12:44:20 -07:00
ishaan-jaff	262022f8e5	boto3 testing + docs	2023-09-04 12:14:24 -07:00
ishaan-jaff	f156733ed3	allow users to set AWS_REGION_NAME	2023-09-04 11:57:22 -07:00
ishaan-jaff	44f44ad5a3	add optional params for llama-2	2023-09-04 11:41:20 -07:00
ishaan-jaff	746001e32a	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	3bea810d7c	bump version	2023-09-02 22:01:49 -07:00
Krrish Dholakia	a972676655	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
ishaan-jaff	98e0010df1	litellm call id's in responses when client true	2023-08-31 10:09:10 -07:00
Krrish Dholakia	4927e5879f	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	5cd98965e0	updates	2023-08-30 16:05:42 -07:00
Krrish Dholakia	fd7b7b998b	add huggingface	2023-08-30 16:05:33 -07:00
Krrish Dholakia	1385c26aff	return logprobs for hf models	2023-08-30 15:16:26 -07:00
Krrish Dholakia	581221339e	updates	2023-08-30 09:55:45 -07:00
Krrish Dholakia	eb33e1fa71	adding testing to make sure litedebugger is opt-in only	2023-08-30 09:55:33 -07:00
ishaan-jaff	ac38599ab1	remove flaky petals test	2023-08-29 21:20:57 -07:00
Krrish Dholakia	7fa00add91	commenting out flaky openrouter tests.	2023-08-29 18:46:47 -07:00
Krrish Dholakia	c63cef96b1	updates	2023-08-29 18:23:34 -07:00
Krrish Dholakia	727f5f2c87	clean up tests	2023-08-29 16:50:31 -07:00
Krrish Dholakia	efbde50a03	adding coverage for openrouter in exception mapping	2023-08-29 15:30:24 -07:00
ishaan-jaff	9c32dbf427	test fixes	2023-08-28 22:33:09 -07:00
Krrish Dholakia	6b9bc2b182	updates	2023-08-28 20:48:03 -07:00
ishaan-jaff	a69b7ffcfa	formatting improvements	2023-08-28 09:20:50 -07:00
ishaan-jaff	73e411572e	add text_completion	2023-08-28 08:20:20 -07:00
ishaan-jaff	8589a7e359	add text completion format support	2023-08-28 08:04:06 -07:00
Krrish Dholakia	2a4cedb1ff	enable litedebugger opt-out	2023-08-24 10:19:10 -07:00
ishaan-jaff	d47476165f	linting fixes	2023-08-22 15:17:38 -07:00
ishaan-jaff	9a04a3b95b	test fallbacks	2023-08-22 15:07:07 -07:00
ishaan-jaff	c67e59cd10	formatting fixes	2023-08-22 15:07:07 -07:00
Krrish Dholakia	bfbab563f8	fixing azure bug	2023-08-21 14:05:25 -07:00
Krrish Dholakia	5e53c9664c	allow custom provider via model name	2023-08-19 16:35:04 -07:00
ishaan-jaff	8710e54f6b	add logit bias	2023-08-19 16:29:14 -07:00
ishaan-jaff	2c7ffb7c75	add linting	2023-08-18 11:05:05 -07:00
yujong-lee	41fbde2f44	better testing	2023-08-18 17:41:31 +09:00