295 commits

Author	SHA1	Message	Date
ishaan-jaff	2880a7b6b4	allow users to pass custom timing for replicate	2023-09-06 18:32:40 -07:00
Krrish Dholakia	4cfcabd919	adding support for vllm	2023-09-06 18:07:44 -07:00
Krrish Dholakia	0ace48d719	update custom prompt template function	2023-09-06 13:14:36 -07:00
ishaan-jaff	af60b2ba77	add vicuna translation	2023-09-06 11:14:24 -07:00
ishaan-jaff	d4c4a138ca	add replicate support for max_tokens	2023-09-06 10:38:21 -07:00
ishaan-jaff	1c61b7b229	add replicate streaming	2023-09-06 10:23:13 -07:00
ishaan-jaff	c45b132675	use replicate http requests instead	2023-09-06 09:43:05 -07:00
ishaan-jaff	fb3983d058	fix timeouts + tests + bump v	2023-09-05 17:17:58 -07:00
ishaan-jaff	8ecef03f63	custom api base	2023-09-05 16:50:32 -07:00
ishaan-jaff	2250d1375e	clean up azure implementation	2023-09-05 15:31:59 -07:00
Krrish Dholakia	9a82bfa4d2	test parallelism on circle ci	2023-09-05 14:47:50 -07:00
Krrish Dholakia	faa78ad543	bump version	2023-09-05 14:30:03 -07:00
Krrish Dholakia	8845938b31	adding support for custom prompt templates to together ai	2023-09-05 12:20:09 -07:00
Krrish Dholakia	64f3d3c56e	prompt formatting for together ai llama2 models	2023-09-05 11:57:13 -07:00
ishaan-jaff	79acfb4dab	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
ishaan-jaff	a474b89779	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	f0e2922710	bump version	2023-09-04 12:44:20 -07:00
ishaan-jaff	8f07c80733	boto3 testing + docs	2023-09-04 12:14:24 -07:00
ishaan-jaff	126830f08a	allow users to set AWS_REGION_NAME	2023-09-04 11:57:22 -07:00
ishaan-jaff	e03d442e8f	add optional params for llama-2	2023-09-04 11:41:20 -07:00
ishaan-jaff	4a4ee51df3	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	315cac619b	bump version	2023-09-02 22:01:49 -07:00
Krrish Dholakia	83b8af8567	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
ishaan-jaff	beac62b8fe	litellm call id's in responses when client true	2023-08-31 10:09:10 -07:00
Krrish Dholakia	14d4c7ead2	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	fcaf514546	updates	2023-08-30 16:05:42 -07:00
Krrish Dholakia	0ea59702fd	add huggingface	2023-08-30 16:05:33 -07:00
Krrish Dholakia	daa949a539	return logprobs for hf models	2023-08-30 15:16:26 -07:00
Krrish Dholakia	f3d8445ff1	updates	2023-08-30 09:55:45 -07:00
Krrish Dholakia	b90e5ed6db	adding testing to make sure litedebugger is opt-in only	2023-08-30 09:55:33 -07:00
ishaan-jaff	38828ae705	remove flaky petals test	2023-08-29 21:20:57 -07:00
Krrish Dholakia	506dd9eaaa	commenting out flaky openrouter tests.	2023-08-29 18:46:47 -07:00
Krrish Dholakia	697092edf5	updates	2023-08-29 18:23:34 -07:00
Krrish Dholakia	4435a231f1	clean up tests	2023-08-29 16:50:31 -07:00
Krrish Dholakia	5bcf612724	adding coverage for openrouter in exception mapping	2023-08-29 15:30:24 -07:00
ishaan-jaff	b2e860cc82	test fixes	2023-08-28 22:33:09 -07:00
Krrish Dholakia	711ec580c6	updates	2023-08-28 20:48:03 -07:00
ishaan-jaff	b713acb0a4	formatting improvements	2023-08-28 09:20:50 -07:00
ishaan-jaff	fedd16361f	add text_completion	2023-08-28 08:20:20 -07:00
ishaan-jaff	dfdf47ddd0	add text completion format support	2023-08-28 08:04:06 -07:00
Krrish Dholakia	efbb476020	enable litedebugger opt-out	2023-08-24 10:19:10 -07:00
ishaan-jaff	f3334a9634	linting fixes	2023-08-22 15:17:38 -07:00
ishaan-jaff	72414919dd	test fallbacks	2023-08-22 15:07:07 -07:00
ishaan-jaff	ccf875f84b	formatting fixes	2023-08-22 15:07:07 -07:00
Krrish Dholakia	7f3b90db3c	fixing azure bug	2023-08-21 14:05:25 -07:00
Krrish Dholakia	6cee3b22ab	allow custom provider via model name	2023-08-19 16:35:04 -07:00
ishaan-jaff	abfc286c20	add logit bias	2023-08-19 16:29:14 -07:00
ishaan-jaff	15b1da9dc8	add linting	2023-08-18 11:05:05 -07:00
yujong-lee	701ff22b56	better testing	2023-08-18 17:41:31 +09:00
ishaan-jaff	7abde6f008	fix Open router	2023-08-17 18:19:50 -07:00