211 commits

Author	SHA1	Message	Date
Krrish Dholakia	8d517f84c9	completion test cleanup	2023-09-11 18:39:16 -07:00
Krrish Dholakia	bab36c2c6f	work for hf inference endpoint	2023-09-11 18:37:55 -07:00
ishaan-jaff	7ee86453dc	bump version	2023-09-11 08:47:37 -07:00
ishaan-jaff	7a7e39587a	cache pip deps	2023-09-11 08:27:09 -07:00
ishaan-jaff	19d26b944e	parallelism tests	2023-09-11 08:21:07 -07:00
ishaan-jaff	e37c2f19f4	fix linting	2023-09-11 08:19:38 -07:00
ishaan-jaff	60729a9f6f	fix circle ci test	2023-09-11 08:14:04 -07:00
ishaan-jaff	1909444285	fix redis cache testing and add new test for azure	2023-09-11 08:01:02 -07:00
ishaan-jaff	edde9ad15b	test for litellm.api_key	2023-09-11 07:55:01 -07:00
ishaan-jaff	0f769c5417	add finish reason to streamed responses	2023-09-09 19:36:38 -07:00
ishaan-jaff	5ab3ca2018	tests	2023-09-09 15:47:38 -07:00
ishaan-jaff	4de44a691f	bump v	2023-09-08 17:47:03 -07:00
ishaan-jaff	7158ea3ab8	bump version to 0.1.564	2023-09-08 17:46:30 -07:00
ishaan-jaff	c45e2ed48c	hosted vllm usage	2023-09-08 13:58:06 -07:00
ishaan-jaff	b0a2e57a8a	fix:completion fails when client=True&no email set	2023-09-08 12:36:33 -07:00
ishaan-jaff	8f5e2d0013	bug fix - issue 277	2023-09-07 14:11:10 -07:00
ishaan-jaff	2880a7b6b4	allow users to pass custom timing for replicate	2023-09-06 18:32:40 -07:00
Krrish Dholakia	4cfcabd919	adding support for vllm	2023-09-06 18:07:44 -07:00
Krrish Dholakia	0ace48d719	update custom prompt template function	2023-09-06 13:14:36 -07:00
ishaan-jaff	af60b2ba77	add vicuna translation	2023-09-06 11:14:24 -07:00
ishaan-jaff	d4c4a138ca	add replicate support for max_tokens	2023-09-06 10:38:21 -07:00
ishaan-jaff	1c61b7b229	add replicate streaming	2023-09-06 10:23:13 -07:00
ishaan-jaff	c45b132675	use replicate http requests instead	2023-09-06 09:43:05 -07:00
ishaan-jaff	fb3983d058	fix timeouts + tests + bump v	2023-09-05 17:17:58 -07:00
ishaan-jaff	8ecef03f63	custom api base	2023-09-05 16:50:32 -07:00
ishaan-jaff	2250d1375e	clean up azure implementation	2023-09-05 15:31:59 -07:00
Krrish Dholakia	9a82bfa4d2	test parallelism on circle ci	2023-09-05 14:47:50 -07:00
Krrish Dholakia	faa78ad543	bump version	2023-09-05 14:30:03 -07:00
Krrish Dholakia	8845938b31	adding support for custom prompt templates to together ai	2023-09-05 12:20:09 -07:00
Krrish Dholakia	64f3d3c56e	prompt formatting for together ai llama2 models	2023-09-05 11:57:13 -07:00
ishaan-jaff	79acfb4dab	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
ishaan-jaff	a474b89779	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	f0e2922710	bump version	2023-09-04 12:44:20 -07:00
ishaan-jaff	8f07c80733	boto3 testing + docs	2023-09-04 12:14:24 -07:00
ishaan-jaff	126830f08a	allow users to set AWS_REGION_NAME	2023-09-04 11:57:22 -07:00
ishaan-jaff	e03d442e8f	add optional params for llama-2	2023-09-04 11:41:20 -07:00
ishaan-jaff	4a4ee51df3	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	315cac619b	bump version	2023-09-02 22:01:49 -07:00
Krrish Dholakia	83b8af8567	adding support for aleph alpha	2023-09-02 13:15:41 -07:00
ishaan-jaff	beac62b8fe	litellm call id's in responses when client true	2023-08-31 10:09:10 -07:00
Krrish Dholakia	14d4c7ead2	update baseten handler to handle TGI calls	2023-08-30 19:14:48 -07:00
Krrish Dholakia	fcaf514546	updates	2023-08-30 16:05:42 -07:00
Krrish Dholakia	0ea59702fd	add huggingface	2023-08-30 16:05:33 -07:00
Krrish Dholakia	daa949a539	return logprobs for hf models	2023-08-30 15:16:26 -07:00
Krrish Dholakia	f3d8445ff1	updates	2023-08-30 09:55:45 -07:00
Krrish Dholakia	b90e5ed6db	adding testing to make sure litedebugger is opt-in only	2023-08-30 09:55:33 -07:00
ishaan-jaff	38828ae705	remove flaky petals test	2023-08-29 21:20:57 -07:00
Krrish Dholakia	506dd9eaaa	commenting out flaky openrouter tests.	2023-08-29 18:46:47 -07:00
Krrish Dholakia	697092edf5	updates	2023-08-29 18:23:34 -07:00
Krrish Dholakia	4435a231f1	clean up tests	2023-08-29 16:50:31 -07:00