288 commits

Author	SHA1	Message	Date
ishaan-jaff	5a047d8b7a	fix:completion fails when client=True&no email set	2023-09-08 12:36:33 -07:00
Krrish Dholakia	b60049b030	fix litedebugger double logging error	2023-09-07 18:02:24 -07:00
Krrish Dholakia	b8358da425	bump version	2023-09-07 17:00:20 -07:00
Krrish Dholakia	d20214f99c	fix litellm client	2023-09-07 16:22:00 -07:00
ishaan-jaff	794672c839	bug fix - issue 277	2023-09-07 14:11:10 -07:00
ishaan-jaff	62cbe862c8	bump version litellm	2023-09-07 14:03:37 -07:00
ishaan-jaff	b39c5c5df9	cleanup async func test	2023-09-07 13:56:46 -07:00
ishaan-jaff	27b8145c56	async streaming generator	2023-09-07 13:53:40 -07:00
Krrish Dholakia	14fa57c185	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
ishaan-jaff	43f240ff42	allow users to pass custom timing for replicate	2023-09-06 18:32:40 -07:00
ishaan-jaff	6995232782	bump v	2023-09-06 18:14:58 -07:00
ishaan-jaff	1eed36eb1d	add replicate pricing	2023-09-06 18:14:34 -07:00
Krrish Dholakia	7290a972e5	adding support for vllm	2023-09-06 18:07:44 -07:00
ishaan-jaff	f4955431c8	docs update	2023-09-06 17:16:24 -07:00
ishaan-jaff	99a3d18a36	show pricing for tg ai completion	2023-09-06 17:10:49 -07:00
ishaan-jaff	955ba98093	rename max_tokens.json	2023-09-06 16:28:17 -07:00
ishaan-jaff	e30a70f0d0	add experimental together_computer cost calc	2023-09-06 16:08:44 -07:00
Krrish Dholakia	021512c60f	update custom prompt template function	2023-09-06 13:14:36 -07:00
Krrish Dholakia	e24e60cd74	commenting out flaky circle ci test	2023-09-06 12:07:47 -07:00
Krrish Dholakia	da308e756f	update linting	2023-09-06 11:30:40 -07:00
ishaan-jaff	a2d425f7de	add flan + vicuna + fix replicate errors	2023-09-06 11:23:58 -07:00
Krrish Dholakia	8189a16188	updates	2023-09-06 11:21:48 -07:00
ishaan-jaff	99d3f8be81	add vicuna translation	2023-09-06 11:14:24 -07:00
ishaan-jaff	89ebdab2b3	add replicate support for max_tokens	2023-09-06 10:38:21 -07:00
ishaan-jaff	74e0e90620	add replicate streaming	2023-09-06 10:23:13 -07:00
ishaan-jaff	6fb01ec257	use replicate http requests instead	2023-09-06 09:43:05 -07:00
ishaan-jaff	2691559e24	fix timeouts + tests + bump v	2023-09-05 17:17:58 -07:00
ishaan-jaff	b4d1992b20	custom api base	2023-09-05 16:50:32 -07:00
ishaan-jaff	48a5ed621f	clean up azure implementation	2023-09-05 15:31:59 -07:00
Krrish Dholakia	dd0a373424	test parallelism on circle ci	2023-09-05 14:47:50 -07:00
Krrish Dholakia	4b98feec36	bump version	2023-09-05 14:30:03 -07:00
Krrish Dholakia	cc59328d32	adding support for custom prompt templates to together ai	2023-09-05 12:20:09 -07:00
Krrish Dholakia	090ec35a4d	prompt formatting for together ai llama2 models	2023-09-05 11:57:13 -07:00
Krrish Dholakia	51b64c59f3	update streaming docs to show it working for async completion calls	2023-09-05 09:18:37 -07:00
Krrish Dholakia	548b419005	test async streaming	2023-09-04 15:42:24 -07:00
ishaan-jaff	b8b7d9bf44	fix aleph alpha client init	2023-09-04 15:14:09 -07:00
Krrish Dholakia	5ae420317e	adding first-party + custom prompt templates for huggingface	2023-09-04 14:54:09 -07:00
ishaan-jaff	c1fb3f19f5	clean up hugging face completion()	2023-09-04 14:41:06 -07:00
ishaan-jaff	493c89fcb3	bump version	2023-09-04 12:44:20 -07:00
ishaan-jaff	262022f8e5	boto3 testing + docs	2023-09-04 12:14:24 -07:00
ishaan-jaff	f156733ed3	allow users to set AWS_REGION_NAME	2023-09-04 11:57:22 -07:00
Krrish Dholakia	57dcd1fee9	update exception mapping and get model cost map	2023-09-04 11:53:20 -07:00
ishaan-jaff	44f44ad5a3	add optional params for llama-2	2023-09-04 11:41:20 -07:00
ishaan-jaff	746001e32a	working sagemaker support	2023-09-04 11:30:34 -07:00
ishaan-jaff	66ca76928e	[temp] remove cache streaming flaky test	2023-09-04 09:50:45 -07:00
ishaan-jaff	3bea810d7c	bump version	2023-09-02 22:01:49 -07:00
ishaan-jaff	4a994dc498	use api_base instead of custom_api_base	2023-09-02 17:11:30 -07:00
ishaan-jaff	bd0a118552	test without id	2023-09-02 16:54:04 -07:00
Krrish Dholakia	669b4bd08d	remove token	2023-09-02 15:24:18 -07:00
Krrish Dholakia	b0b2b58fc6	update split test logic	2023-09-02 14:32:18 -07:00