3448 commits

Author	SHA1	Message	Date
ishaan-jaff	632d928bfb	comments about using hosted vllm	2023-09-08 14:06:52 -07:00
ishaan-jaff	c45e2ed48c	hosted vllm usage	2023-09-08 13:58:06 -07:00
ishaan-jaff	c05606b587	custom base with openai completion	2023-09-08 13:21:43 -07:00
Krrish Dholakia	8acf959430	bump version	2023-09-08 13:12:27 -07:00
ishaan-jaff	b0a2e57a8a	fix:completion fails when client=True&no email set	2023-09-08 12:36:33 -07:00
Krrish Dholakia	554b05015e	fix litedebugger double logging error	2023-09-07 18:02:24 -07:00
Krrish Dholakia	147a877aca	bump version	2023-09-07 17:00:20 -07:00
Krrish Dholakia	81ac07644d	bump version	2023-09-07 16:24:05 -07:00
Krrish Dholakia	e452ceb21e	fix litellm client	2023-09-07 16:22:00 -07:00
ishaan-jaff	8f5e2d0013	bug fix - issue 277	2023-09-07 14:11:10 -07:00
ishaan-jaff	3e5c972e91	bump version litellm	2023-09-07 14:03:37 -07:00
Ishaan Jaff	19b78c3f6f	Merge pull request #294 from shauryr/patch-1 ... added import aiohttp	2023-09-07 13:58:34 -07:00
ishaan-jaff	301eb36095	cleanup async func test	2023-09-07 13:56:46 -07:00
ishaan-jaff	a611409e0f	async streaming generator	2023-09-07 13:53:40 -07:00
Krrish Dholakia	c7e34bce5f	update get model list	2023-09-07 13:15:50 -07:00
Shaurya Rohatgi	f4596c52b8	added import aiohttp	2023-09-07 12:31:14 -05:00
Krrish Dholakia	072d93696c	remove print statement	2023-09-07 08:21:25 -07:00
Krrish Dholakia	6b3cb18983	fix linting issues	2023-09-06 20:43:59 -07:00
Krrish Dholakia	35cf6ef0a1	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
ishaan-jaff	2880a7b6b4	allow users to pass custom timing for replicate	2023-09-06 18:32:40 -07:00
ishaan-jaff	fc7ad0c245	bump v	2023-09-06 18:14:58 -07:00
ishaan-jaff	8b3b682000	add replicate pricing	2023-09-06 18:14:34 -07:00
Krrish Dholakia	4cfcabd919	adding support for vllm	2023-09-06 18:07:44 -07:00
ishaan-jaff	bd77d5ac21	docs update	2023-09-06 17:16:24 -07:00
ishaan-jaff	1ba6b6761b	show pricing for tg ai completion	2023-09-06 17:10:49 -07:00
ishaan-jaff	04f8b20651	fix linting errors @krrishdholakia	2023-09-06 16:38:42 -07:00
ishaan-jaff	c5151aa573	move model_prices to root github	2023-09-06 16:31:44 -07:00
ishaan-jaff	bab27634a8	rename max_tokens.json	2023-09-06 16:28:17 -07:00
ishaan-jaff	fbd67bc24c	add experimental together_computer cost calc	2023-09-06 16:08:44 -07:00
Krrish Dholakia	0ace48d719	update custom prompt template function	2023-09-06 13:14:36 -07:00
ishaan-jaff	dc0c084813	improve replicate usage	2023-09-06 12:29:34 -07:00
Krrish Dholakia	4bcfa71e11	commenting out flaky circle ci test	2023-09-06 12:07:47 -07:00
ishaan-jaff	601a6a4a92	better documentation on __init__	2023-09-06 11:31:52 -07:00
Krrish Dholakia	91d2a57970	update linting	2023-09-06 11:30:40 -07:00
ishaan-jaff	cfe35580e2	add support for flant5	2023-09-06 11:28:43 -07:00
Krrish Dholakia	44f71aa321	logging replicate response logs	2023-09-06 11:28:40 -07:00
ishaan-jaff	1da6026622	add flan + vicuna + fix replicate errors	2023-09-06 11:23:58 -07:00
Krrish Dholakia	48ee4a08ac	updates	2023-09-06 11:21:48 -07:00
ishaan-jaff	af60b2ba77	add vicuna translation	2023-09-06 11:14:24 -07:00
Krrish Dholakia	afcd6b28cc	bump version	2023-09-06 11:05:11 -07:00
ishaan-jaff	0ddda7c035	send optional_params for llama2-70b chat replicate	2023-09-06 11:01:39 -07:00
Krrish Dholakia	d236d68fa4	fix linting issues	2023-09-06 10:41:52 -07:00
ishaan-jaff	d4c4a138ca	add replicate support for max_tokens	2023-09-06 10:38:21 -07:00
Krrish Dholakia	ef43141554	updates to exception mapping	2023-09-06 10:36:22 -07:00
ishaan-jaff	d0b16892e0	fix replicate supported llms	2023-09-06 10:28:03 -07:00
ishaan-jaff	bc9b629726	add Replicate Error class	2023-09-06 10:25:40 -07:00
ishaan-jaff	1c61b7b229	add replicate streaming	2023-09-06 10:23:13 -07:00
ishaan-jaff	c45b132675	use replicate http requests instead	2023-09-06 09:43:05 -07:00
Krrish Dholakia	3d6836417e	adding prompt template for falcon 180b	2023-09-06 08:44:13 -07:00
Krrish Dholakia	b4a9699138	update docs on together ai	2023-09-06 08:26:05 -07:00