28 commits

Author	SHA1	Message	Date
Hardik Shah	ade574a0ef	minor fixes	2024-08-06 18:56:34 -07:00
Hardik Shah	039861f1c7	update inference config to take model and not model_dir	2024-08-06 15:02:47 -07:00
Ashwin Bharambe	7cc0445517	Rename Distribution -> DistributionSpec, simplify RemoteProviders	2024-08-06 14:05:01 -07:00
Hardik Shah	0a67f3d3e6	installation fixes	2024-08-05 18:04:44 -07:00
Ashwin Bharambe	65a9e40174	Adapter -> Provider	2024-08-05 13:42:56 -07:00
Ashwin Bharambe	125fdb1b2a	ApiSurface -> Api	2024-08-05 12:46:38 -07:00
Ashwin Bharambe	803976df26	cleanup, moving stuff to common, nuke utils	2024-08-03 20:58:00 -07:00
Ashwin Bharambe	fe582a739d	add safety adapters, configuration handling, server + clients	2024-08-03 19:46:59 -07:00
Ashwin Bharambe	9dafa6ad94	implement full-passthrough in the server	2024-08-03 14:15:20 -07:00
Hardik Shah	67229f23a4	local imports for faster cli	2024-08-02 16:35:22 -07:00
Ashwin Bharambe	d3e269fcf2	Remove inference uvicorn server entrypoint and llama inference CLI command	2024-08-02 14:18:25 -07:00
Ashwin Bharambe	3bc827cd5f	read existing configuration, save enums properly	2024-08-02 14:09:57 -07:00
Ashwin Bharambe	2cf9915806	Distribution server now functioning	2024-08-02 13:37:40 -07:00
Ashwin Bharambe	041cafbee3	getting closer to a distro definition, distro install + configure works	2024-08-01 23:12:43 -07:00
Ashwin Bharambe	dac2b5a1ed	More progress towards llama distribution install	2024-08-01 16:40:43 -07:00
Ashwin Bharambe	5a583cf16e	Add distribution CLI scaffolding	2024-08-01 14:44:57 -07:00
Ashwin Bharambe	09cf3fe78b	Use new definitions of Model / SKU	2024-07-31 22:44:35 -07:00
Ashwin Bharambe	1bc81eae7b	update toolchain to work with updated imports from llama_models	2024-07-30 17:52:57 -07:00
Ashwin Bharambe	23014ea4d1	Add hacks because Cloudfront config limits on the 405b model files	2024-07-30 13:46:47 -07:00
Ashwin Bharambe	7306e6b167	show sampling params in model describe	2024-07-29 23:44:07 -07:00
Ashwin Bharambe	040c30ee54	added resumable downloader for downloading models	2024-07-29 23:29:16 -07:00
Ashwin Bharambe	59574924de	model template --template -> model template --name	2024-07-29 18:21:05 -07:00
Ashwin Bharambe	45b8a7ffcd	Add model describe subcommand	2024-07-29 18:19:53 -07:00
Ashwin Bharambe	9d7f283722	Add model list subcommand	2024-07-29 16:39:53 -07:00
Ashwin Bharambe	3583cf2d51	update model template output to be prettier, more consumable	2024-07-26 15:39:46 -07:00
Dalton Flanagan	ec433448f2	Add CLI reference docs (#14) ... * Add CLI reference doc * touchups * add helptext for download	2024-07-25 13:56:29 -07:00
Lucain	378a2077dd	Update download command (#9)	2024-07-24 16:50:40 -07:00
Ashwin Bharambe	5d5acc8ed5	Initial commit	2024-07-23 08:32:33 -07:00