Commit graph

37 commits

Author SHA1 Message Date
Hardik Shah
55cf1f0642 resort imports 2024-08-08 10:13:38 -07:00
Ashwin Bharambe
e33f402046 Merge remote-tracking branch 'origin/main' into distros 2024-08-07 21:55:29 -07:00
Dalton Flanagan
da4645a27a
hide non-featured (older) models from model list command without show-all flag (#23) 2024-08-07 23:31:30 -04:00
Ashwin Bharambe
9ec46d718d Show message about checksum file so users can check themselves 2024-08-07 16:17:51 -07:00
Ashwin Bharambe
57402c1a19 Add llama model download alias for llama download 2024-08-07 16:10:26 -07:00
Ashwin Bharambe
fddaf5c929 Refactor download functionality out of the Command so can be reused 2024-08-07 15:35:12 -07:00
Ashwin Bharambe
68654460f8 Update README, add newline between API surface configurations 2024-08-07 15:14:59 -07:00
Ashwin Bharambe
e1a7aa4773 Make install + start scripts do proper configuration automatically 2024-08-06 21:53:05 -07:00
Ashwin Bharambe
9e1ca4eeb1 add DistributionConfig, fix a bug in model download 2024-08-06 19:24:52 -07:00
Hardik Shah
ade574a0ef minor fixes 2024-08-06 18:56:34 -07:00
Hardik Shah
039861f1c7 update inference config to take model and not model_dir 2024-08-06 15:02:47 -07:00
Ashwin Bharambe
7cc0445517 Rename Distribution -> DistributionSpec, simplify RemoteProviders 2024-08-06 14:05:01 -07:00
Hardik Shah
0a67f3d3e6 installation fixes 2024-08-05 18:04:44 -07:00
Ashwin Bharambe
65a9e40174 Adapter -> Provider 2024-08-05 13:42:56 -07:00
Ashwin Bharambe
125fdb1b2a ApiSurface -> Api 2024-08-05 12:46:38 -07:00
Ashwin Bharambe
803976df26 cleanup, moving stuff to common, nuke utils 2024-08-03 20:58:00 -07:00
Ashwin Bharambe
fe582a739d add safety adapters, configuration handling, server + clients 2024-08-03 19:46:59 -07:00
Ashwin Bharambe
9dafa6ad94 implement full-passthrough in the server 2024-08-03 14:15:20 -07:00
Hardik Shah
67229f23a4 local imports for faster cli 2024-08-02 16:35:22 -07:00
Ashwin Bharambe
d3e269fcf2 Remove inference uvicorn server entrypoint and llama inference CLI command 2024-08-02 14:18:25 -07:00
Ashwin Bharambe
3bc827cd5f read existing configuration, save enums properly 2024-08-02 14:09:57 -07:00
Ashwin Bharambe
2cf9915806 Distribution server now functioning 2024-08-02 13:37:40 -07:00
Ashwin Bharambe
041cafbee3 getting closer to a distro definition, distro install + configure works 2024-08-01 23:12:43 -07:00
Ashwin Bharambe
dac2b5a1ed More progress towards llama distribution install 2024-08-01 16:40:43 -07:00
Ashwin Bharambe
5a583cf16e Add distribution CLI scaffolding 2024-08-01 14:44:57 -07:00
Ashwin Bharambe
09cf3fe78b Use new definitions of Model / SKU 2024-07-31 22:44:35 -07:00
Ashwin Bharambe
1bc81eae7b update toolchain to work with updated imports from llama_models 2024-07-30 17:52:57 -07:00
Ashwin Bharambe
23014ea4d1 Add hacks because Cloudfront config limits on the 405b model files 2024-07-30 13:46:47 -07:00
Ashwin Bharambe
7306e6b167 show sampling params in model describe 2024-07-29 23:44:07 -07:00
Ashwin Bharambe
040c30ee54 added resumable downloader for downloading models 2024-07-29 23:29:16 -07:00
Ashwin Bharambe
59574924de model template --template -> model template --name 2024-07-29 18:21:05 -07:00
Ashwin Bharambe
45b8a7ffcd Add model describe subcommand 2024-07-29 18:19:53 -07:00
Ashwin Bharambe
9d7f283722 Add model list subcommand 2024-07-29 16:39:53 -07:00
Ashwin Bharambe
3583cf2d51 update model template output to be prettier, more consumable 2024-07-26 15:39:46 -07:00
Dalton Flanagan
ec433448f2
Add CLI reference docs (#14)
* Add CLI reference doc

* touchups

* add helptext for download
2024-07-25 13:56:29 -07:00
Lucain
378a2077dd
Update download command (#9) 2024-07-24 16:50:40 -07:00
Ashwin Bharambe
5d5acc8ed5 Initial commit 2024-07-23 08:32:33 -07:00