14 commits

Author	SHA1	Message	Date
Ashwin Bharambe	09cf3fe78b	Use new definitions of Model / SKU	2024-07-31 22:44:35 -07:00
Hardik Shah	156bfa0e15	Added Ollama as an inference impl (#20) ... * fix non-streaming api in inference server * unit test for inline inference * Added non-streaming ollama inference impl * add streaming support for ollama inference with tests * addressing comments --------- Co-authored-by: Hardik Shah <hjshah@fb.com>	2024-07-31 22:08:37 -07:00
Ashwin Bharambe	c253c1c9ad	Begin adding a /safety/run_shield API	2024-07-31 21:57:10 -07:00
Ashwin Bharambe	1bc81eae7b	update toolchain to work with updated imports from llama_models	2024-07-30 17:52:57 -07:00
Ashwin Bharambe	23014ea4d1	Add hacks because Cloudfront config limits on the 405b model files	2024-07-30 13:46:47 -07:00
Ashwin Bharambe	7306e6b167	show sampling params in model describe	2024-07-29 23:44:07 -07:00
Ashwin Bharambe	040c30ee54	added resumable downloader for downloading models	2024-07-29 23:29:16 -07:00
Ashwin Bharambe	59574924de	model template --template -> model template --name	2024-07-29 18:21:05 -07:00
Ashwin Bharambe	45b8a7ffcd	Add model describe subcommand	2024-07-29 18:19:53 -07:00
Ashwin Bharambe	9d7f283722	Add model list subcommand	2024-07-29 16:39:53 -07:00
Ashwin Bharambe	3583cf2d51	update model template output to be prettier, more consumable	2024-07-26 15:39:46 -07:00
Dalton Flanagan	ec433448f2	Add CLI reference docs (#14) ... * Add CLI reference doc * touchups * add helptext for download	2024-07-25 13:56:29 -07:00
Lucain	378a2077dd	Update download command (#9)	2024-07-24 16:50:40 -07:00
Ashwin Bharambe	5d5acc8ed5	Initial commit	2024-07-23 08:32:33 -07:00