6 commits

Author	SHA1	Message	Date
Hardik Shah	ad9eaf13bb	for inline make 8b model the default	2024-08-08 10:45:32 -07:00
Ashwin Bharambe	9e3182216d	add validation for configuration input	2024-08-08 10:09:36 -07:00
Ashwin Bharambe	f27d629fe8	Reduce a bunch of dependencies from toolchain ... Some improvements to the distribution install script	2024-08-07 21:55:07 -07:00
Hardik Shah	171a178783	get ollama working	2024-08-07 17:53:15 -07:00
Hardik Shah	039861f1c7	update inference config to take model and not model_dir	2024-08-06 15:02:47 -07:00
Ashwin Bharambe	0de5a807c7	Make each inference provider into its own subdirectory	2024-08-05 16:39:58 -07:00