4 commits

Author	SHA1	Message	Date
Hardik Shah	d7a4cdd70d	added options to ollama inference	2024-08-02 14:44:22 -07:00
Ashwin Bharambe	09cf3fe78b	Use new definitions of Model / SKU	2024-07-31 22:44:35 -07:00
Hardik Shah	156bfa0e15	Added Ollama as an inference impl (#20) ... * fix non-streaming api in inference server * unit test for inline inference * Added non-streaming ollama inference impl * add streaming support for ollama inference with tests * addressing comments --------- Co-authored-by: Hardik Shah <hjshah@fb.com>	2024-07-31 22:08:37 -07:00
Ashwin Bharambe	5d5acc8ed5	Initial commit	2024-07-23 08:32:33 -07:00