203 commits

Author	SHA1	Message	Date
Hardik Shah	7664d5701d	update tests and formatting	2024-08-05 12:34:16 -07:00
Hardik Shah	d7a4cdd70d	added options to ollama inference	2024-08-02 14:44:22 -07:00
Hardik Shah	156bfa0e15	Added Ollama as an inference impl (#20) ... * fix non-streaming api in inference server * unit test for inline inference * Added non-streaming ollama inference impl * add streaming support for ollama inference with tests * addressing comments --------- Co-authored-by: Hardik Shah <hjshah@fb.com>	2024-07-31 22:08:37 -07:00