Commit graph

6 commits

Author SHA1 Message Date
Ashwin Bharambe
0de5a807c7 Make each inference provider into its own subdirectory 2024-08-05 16:39:58 -07:00
Ashwin Bharambe
f64668319c Merge remote-tracking branch 'origin/main' into distros 2024-08-05 14:31:06 -07:00
Ashwin Bharambe
65a9e40174 Adapter -> Provider 2024-08-05 13:42:56 -07:00
Hardik Shah
d7a4cdd70d added options to ollama inference 2024-08-02 14:44:22 -07:00
Ashwin Bharambe
041cafbee3 getting closer to a distro definition, distro install + configure works 2024-08-01 23:12:43 -07:00
Hardik Shah
156bfa0e15
Added Ollama as an inference impl (#20)
* fix non-streaming api in inference server

* unit test for inline inference

* Added non-streaming ollama inference impl

* add streaming support for ollama inference with tests

* addressing comments

---------

Co-authored-by: Hardik Shah <hjshah@fb.com>
2024-07-31 22:08:37 -07:00