phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-04 12:07:34 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
61 commits 150 branches 116 tags 100 MiB
Commit graph

3 commits

Author SHA1 Message Date
Hardik Shah
039861f1c7 update inference config to take model and not model_dir 2024-08-06 15:02:47 -07:00
Hardik Shah
7664d5701d update tests and formatting 2024-08-05 12:34:16 -07:00
Hardik Shah
156bfa0e15
Added Ollama as an inference impl (#20) 
* fix non-streaming api in inference server

* unit test for inline inference

* Added non-streaming ollama inference impl

* add streaming support for ollama inference with tests

* addressing comments

---------

Co-authored-by: Hardik Shah <hjshah@fb.com>
 2024-07-31 22:08:37 -07:00