phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-04 04:04:14 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
86 commits 149 branches 115 tags 98 MiB
Commit graph

4 commits

Author SHA1 Message Date
Celina Hanouti
b96e705680 Fixes post-review and split TGI adapter into local and Inference Endpoints ones 2024-09-09 17:47:49 +02:00
Celina Hanouti
031dbc0e45 Use InferenceClient.text_generation for TGI inference 2024-09-06 17:56:27 +02:00
Celina Hanouti
e5bcfdac21 Use huggingface_hub inference client for TGI inference 2024-09-05 18:29:04 +02:00
Ashwin Bharambe
21bedc1596
[inference] Add a TGI adapter (#52) 
* TGI adapter and some refactoring of other inference adapters

* Use the lower-level `generate_stream()` method for correct tool calling

---------

Co-authored-by: Ashwin Bharambe <ashwin@meta.com>
 2024-09-04 22:49:33 -07:00