Commit graph

2 commits

Author SHA1 Message Date
Xi Yan
7d6ebf4b72 update inference adapters 2024-09-11 19:58:20 -07:00
Ashwin Bharambe
21bedc1596
[inference] Add a TGI adapter (#52)
* TGI adapter and some refactoring of other inference adapters

* Use the lower-level `generate_stream()` method for correct tool calling

---------

Co-authored-by: Ashwin Bharambe <ashwin@meta.com>
2024-09-04 22:49:33 -07:00