Celina Hanouti
c8808b4700
Move helper into impl file + fix merging conflicts
2024-09-12 15:55:42 +02:00
Celina Hanouti
2ac8e7b901
Remove unecessary method argument
2024-09-09 19:04:21 +02:00
Celina Hanouti
fff1b6d6bf
Use HfApi to get the namespace when not provide in the hf endpoint name
2024-09-09 18:59:10 +02:00
Celina Hanouti
3d660ad938
Rename TGI Adapter class
2024-09-09 18:30:34 +02:00
Celina Hanouti
eee6c69f46
Update CLI reference and add typing
2024-09-09 17:49:07 +02:00
Celina Hanouti
b96e705680
Fixes post-review and split TGI adapter into local and Inference Endpoints ones
2024-09-09 17:47:49 +02:00
Celina Hanouti
031dbc0e45
Use InferenceClient.text_generation for TGI inference
2024-09-06 17:56:27 +02:00
Celina Hanouti
e5bcfdac21
Use huggingface_hub inference client for TGI inference
2024-09-05 18:29:04 +02:00
Ashwin Bharambe
21bedc1596
[inference] Add a TGI adapter ( #52 )
...
* TGI adapter and some refactoring of other inference adapters
* Use the lower-level `generate_stream()` method for correct tool calling
---------
Co-authored-by: Ashwin Bharambe <ashwin@meta.com>
2024-09-04 22:49:33 -07:00