llama-stack/llama_stack/providers
Botao Chen 2b995c22eb
feat: inference passthrough provider (#1166)
##  What does this PR do?
In this PR, we implement a passthrough inference provider that works for
any endpoints that respect llama stack inference API definition.

## Test Plan
config some endpoint that respect llama stack inference API definition
and got the inference results successfully

<img width="1268" alt="Screenshot 2025-02-19 at 8 52 51 PM"
src="https://github.com/user-attachments/assets/447816e4-ea7a-4365-b90c-386dc7dcf4a1"
/>
2025-02-19 21:47:00 -08:00
..
inline feat: add aggregation_functions to llm_as_judge_405b_simpleqa (#1164) 2025-02-19 19:42:04 -08:00
registry feat: inference passthrough provider (#1166) 2025-02-19 21:47:00 -08:00
remote feat: inference passthrough provider (#1166) 2025-02-19 21:47:00 -08:00
tests feat: Chunk sqlite-vec writes (#1094) 2025-02-19 19:07:46 -08:00
utils chore: remove llama_models.llama3.api imports from providers (#1107) 2025-02-19 19:01:29 -08:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
datatypes.py chore: move all Llama Stack types from llama-models to llama-stack (#1098) 2025-02-14 09:10:59 -08:00