phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions
llama-stack/llama_stack/providers/remote/inference/passthrough
History
Botao Chen 90ca4d94de
fix: fix passthrough inference provider to make it work for agent (#1577) 
## What does this PR do?
We noticed that the passthrough inference provider doesn't work agent
due to the type mis-match between client and server. We manually cast
the llama stack client type to llama stack server type to fix the issue.

## test 
run `python -m examples.agents.hello localhost 8321` within
llama-stack-apps

<img width="1073" alt="Screenshot 2025-03-11 at 8 43 44 PM"
src="https://github.com/user-attachments/assets/bd1bdd31-606a-420c-a249-95f6184cc0b1"
/>

fix https://github.com/meta-llama/llama-stack/issues/1560
2025-03-12 11:16:17 -07:00
..
__init__.py feat: inference passthrough provider (#1166) 2025-02-19 21:47:00 -08:00
config.py feat: inference passthrough provider (#1166) 2025-02-19 21:47:00 -08:00
passthrough.py fix: fix passthrough inference provider to make it work for agent (#1577) 2025-03-12 11:16:17 -07:00