phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-06-28 02:53:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/llama_stack
History
Ashwin Bharambe 14f973a64f
Make LlamaStackLibraryClient work correctly (#581) 
This PR does a few things:

- it moves "direct client" to llama-stack repo instead of being in the
llama-stack-client-python repo
- renames it to `LlamaStackLibraryClient`
- actually makes synchronous generators work 
- makes streaming and non-streaming work properly

In many ways, this PR makes things finally "work"

## Test Plan

See a `library_client_test.py` I added. This isn't really quite a test
yet but it demonstrates that this mode now works. Here's the invocation
and the response:

```
INFERENCE_MODEL=meta-llama/Llama-3.2-3B-Instruct python llama_stack/distribution/tests/library_client_test.py ollama
```


![image](https://github.com/user-attachments/assets/17d4e116-4457-4755-a14e-d9a668801fe0)
2024-12-07 14:59:36 -08:00
..
apis Console span processor improvements (#577) 2024-12-06 11:46:16 -08:00
cli No need to use os.path.relpath() when Path() knows everything anyway 2024-11-23 11:45:47 -08:00
distribution Make LlamaStackLibraryClient work correctly (#581) 2024-12-07 14:59:36 -08:00
providers Make LlamaStackLibraryClient work correctly (#581) 2024-12-07 14:59:36 -08:00
scripts Integrate distro docs into the restructured docs 2024-11-20 23:20:05 -08:00
templates Add eval/scoring/datasetio API providers to distribution templates & UI developer guide (#564) 2024-12-05 16:29:32 -08:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00