phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-08 11:07:22 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/llama_stack/distribution/routers
History
Ashwin Bharambe 0c9eb3341c Separate chat_completion stream and non-stream implementations 
This is a pretty important requirement. The streaming response type is
an AsyncGenerator while the non-stream one is a single object. So far
this has worked _sometimes_ due to various pre-existing hacks (and in
some cases, just failed.)
2024-10-08 17:23:40 -07:00
..
__init__.py Push registration methods onto the backing providers 2024-10-08 17:23:02 -07:00
routers.py Separate chat_completion stream and non-stream implementations 2024-10-08 17:23:40 -07:00
routing_tables.py Add really basic testing for memory API 2024-10-08 17:23:02 -07:00