phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-08 19:10:56 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/llama_stack/apis/inference
History
Ashwin Bharambe 0c9eb3341c Separate chat_completion stream and non-stream implementations 
This is a pretty important requirement. The streaming response type is
an AsyncGenerator while the non-stream one is a single object. So far
this has worked _sometimes_ due to various pre-existing hacks (and in
some cases, just failed.)
2024-10-08 17:23:40 -07:00
..
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
client.py Separate chat_completion stream and non-stream implementations 2024-10-08 17:23:40 -07:00
event_logger.py pre-commit lint 2024-09-28 16:04:41 -07:00
inference.py Separate chat_completion stream and non-stream implementations 2024-10-08 17:23:40 -07:00