phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-08 19:10:56 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/llama_stack/providers/impls
History
Ashwin Bharambe 0c9eb3341c Separate chat_completion stream and non-stream implementations 
This is a pretty important requirement. The streaming response type is
an AsyncGenerator while the non-stream one is a single object. So far
this has worked _sometimes_ due to various pre-existing hacks (and in
some cases, just failed.)
2024-10-08 17:23:40 -07:00
..
ios/inference Drop header from LocalInference.h 2024-09-25 11:27:37 -07:00
meta_reference Separate chat_completion stream and non-stream implementations 2024-10-08 17:23:40 -07:00
vllm more fixes, plug shutdown handlers 2024-10-08 17:23:02 -07:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00