phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-09 19:29:18 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/llama_stack/providers/impls/meta_reference/inference
History
Ashwin Bharambe 0c9eb3341c Separate chat_completion stream and non-stream implementations 
This is a pretty important requirement. The streaming response type is
an AsyncGenerator while the non-stream one is a single object. So far
this has worked _sometimes_ due to various pre-existing hacks (and in
some cases, just failed.)
2024-10-08 17:23:40 -07:00
..
quantization fix fp8 imports 2024-10-03 14:40:21 -07:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
config.py Use inference APIs for executing Llama Guard (#121) 2024-09-28 15:40:06 -07:00
generation.py [bugfix] Fix logprobs on meta-reference impl (#213) 2024-10-07 19:42:39 -07:00
inference.py Separate chat_completion stream and non-stream implementations 2024-10-08 17:23:40 -07:00
model_parallel.py API Updates (#73) 2024-09-17 19:51:35 -07:00
parallel_utils.py API Updates (#73) 2024-09-17 19:51:35 -07:00