llama-stack-mirror/llama_stack/providers/impls/meta_reference/inference
2024-10-09 11:56:02 -07:00
..
quantization fix fp8 imports 2024-10-03 14:40:21 -07:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
config.py Use inference APIs for executing Llama Guard (#121) 2024-09-28 15:40:06 -07:00
generation.py send/recv pydantic json over socket 2024-10-09 09:31:37 -07:00
inference.py [bugfix] Fix logprobs on meta-reference impl (#213) 2024-10-07 19:42:39 -07:00
model_parallel.py fixup 2024-10-09 09:33:25 -07:00
parallel_utils.py second round of feedback 2024-10-09 11:56:02 -07:00