llama-stack-mirror/llama_stack/providers/impls/meta_reference/inference
Xi Yan 4d5f7459aa
[bugfix] Fix logprobs on meta-reference impl (#213)
* fix log probs

* add back LogProbsConfig

* error handling

* bugfix
2024-10-07 19:42:39 -07:00
..
quantization fix fp8 imports 2024-10-03 14:40:21 -07:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
config.py Use inference APIs for executing Llama Guard (#121) 2024-09-28 15:40:06 -07:00
generation.py [bugfix] Fix logprobs on meta-reference impl (#213) 2024-10-07 19:42:39 -07:00
inference.py [bugfix] Fix logprobs on meta-reference impl (#213) 2024-10-07 19:42:39 -07:00
model_parallel.py API Updates (#73) 2024-09-17 19:51:35 -07:00
parallel_utils.py API Updates (#73) 2024-09-17 19:51:35 -07:00