phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions
llama-stack/llama_stack/providers/inline/inference/meta_reference
History
Ashwin Bharambe 9f14382d82
meta reference inference fixes (#797) 
Miscellaneous fixes for meta reference inference

Tests for log probs dont pass because meta reference does not support
top_k > 1
2025-01-16 18:17:46 -08:00
..
quantization Make llama stack build not create a new conda by default (#788) 2025-01-16 13:44:53 -08:00
__init__.py Add provider deprecation support; change directory structure (#397) 2024-11-07 13:04:53 -08:00
config.py [remove import *] clean up import *'s (#689) 2024-12-27 15:45:44 -08:00
generation.py Convert SamplingParams.strategy to a union (#767) 2025-01-15 05:38:51 -08:00
inference.py meta reference inference fixes (#797) 2025-01-16 18:17:46 -08:00
model_parallel.py Fix Meta reference GPU implementation (#663) 2024-12-19 14:09:45 -08:00
parallel_utils.py Update types in parallel_utils for meta-refernece-gpu impl 2024-12-19 13:58:41 -08:00