liyunlu0618 4e1105e563 Fix fp8 quantization script. (#500) ... # What does this PR do? Fix fp8 quantization script. ## Test Plan ``` sh run_quantize_checkpoint.sh localhost fp8 /home/yll/fp8_test/ /home/yll/fp8_test/quantized_2 /home/yll/fp8_test/tokenizer.model 1 1 ``` ## Sources Please link relevant resources if necessary. ## Before submitting - [x] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case). - [x] Ran pre-commit to handle lint / formatting issues. - [x] Read the [contributor guideline](https://github.com/meta-llama/llama-stack/blob/main/CONTRIBUTING.md), Pull Request section? - [x] Updated relevant documentation. - [x] Wrote necessary unit or integration tests. Co-authored-by: Yunlu Li <yll@meta.com>		2024-11-21 09:15:28 -08:00
..
quantization	Fix fp8 quantization script. (#500)	2024-11-21 09:15:28 -08:00
__init__.py	Add provider deprecation support; change directory structure (#397)	2024-11-07 13:04:53 -08:00
config.py	Integrate distro docs into the restructured docs	2024-11-20 23:20:05 -08:00
generation.py	Auto-generate distro yamls + docs (#468)	2024-11-18 14:57:06 -08:00
inference.py	unregister for memory banks and remove update API (#458)	2024-11-14 17:12:11 -08:00
model_parallel.py	Add provider deprecation support; change directory structure (#397)	2024-11-07 13:04:53 -08:00
parallel_utils.py	precommit	2024-11-08 17:58:58 -08:00