liyunlu0618 4e1105e563 Fix fp8 quantization script. (#500) ... # What does this PR do? Fix fp8 quantization script. ## Test Plan ``` sh run_quantize_checkpoint.sh localhost fp8 /home/yll/fp8_test/ /home/yll/fp8_test/quantized_2 /home/yll/fp8_test/tokenizer.model 1 1 ``` ## Sources Please link relevant resources if necessary. ## Before submitting - [x] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case). - [x] Ran pre-commit to handle lint / formatting issues. - [x] Read the [contributor guideline](https://github.com/meta-llama/llama-stack/blob/main/CONTRIBUTING.md), Pull Request section? - [x] Updated relevant documentation. - [x] Wrote necessary unit or integration tests. Co-authored-by: Yunlu Li <yll@meta.com>		2024-11-21 09:15:28 -08:00
..
apis	Support Tavily as built-in search tool. (#485)	2024-11-19 20:59:02 -08:00
cli	Don't depend on templates.py when print llama stack build messages (#496)	2024-11-20 15:44:49 -08:00
distribution	Make run yaml optional so dockers can start with just --env (#492)	2024-11-20 13:11:40 -08:00
providers	Fix fp8 quantization script. (#500)	2024-11-21 09:15:28 -08:00
scripts	Integrate distro docs into the restructured docs	2024-11-20 23:20:05 -08:00
templates	Integrate distro docs into the restructured docs	2024-11-20 23:20:05 -08:00
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00