phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-06-28 02:53:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

add Llama3.2-3B-Instruct:int4-qlora-eo8

Browse source
This commit is contained in:
Xi Yan 2024-11-05 15:22:26 -08:00
parent 16b7fa4614
commit 0706f6c82f
1 changed files with 1 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

3
docs/source/getting_started/distributions/self_hosted_distro/meta-reference-quantized-gpu.md
View file

@ -14,8 +14,7 @@ Please make sure you have llama model checkpoints downloaded in `~/.llama` befor
```
$ ls ~/.llama/checkpoints
Llama3.1-8B Llama3.2-11B-Vision-Instruct Llama3.2-1B-Instruct Llama3.2-90B-Vision-Instruct Llama-Guard-3-8B
Llama3.1-8B-Instruct Llama3.2-1B Llama3.2-3B-Instruct Llama-Guard-3-1B Prompt-Guard-86M
Llama3.2-3B-Instruct:int4-qlora-eo8
```
### Step 1. Start the Distribution