phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

add Llama3.2-3B-Instruct:int4-qlora-eo8

Browse source
This commit is contained in:
Xi Yan 2024-11-05 15:22:26 -08:00
parent 16b7fa4614
commit 0706f6c82f
1 changed files with 1 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

3
docs/source/getting_started/distributions/self_hosted_distro/meta-reference-quantized-gpu.md
View file

@ -14,8 +14,7 @@ Please make sure you have llama model checkpoints downloaded in `~/.llama` befor
```
$ ls ~/.llama/checkpoints
Llama3.1-8B Llama3.2-11B-Vision-Instruct Llama3.2-1B-Instruct Llama3.2-90B-Vision-Instruct Llama-Guard-3-8B
Llama3.1-8B-Instruct Llama3.2-1B Llama3.2-3B-Instruct Llama-Guard-3-1B Prompt-Guard-86M
Llama3.2-3B-Instruct:int4-qlora-eo8
```
### Step 1. Start the Distribution