phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-29 15:23:51 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Add llama download cli reference for multiple models

Browse source
This commit is contained in:
ABucket 2024-10-12 14:29:43 +08:00 • committed by GitHub
parent 8fcded0004
commit 4b78f3dce6
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 8 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

9
docs/cli_reference.md
View file

@ -110,19 +110,26 @@ llama download --source meta --model-id Llama3.2-11B-Vision-Instruct --meta-url
# safety models -- Llama-Guard and Prompt-Guard # safety models -- Llama-Guard and Prompt-Guard
llama download --source meta --model-id Prompt-Guard-86M --meta-url META_URL llama download --source meta --model-id Prompt-Guard-86M --meta-url META_URL
llama download --source meta --model-id Llama-Guard-3-1B --meta-url META_URL llama download --source meta --model-id Llama-Guard-3-1B --meta-url META_URL
# Download multiple models with a single command
llama download --source meta --model-ids Llama3.2-3B-Instruct,Llama3.2-11B-Vision-Instruct --meta-url META_URL_1,META_URL_2
``` ```
#### Downloading from [Hugging Face](https://huggingface.co/meta-llama) #### Downloading from [Hugging Face](https://huggingface.co/meta-llama)
Essentially, the same commands above work, just replace `--source meta` with `--source huggingface`. Essentially, the same commands above work, just replace `--source meta` with `--source huggingface`.
```bash ```bash
llama download --source huggingface --model-id Llama3.1-8B-Instruct --hf-token <HF_TOKEN> llama download --source huggingface --model-id Llama3.1-8B-Instruct --hf-token <HF_TOKEN>
llama download --source huggingface --model-id Llama3.1-70B-Instruct --hf-token <HF_TOKEN> llama download --source huggingface --model-id Llama3.1-70B-Instruct --hf-token <HF_TOKEN>
llama download --source huggingface --model-id Llama-Guard-3-1B --ignore-patterns *original* llama download --source huggingface --model-id Llama-Guard-3-1B --ignore-patterns *original*
llama download --source huggingface --model-id Prompt-Guard-86M --ignore-patterns *original* llama download --source huggingface --model-id Prompt-Guard-86M --ignore-patterns *original*
# Download multiple models with a single command
llama download --source huggingface --model-ids Llama3.2-3B-Instruct,Llama3.2-11B-Vision-Instruct --hf-token <HF_TOKEN>
``` ```
**Important:** Set your environment variable `HF_TOKEN` or pass in `--hf-token` to the command to validate your access. You can find your token at [https://huggingface.co/settings/tokens](https://huggingface.co/settings/tokens). **Important:** Set your environment variable `HF_TOKEN` or pass in `--hf-token` to the command to validate your access. You can find your token at [https://huggingface.co/settings/tokens](https://huggingface.co/settings/tokens).