phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-08-12 13:00:39 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Run distro codegen for real

Browse source
This commit is contained in:
Ashwin Bharambe 2025-02-20 16:58:06 -08:00
parent 587c429e08
commit 6e03c3fb69
2 changed files with 4 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

1
docs/source/distributions/remote_hosted_distro/nvidia.md
View file

@ -36,6 +36,7 @@ The following models are available by default:
- `meta-llama/Llama-3.2-3B-Instruct (meta/llama-3.2-3b-instruct)`
- `meta-llama/Llama-3.2-11B-Vision-Instruct (meta/llama-3.2-11b-vision-instruct)`
- `meta-llama/Llama-3.2-90B-Vision-Instruct (meta/llama-3.2-90b-vision-instruct)`
- `baai/bge-m3 (baai/bge-m3)`
### Prerequisite: API Keys

6
llama_stack/templates/nvidia/run.yaml
View file

@ -135,9 +135,9 @@ models:
provider_id: nvidia
provider_model_id: meta/llama-3.2-90b-vision-instruct
model_type: llm
- metadata: {
embedding_dimension: 1024
}
- metadata:
embedding_dimensions: 1024
context_length: 8192
model_id: baai/bge-m3
provider_id: nvidia
provider_model_id: baai/bge-m3