phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-26 18:18:03 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix: Restore the nvidia distro

Browse source 
The `nvidia` distro was previously collapsed into the `starter`
distro. However, the `nvidia` distro was setup specifically to use
NVIDIA NeMo microservices as providers for all APIs and not just
inference, which means it was doing quite a bit more than what the
`starter` distro covers today.

We should work with our friends at NVIDIA to determine the best place
to maintain this distro long-term, but for now this restores the
`nvidia` distro and its docs back to where they were so that things
continue to work for their users.

Signed-off-by: Ben Browning <bbrownin@redhat.com>
This commit is contained in:
Ben Browning 2025-07-07 12:36:54 -04:00
parent 5561f1c36d
commit 818982a892
8 changed files with 864 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

7
docs/source/distributions/list_of_distributions.md
View file

@ -39,6 +39,13 @@ docker pull llama-stack/distribution-meta-reference-gpu
**Guides:** [Meta Reference GPU Guide](self_hosted_distro/meta-reference-gpu)
### 🖥️ Self-Hosted with NVIDA NeMo Microservices
**Use `nvidia` if you:**
- Want to use Llama Stack with NVIDIA NeMo Microservices
**Guides:** [NVIDIA Distribution Guide](self_hosted_distro/nvidia)
### ☁️ Managed Hosting
**Use remote-hosted endpoints if you:**