phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-26 06:22:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix: Restore the nvidia distro

Browse source 
The `nvidia` distro was previously collapsed into the `starter`
distro. However, the `nvidia` distro was setup specifically to use
NVIDIA NeMo microservices as providers for all APIs and not just
inference, which means it was doing quite a bit more than what the
`starter` distro covers today.

We should work with our friends at NVIDIA to determine the best place
to maintain this distro long-term, but for now this restores the
`nvidia` distro and its docs back to where they were so that things
continue to work for their users.

Signed-off-by: Ben Browning <bbrownin@redhat.com>
This commit is contained in:
Ben Browning 2025-07-07 12:36:54 -04:00
parent 5561f1c36d
commit 818982a892
8 changed files with 864 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

7
llama_stack/templates/nvidia/__init__.py Normal file
View file

@ -0,0 +1,7 @@
# Copyright (c) Meta Platforms, Inc. and affiliates.
# All rights reserved.
#
# This source code is licensed under the terms described in the LICENSE file in
# the root directory of this source tree.
from .nvidia import get_distribution_template # noqa: F401