phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-17 14:09:48 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Reverted outdated changes

Browse source
This commit is contained in:
Chantal D Gama Rose 2024-12-03 19:22:05 -08:00
parent 5b027d2de5
commit deecc27b66
6 changed files with 5 additions and 728 deletions
Download patch file Download diff file Expand all files Collapse all files

6
llama_stack/templates/nvidia/doc_template.md
View file

@ -47,14 +47,14 @@ docker run \
llamastack/distribution-{{ name }} \
--yaml-config /root/my-run.yaml \
--port $LLAMA_STACK_PORT \
--env FIREWORKS_API_KEY=$FIREWORKS_API_KEY
--env NVIDIA_API_KEY=$NVIDIA_API_KEY
```
### Via Conda
```bash
llama stack build --template fireworks --image-type conda
llama stack build --template nvidia --image-type conda
llama stack run ./run.yaml \
--port 5001 \
--env FIREWORKS_API_KEY=$FIREWORKS_API_KEY
--env NVIDIA_API_KEY=$NVIDIA_API_KEY
```

6
llama_stack/templates/nvidia/nvidia.py
View file

@ -6,11 +6,9 @@
from pathlib import Path
from llama_models.sku_list import all_registered_models
from llama_stack.distribution.datatypes import ModelInput, Provider, ShieldInput
from llama_stack.distribution.datatypes import ModelInput, Provider
from llama_stack.providers.remote.inference.nvidia import NVIDIAConfig
from llama_stack.providers.remote.inference.nvidia._nvidia import _MODEL_ALIASES
from llama_stack.providers.remote.inference.nvidia.nvidia import _MODEL_ALIASES
from llama_stack.templates.template import DistributionTemplate, RunConfigSettings