phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-17 12:02:36 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/distributions/nutanix
History
Jinan Zhou 64c5d38ae9 Nutanix AI on!
2024-12-03 01:49:07 +00:00
..
build.yaml Nutanix AI on! 2024-12-03 01:49:07 +00:00
README.md Nutanix AI on! 2024-12-03 01:49:07 +00:00

README.md

Nutanix Distribution

The llamastack/distribution-nutanix distribution consists of the following provider configurations.

API Inference Agents Memory Safety Telemetry
Provider(s) remote::nutanix meta-reference meta-reference meta-reference meta-reference

Start the Distribution (Hosted remote)

Note

This assumes you have an hosted Nutanix AI endpoint and an API Key.

  1. Clone the repo
git clone git@github.com:meta-llama/llama-stack.git
cd llama-stack
  1. Config the model name

Please adjust the NUTANIX_SUPPORTED_MODELS variable at line 29 in llama_stack/providers/adapters/inference/nutanix/nutanix.py according to your deployment.

  1. Build the distrbution
pip install -e .
llama stack build --template nutanix --name ntnx --image-type conda
  1. Set the endpoint URL and API Key
llama stack configure ntnx
  1. Serve and enjoy!
llama stack run ntnx --port 174