diff --git a/docs/source/distributions/kubernetes_deployment.md b/docs/source/distributions/kubernetes_deployment.md index 2daf9d785..21ec02012 100644 --- a/docs/source/distributions/kubernetes_deployment.md +++ b/docs/source/distributions/kubernetes_deployment.md @@ -11,7 +11,12 @@ First, create a local Kubernetes cluster via Kind: kind create cluster --image kindest/node:v1.32.0 --name llama-stack-test ``` -First, create a Kubernetes PVC and Secret for downloading and storing Hugging Face model: +First set your hugging face token as an environment variable. +``` +export HF_TOKEN=$(echo -n "your-hf-token" | base64) +``` + +Now create a Kubernetes PVC and Secret for downloading and storing Hugging Face model: ``` cat </tmp/test-vllm-llama-stack/Containerfile.llama-stack-run-k8s <$tmp_dir/Containerfile.llama-stack-run-k8s <