From ed4272e31ec4de9c5980ee2f8d1c5cf743a2d9a2 Mon Sep 17 00:00:00 2001 From: Xi Yan Date: Mon, 16 Sep 2024 11:55:10 -0700 Subject: [PATCH] Update getting_started.md --- docs/getting_started.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/docs/getting_started.md b/docs/getting_started.md index 556d675be..a312b8f33 100644 --- a/docs/getting_started.md +++ b/docs/getting_started.md @@ -285,6 +285,9 @@ INFO: Uvicorn running on http://[::]:5000 (Press CTRL+C to quit) > [!IMPORTANT] > The "local" distribution inference server currently only supports CUDA. It will not work on Apple Silicon machines. +> [!TIP] +> You might need to use the flag `--disable-ipv6` to Disable IPv6 support + This server is running a Llama model locally. ## Step 4. Test with Client