phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

Update getting_started.md

Browse source
This commit is contained in:
Xi Yan 2024-09-16 11:55:10 -07:00 • committed by GitHub
parent d9147f3184
commit ed4272e31e
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 3 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
docs/getting_started.md
View file

@ -285,6 +285,9 @@ INFO: Uvicorn running on http://[::]:5000 (Press CTRL+C to quit)
> [!IMPORTANT] > [!IMPORTANT]
> The "local" distribution inference server currently only supports CUDA. It will not work on Apple Silicon machines. > The "local" distribution inference server currently only supports CUDA. It will not work on Apple Silicon machines.
> [!TIP]
> You might need to use the flag `--disable-ipv6` to Disable IPv6 support
This server is running a Llama model locally. This server is running a Llama model locally.
## Step 4. Test with Client ## Step 4. Test with Client