From e60793af118111d6df87c5f7af3237115f8d169c Mon Sep 17 00:00:00 2001 From: Xi Yan Date: Tue, 29 Oct 2024 19:48:11 -0700 Subject: [PATCH] update --- docs/source/getting_started/index.md | 19 +++++++++---------- 1 file changed, 9 insertions(+), 10 deletions(-) diff --git a/docs/source/getting_started/index.md b/docs/source/getting_started/index.md index 5a1ad5be8..6c65f7398 100644 --- a/docs/source/getting_started/index.md +++ b/docs/source/getting_started/index.md @@ -58,9 +58,9 @@ If so, we suggest: ### Quick Start Commands -#### Single-Node GPU (Local Inference) +#### Single-Node GPU -##### Docker +**Docker** ````{tab-set-code} ```{code-block} meta-reference-gpu @@ -72,7 +72,7 @@ $ cd distributions/tgi && docker compose up ``` ```` -##### Conda +**Conda** ````{tab-set-code} @@ -88,8 +88,8 @@ $ cd distributions/tgi && llama stack run ./run.yaml ```` -#### Single-Node CPU/GPU (Local Inference) -##### Docker +#### Single-Node CPU +**Docker** ````{tab-set-code} ```{code-block} ollama @@ -98,7 +98,7 @@ $ cd distributions/ollama/cpu && docker compose up ```` -##### Conda +**Conda** ````{tab-set-code} ```{code-block} ollama @@ -108,10 +108,9 @@ $ cd distributions/ollama && llama stack run ./run.yaml ```` -#### Single-Node CPU (Remote Inference) - -##### Docker +#### Single-Node CPU + Hosted Endpoint +**Docker** ````{tab-set-code} ```{code-block} together @@ -124,7 +123,7 @@ $ cd distributions/fireworks && docker compose up ```` -##### Conda +**Conda** ````{tab-set-code} ```{code-block} together