phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-30 07:39:38 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

getting started

Browse source
This commit is contained in:
Xi Yan 2024-09-15 11:15:55 -07:00
parent 5977ff69b2
commit a8ef58368c
1 changed files with 4 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

7
docs/getting_started.md
View file

@ -205,8 +205,11 @@ Build spec configuration saved at /home/xiyan/.llama/distributions/docker/docker
## Step 2. Configure ## Step 2. Configure
After our distribution is built (either in form of docker or conda environment), we will run the following command to After our distribution is built (either in form of docker or conda environment), we will run the following command to
``` ```
llama stack configure <path/to/name.build.yaml> llama stack configure [<path/to/name.build.yaml> | <docker-image-name>]
``` ```
- For `conda` environments: <path/to/name.build.yaml> would be the generated build spec saved from Step 1.
- For `docker` images downloaded from Dockerhub, you could also use <docker-image-name> as the argument.
- Run `docker images` to check list of available images on your machine.
``` ```
$ llama stack configure ~/.llama/distributions/conda/8b-instruct-build.yaml $ llama stack configure ~/.llama/distributions/conda/8b-instruct-build.yaml
@ -243,8 +246,6 @@ YAML configuration has been written to ~/.llama/builds/conda/8b-instruct-run.yam
After this step is successful, you should be able to find a run configuration spec in `~/.llama/builds/conda/8b-instruct-run.yaml` with the following contents. You may efit this file to change the settings. After this step is successful, you should be able to find a run configuration spec in `~/.llama/builds/conda/8b-instruct-run.yaml` with the following contents. You may efit this file to change the settings.
> TODO: For Docker, specify docker image instead of build config.
## Step 3. Run ## Step 3. Run
Now, let's start the Llama Stack Distribution Server. You will need the YAML configuration file which was written out at the end by the `llama stack configure` step. Now, let's start the Llama Stack Distribution Server. You will need the YAML configuration file which was written out at the end by the `llama stack configure` step.