phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-29 07:14:20 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

readme

Browse source
This commit is contained in:
Xi Yan 2024-10-15 12:02:31 -07:00
parent d1f8515a78
commit 7c450f8660
1 changed files with 6 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

7
llama_stack/distribution/docker/README.md
View file

@ -3,7 +3,7 @@
This folder contains scripts to enable starting a distribution using `docker compose`.
#### TGI Inference Adapter
#### Example: TGI Inference Adapter
```
$ cd llama_stack/distribution/docker/tgi
$ ls
@ -21,3 +21,8 @@ INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://[::]:5000 (Press CTRL+C to quit)
```
To kill the server
```
docker compose down
```