phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-10-18 23:28:53 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

release notes

Browse source
This commit is contained in:
Xi Yan 2024-11-02 17:15:07 -07:00
parent 9c0dac5832
commit c7f87fcbe7
5 changed files with 5 additions and 4 deletions
Download patch file Download diff file Expand all files Collapse all files

2
docs/source/getting_started/distributions/tgi.md
View file

@ -88,7 +88,7 @@ inference:
```
### Model Serving
### (Optional) Update Model Serving Configuration
To serve a new model with `tgi`, change the docker command flag `--model-id <model-to-serve>`.
This can be done by edit the `command` args in `compose.yaml`. E.g. Replace "Llama-3.2-1B-Instruct" with the model you want to serve.