This commit is contained in:
Xi Yan 2024-10-30 11:13:01 -07:00
parent c2195a0b5c
commit c94fae5ab1
3 changed files with 224 additions and 20 deletions

View file

@ -17,10 +17,7 @@ The `llamastack/distribution-together` distribution consists of the following pr
> This assumes you have an hosted endpoint at Together with API Key.
```
$ cd distributions/together
$ ls
compose.yaml run.yaml
$ docker compose up
$ cd distributions/together && docker compose up
```
Make sure in you `run.yaml` file, you inference provider is pointing to the correct Together URL server endpoint. E.g.