Commit graph

4 commits

Author SHA1 Message Date
Ashwin Bharambe
e51107e019 Fix compose.yaml 2024-11-12 15:43:30 -08:00
Ashwin Bharambe
e4f14eafe2 Use GPUs 0 and 1 2024-11-12 14:21:22 -08:00
Ashwin Bharambe
1245a625ce Update vllm compose and run YAMLs 2024-11-12 14:17:38 -08:00
Ashwin Bharambe
4986e46188
Distributions updates (slight updates to ollama, add inline-vllm and remote-vllm) (#408)
* remote vllm distro

* add inline-vllm details, fix things

* Write some docs
2024-11-08 18:09:39 -08:00