phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-27 21:52:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
2014 commits 57 branches 151 tags 128 MiB
Commit graph

3 commits

Author SHA1 Message Date
Ashwin Bharambe
6cbb3366f2 more fixes, gah 2025-06-01 17:07:18 -07:00
Ashwin Bharambe
6f4f51f8d9 apply anti affinity and separate PVCs for the models so the two vllms can be mapped to two nodes and avoid causing unnecessary memory pressure 2025-06-01 16:54:36 -07:00
Ashwin Bharambe
4121166784 split off safety so it can be applied one at a time 2025-06-01 15:59:00 -07:00