Ashwin Bharambe 199f859eec feat(vllm): periodically refresh models (#2823) ... Just like #2805 but for vLLM. We also make VLLM_URL env variable optional (not required) -- if not specified, the provider silently sits idle and yells eventually if someone tries to call a completion on it. This is done so as to allow this provider to be present in the `starter` distribution. ## Test Plan Set up vLLM, copy the starter template and set `{ refresh_models: true, refresh_models_interval: 10 }` for the vllm provider and then run: ``` ENABLE_VLLM=vllm VLLM_URL=http://localhost:8000/v1 \ uv run llama stack run --image-type venv /tmp/starter.yaml ``` Verify that `llama-stack-client models list` brings up the model correctly from vLLM.		2025-07-18 15:53:09 -07:00
..
__init__.py	refactor: rename dev distro as starter (#2181)	2025-05-15 12:52:34 -07:00
build.yaml	fix(starter): Add missing faiss provider to build.yaml vector_io section (#2625)	2025-07-04 17:28:57 +02:00
run.yaml	feat(vllm): periodically refresh models (#2823)	2025-07-18 15:53:09 -07:00
starter.py	fix: Move sentence-transformers to the top (#2703)	2025-07-17 10:31:30 -04:00