phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-26 14:17:44 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix: remove sentence-transformers from remote vllm

Browse source 
vLLM itself can perform the embeddings generation so we don't need this
extra provider.

Signed-off-by: Sébastien Han <seb@redhat.com>
This commit is contained in:
Sébastien Han 2025-06-03 18:00:27 +02:00
parent 3c9a10d2fe
commit 7e30b5a466
No known key found for this signature in database
5 changed files with 6 additions and 22 deletions
Download patch file Download diff file Expand all files Collapse all files

1
llama_stack/templates/remote-vllm/build.yaml
View file

@ -4,7 +4,6 @@ distribution_spec:
providers:
inference:
- remote::vllm
- inline::sentence-transformers
vector_io:
- inline::faiss
- remote::chromadb