mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-12-23 04:29:40 +00:00
474b50b422
This change lets users configure default embedding models at the provider level instead of always relying on system defaults. Each vector store provider can now specify an embedding_model and optional embedding_dimension in their config. Key features: - Auto-dimension lookup for standard models from the registry - Support for Matryoshka embeddings with custom dimensions - Three-tier priority: explicit params > provider config > system fallback - Full backward compatibility - existing setups work unchanged - Comprehensive test coverage with 20 test cases Updated all vector IO providers (FAISS, Chroma, Milvus, Qdrant, etc.) with the new config fields and added detailed documentation with examples. Fixes #2729
1 KiB
1 KiB
remote::qdrant
Description
Please refer to the inline provider documentation.
Configuration
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
location |
str | None |
No | ||
url |
str | None |
No | ||
port |
int | None |
No | 6333 | |
grpc_port |
<class 'int'> |
No | 6334 | |
prefer_grpc |
<class 'bool'> |
No | False | |
https |
bool | None |
No | ||
api_key |
str | None |
No | ||
prefix |
str | None |
No | ||
timeout |
int | None |
No | ||
host |
str | None |
No | ||
embedding_model |
str | None |
No | Optional default embedding model for this provider. If not specified, will use system default. | |
embedding_dimension |
int | None |
No | Optional embedding dimension override. Only needed for models with variable dimensions (e.g., Matryoshka embeddings). If not specified, will auto-lookup from model registry. |
Sample Configuration
api_key: ${env.QDRANT_API_KEY}