phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-23 21:04:29 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Add OLLAMA_EMBEDDING_MODEL to starter distro

Browse source 
This allows a user to specify the Ollama Embedding Model to use, if any.

Signed-off-by: Ben Browning <bbrownin@redhat.com>
This commit is contained in:
Ben Browning 2025-06-25 09:16:01 -04:00
parent 497c97487f
commit 9239b338d5
2 changed files with 21 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

6
llama_stack/templates/starter/run.yaml
View file

@ -542,6 +542,12 @@ models:
provider_id: ollama
provider_model_id: ${env.OLLAMA_INFERENCE_MODEL:__disabled__}
model_type: llm
- metadata:
embedding_dimension: ${env.OLLAMA_EMBEDDING_DIMENSION:384}
model_id: ollama/${env.OLLAMA_EMBEDDING_MODEL:__disabled__}
provider_id: ollama
provider_model_id: ${env.OLLAMA_EMBEDDING_MODEL:__disabled__}
model_type: embedding
- metadata: {}
model_id: anthropic/claude-3-5-sonnet-latest
provider_id: anthropic