llama-stack-mirror/llama_stack/providers/utils/inference
Ashwin Bharambe 81ce39a607
feat(api): Add options for supporting various embedding models (#1192)
We need to support:
- asymmetric embedding models (#934)
- truncation policies (#933)
- varying dimensional output (#932) 

## Test Plan

```bash
$ cd llama_stack/providers/tests/inference
$ pytest -s -v -k fireworks test_embeddings.py \
   --inference-model nomic-ai/nomic-embed-text-v1.5 --env EMBEDDING_DIMENSION=784
$  pytest -s -v -k together test_embeddings.py \
   --inference-model togethercomputer/m2-bert-80M-8k-retrieval --env EMBEDDING_DIMENSION=784
$ pytest -s -v -k ollama test_embeddings.py \
   --inference-model all-minilm:latest --env EMBEDDING_DIMENSION=784
```
2025-02-20 22:27:12 -08:00
..
__init__.py chore: move all Llama Stack types from llama-models to llama-stack (#1098) 2025-02-14 09:10:59 -08:00
embedding_mixin.py feat(api): Add options for supporting various embedding models (#1192) 2025-02-20 22:27:12 -08:00
model_registry.py feat: register embedding models for ollama, together, fireworks (#1190) 2025-02-20 15:39:08 -08:00
openai_compat.py chore: remove llama_models.llama3.api imports from providers (#1107) 2025-02-19 19:01:29 -08:00
prompt_adapter.py fix: pass tool_prompt_format to chat_formatter (#1198) 2025-02-20 21:38:35 -08:00