llama-stack-mirror/llama_stack/providers/registry
Dinesh Yeduguru d362d2d740 implement embedding generation in supported inference providers (#589)
This PR adds the ability to generate embeddings in all supported
inference providers.

```
pytest -v -s llama_stack/providers/tests/inference/test_embeddings.py -k "bedrock" --inference-model="amazon.titan-embed-text-v2:0"  --env EMBEDDING_DIMENSION=1024

 pytest -v -s -k "vllm"  --inferrence-model="intfloat/e5-mistral-7b-instruct"  llama_stack/providers/tests/inference/test_embeddings.py --env EMBEDDING_DIMENSION=4096  --env VLLM_URL="http://localhost:9798/v1"

pytest -v -s --inference-model="nomic-ai/nomic-embed-text-v1.5"  llama_stack/providers/tests/inference/test_embeddings.py  -k "fireworks"  --env FIREWORKS_API_KEY=<API_KEY>--env EMBEDDING_DIMENSION=128

pytest -v -s --inference-model="togethercomputer/m2-bert-80M-2k-retrieval"  llama_stack/providers/tests/inference/test_embeddings.py  -k "together"  --env TOGETHER_API_KEY=<API_KEY>--env EMBEDDING_DIMENSION=768

pytest -v -s -k "ollama"  --inference-model="all-minilm:v8"  llama_stack/providers/tests/inference/test_embeddings.py --env EMBEDDING_DIMENSION=384

 torchrun $CONDA_PREFIX/bin/pytest -v -s -k "meta_reference" --inference-model="sentence-transformers/all-MiniLM-L6-v2"  llama_stack/providers/tests/inference/test_embeddings.py --env EMBEDDING_DIMENSION=384

```
2024-12-12 11:25:09 -08:00
..
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
agents.py Rename all inline providers with an inline:: prefix (#423) 2024-11-11 22:19:16 -08:00
datasetio.py move hf addapter->remote (#459) 2024-11-14 22:41:19 -05:00
eval.py [Agentic Eval] add ability to run agents generation (#469) 2024-11-18 11:43:03 -08:00
inference.py implement embedding generation in supported inference providers (#589) 2024-12-12 11:25:09 -08:00
memory.py implement embedding generation in supported inference providers (#589) 2024-12-12 11:25:09 -08:00
safety.py Fix llama stack build in 0.0.54 (#505) 2024-11-22 16:23:44 -05:00
scoring.py fixes tests & move braintrust api_keys to request headers (#535) 2024-11-26 13:11:21 -08:00
telemetry.py Add ability to query and export spans to dataset (#574) 2024-12-05 21:07:30 -08:00