Dinesh Yeduguru 4f8b73b9e1 Vector store inference api (#598) ... # What does this PR do? Moves all the memory providers to use the inference API and improved the memory tests to setup the inference stack correctly and use the embedding models ## Test Plan torchrun $CONDA_PREFIX/bin/pytest -v -s -k "meta_reference" --inference-model="Llama3.2-3B-Instruct" --embedding-model="sentence-transformers/all-MiniLM-L6-v2" llama_stack/providers/tests/inference/test_embeddings.py --env EMBEDDING_DIMENSION=384 pytest -v -s llama_stack/providers/tests/memory/test_memory.py --providers="inference=together,memory=weaviate" --embedding-model="togethercomputer/m2-bert-80M-2k-retrieval" --env EMBEDDING_DIMENSION=768 --env TOGETHER_API_KEY=<API-KEY> --env WEAVIATE_API_KEY=foo --env WEAVIATE_CLUSTER_URL=bar pytest -v -s llama_stack/providers/tests/memory/test_memory.py --providers="inference=together,memory=chroma" --embedding-model="togethercomputer/m2-bert-80M-2k-retrieval" --env EMBEDDING_DIMENSION=768 --env TOGETHER_API_KEY=<API-KEY>--env CHROMA_HOST=localhost --env CHROMA_PORT=8000 pytest -v -s llama_stack/providers/tests/memory/test_memory.py --providers="inference=together,memory=pgvector" --embedding-model="togethercomputer/m2-bert-80M-2k-retrieval" --env PGVECTOR_DB=postgres --env PGVECTOR_USER=postgres --env PGVECTOR_PASSWORD=mysecretpassword --env PGVECTOR_HOST=0.0.0.0 --env EMBEDDING_DIMENSION=768 --env TOGETHER_API_KEY=<API-KEY> pytest -v -s llama_stack/providers/tests/memory/test_memory.py --providers="inference=together,memory=faiss" --embedding-model="togethercomputer/m2-bert-80M-2k-retrieval" --env EMBEDDING_DIMENSION=768 --env TOGETHER_API_KEY=<API-KEY>		2024-12-12 11:16:54 -08:00
..
__init__.py	API Updates (#73)	2024-09-17 19:51:35 -07:00
agents.py	Rename all inline providers with an inline:: prefix (#423)	2024-11-11 22:19:16 -08:00
datasetio.py	move hf addapter->remote (#459)	2024-11-14 22:41:19 -05:00
eval.py	[Agentic Eval] add ability to run agents generation (#469)	2024-11-18 11:43:03 -08:00
inference.py	implement embedding generation in supported inference providers	2024-12-11 10:35:00 -08:00
memory.py	Vector store inference api (#598)	2024-12-12 11:16:54 -08:00
safety.py	Fix llama stack build in 0.0.54 (#505)	2024-11-22 16:23:44 -05:00
scoring.py	fixes tests & move braintrust api_keys to request headers (#535)	2024-11-26 13:11:21 -08:00
telemetry.py	Add ability to query and export spans to dataset (#574)	2024-12-05 21:07:30 -08:00