llama-stack/llama_stack/providers/inline/inference/meta_reference
Dinesh Yeduguru 96e158eaac
Make embedding generation go through inference (#606)
This PR does the following:
1) adds the ability to generate embeddings in all supported inference
providers.
2) Moves all the memory providers to use the inference API and improved
the memory tests to setup the inference stack correctly and use the
embedding models

This is a merge from #589 and #598
2024-12-12 11:47:50 -08:00
..
quantization use logging instead of prints (#499) 2024-11-21 11:32:53 -08:00
__init__.py Add provider deprecation support; change directory structure (#397) 2024-11-07 13:04:53 -08:00
config.py Integrate distro docs into the restructured docs 2024-11-20 23:20:05 -08:00
generation.py use logging instead of prints (#499) 2024-11-21 11:32:53 -08:00
inference.py Make embedding generation go through inference (#606) 2024-12-12 11:47:50 -08:00
model_parallel.py Add provider deprecation support; change directory structure (#397) 2024-11-07 13:04:53 -08:00
parallel_utils.py use logging instead of prints (#499) 2024-11-21 11:32:53 -08:00