llama-stack-mirror/llama_stack/providers/inline/inference
Hardik Shah 6ec2ed4196
feat: New OpenAI compat embeddings API (#2314)
# What does this PR do?
Adds a new endpoint that is compatible with OpenAI for embeddings api. 
`/openai/v1/embeddings`
Added providers for OpenAI, LiteLLM and SentenceTransformer. 


## Test Plan
```
LLAMA_STACK_CONFIG=http://localhost:8321 pytest -sv tests/integration/inference/test_openai_embeddings.py --embedding-model all-MiniLM-L6-v2,text-embedding-3-small,gemini/text-embedding-004
```
2025-06-01 17:55:12 +05:30
..
meta_reference chore: make cprint write to stderr (#2250) 2025-05-24 23:39:57 -07:00
sentence_transformers feat: introduce APIs for retrieving chat completion requests (#2145) 2025-05-18 21:43:19 -07:00
vllm feat: New OpenAI compat embeddings API (#2314) 2025-06-01 17:55:12 +05:30
__init__.py precommit 2024-11-08 17:58:58 -08:00