phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-06-27 18:50:41 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix: make vision and embedding tests pass with openai, anthropic and gemini

Browse source 
NOTE - Anthropic embeddings do not work due to LiteLLM not supporting
them.
This commit is contained in:
Ashwin Bharambe 2025-02-26 10:52:33 -08:00
parent abfc4b3bce
commit 4cf95475e5
4 changed files with 10 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

1
llama_stack/providers/utils/inference/litellm_openai_mixin.py
View file

@ -97,7 +97,6 @@ class LiteLLMOpenAIMixin(
)
params = await self._get_params(request)
# unfortunately, we need to use synchronous litellm.completion here because litellm
# caches various httpx.client objects in a non-eventloop aware manner
response = litellm.completion(**params)