phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

fix(vertex_httpx.py): support async completion calls

Browse source
This commit is contained in:
Krrish Dholakia 2024-06-12 20:15:03 -07:00
parent 3955b058ed
commit 995631bd39
3 changed files with 142 additions and 22 deletions
Download patch file Download diff file Expand all files Collapse all files

1
litellm/main.py
View file

@ -329,6 +329,7 @@ async def acompletion(
or custom_llm_provider == "ollama_chat"
or custom_llm_provider == "replicate"
or custom_llm_provider == "vertex_ai"
or custom_llm_provider == "vertex_ai_beta"
or custom_llm_provider == "gemini"
or custom_llm_provider == "sagemaker"
or custom_llm_provider == "anthropic"