phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(perf) use aiohttp for custom_openai (#7514)

Browse source 
* use aiohttp handler

* BaseLLMAIOHTTPHandler

* use CustomOpenAIChatConfig

* CustomOpenAIChatConfig

* CustomOpenAIChatConfig

* fix linting

* AiohttpOpenAIChatConfig

* fix order

* aiohttp_openai
This commit is contained in:
Ishaan Jaff 2025-01-02 22:15:17 -08:00 • committed by GitHub
parent 4d93fe787b
commit d861aa8ff3
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
8 changed files with 519 additions and 29 deletions
Download patch file Download diff file Expand all files Collapse all files

2
litellm/utils.py
View file

@ -6147,6 +6147,8 @@ class ProviderConfigManager:
or litellm.LlmProviders.LITELLM_PROXY == provider
):
return litellm.OpenAILikeChatConfig()
elif litellm.LlmProviders.AIOHTTP_OPENAI == provider:
return litellm.AiohttpOpenAIChatConfig()
elif litellm.LlmProviders.HOSTED_VLLM == provider:
return litellm.HostedVLLMChatConfig()
elif litellm.LlmProviders.LM_STUDIO == provider: