phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 11:14:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
18886 commits 2484 branches 894 tags 537 MiB
Commit graph

3 commits

Author SHA1 Message Date
Ishaan Jaff
dc10cebde7 fix _make_common_async_call 2025-01-03 15:15:38 -08:00
Ishaan Jaff
6e2f712b06 (fix) aiohttp_openai/ route - get to 1K RPS on single instance (#7539) 
* ClientSession

* re use client_session

* _init_client_session

* fix aiohttp
 2025-01-03 15:12:17 -08:00
Ishaan Jaff
3a454ee2ce (perf) use aiohttp for custom_openai (#7514) 
* use aiohttp handler

* BaseLLMAIOHTTPHandler

* use CustomOpenAIChatConfig

* CustomOpenAIChatConfig

* CustomOpenAIChatConfig

* fix linting

* AiohttpOpenAIChatConfig

* fix order

* aiohttp_openai
 2025-01-02 22:15:17 -08:00