phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
18920 commits 2497 branches 897 tags 550 MiB
Commit graph

4 commits

Author SHA1 Message Date
Ishaan Jaff
7ac1c0c1b2 (perf) - fixes for aiohttp handler to hit 1K RPS (#7590) 
* fix getting aiohttp sesson

* fix _get_async_client_session
 2025-01-06 15:41:39 -08:00
Ishaan Jaff
dc10cebde7 fix _make_common_async_call 2025-01-03 15:15:38 -08:00
Ishaan Jaff
6e2f712b06 (fix) aiohttp_openai/ route - get to 1K RPS on single instance (#7539) 
* ClientSession

* re use client_session

* _init_client_session

* fix aiohttp
 2025-01-03 15:12:17 -08:00
Ishaan Jaff
3a454ee2ce (perf) use aiohttp for custom_openai (#7514) 
* use aiohttp handler

* BaseLLMAIOHTTPHandler

* use CustomOpenAIChatConfig

* CustomOpenAIChatConfig

* CustomOpenAIChatConfig

* fix linting

* AiohttpOpenAIChatConfig

* fix order

* aiohttp_openai
 2025-01-02 22:15:17 -08:00