Ishaan Jaff
|
2ca0977921
|
aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o (#7598)
* fixes for get_complete_url
* update aiohttp tests
* fix event loop for aiohtto
* ci/cd run again
* test_aiohttp_openai
|
2025-01-06 21:39:11 -08:00 |
|
Ishaan Jaff
|
61d67cfa43
|
(perf) - fixes for aiohttp handler to hit 1K RPS (#7590)
* fix getting aiohttp sesson
* fix _get_async_client_session
|
2025-01-06 15:41:39 -08:00 |
|
Ishaan Jaff
|
c8f9e2afab
|
fix _make_common_async_call
|
2025-01-03 15:15:38 -08:00 |
|
Ishaan Jaff
|
02875d4ae8
|
(fix) aiohttp_openai/ route - get to 1K RPS on single instance (#7539)
* ClientSession
* re use client_session
* _init_client_session
* fix aiohttp
|
2025-01-03 15:12:17 -08:00 |
|
Ishaan Jaff
|
d861aa8ff3
|
(perf) use aiohttp for custom_openai (#7514)
* use aiohttp handler
* BaseLLMAIOHTTPHandler
* use CustomOpenAIChatConfig
* CustomOpenAIChatConfig
* CustomOpenAIChatConfig
* fix linting
* AiohttpOpenAIChatConfig
* fix order
* aiohttp_openai
|
2025-01-02 22:15:17 -08:00 |
|