Ishaan Jaff
|
5d3ae6da62
|
aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o (#7598)
* fixes for get_complete_url
* update aiohttp tests
* fix event loop for aiohtto
* ci/cd run again
* test_aiohttp_openai
|
2025-01-06 21:39:11 -08:00 |
|
Ishaan Jaff
|
7ac1c0c1b2
|
(perf) - fixes for aiohttp handler to hit 1K RPS (#7590)
* fix getting aiohttp sesson
* fix _get_async_client_session
|
2025-01-06 15:41:39 -08:00 |
|
Ishaan Jaff
|
dc10cebde7
|
fix _make_common_async_call
|
2025-01-03 15:15:38 -08:00 |
|
Ishaan Jaff
|
6e2f712b06
|
(fix) aiohttp_openai/ route - get to 1K RPS on single instance (#7539)
* ClientSession
* re use client_session
* _init_client_session
* fix aiohttp
|
2025-01-03 15:12:17 -08:00 |
|
Ishaan Jaff
|
3a454ee2ce
|
(perf) use aiohttp for custom_openai (#7514)
* use aiohttp handler
* BaseLLMAIOHTTPHandler
* use CustomOpenAIChatConfig
* CustomOpenAIChatConfig
* CustomOpenAIChatConfig
* fix linting
* AiohttpOpenAIChatConfig
* fix order
* aiohttp_openai
|
2025-01-02 22:15:17 -08:00 |
|