phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(proxy - RPS) - Get 2K RPS at 4 instances, minor fix aiohttp_openai/ (#7659)

Browse source 
* speed up transform_response

* use 2 workers

* undo changes to uvicorn

* ci/cd run again
This commit is contained in:
Ishaan Jaff 2025-01-09 17:24:18 -08:00 • committed by GitHub
parent 6f6bf45684
commit 7d680d411d
2 changed files with 11 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

2
tests/llm_translation/test_aiohttp_openai.py
View file

@ -6,7 +6,7 @@ import pytest
sys.path.insert(
0, os.path.abspath("../../")
) # Adds the parent directory to the system path
) # Adds the parent directory to the system-path
import litellm