phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity

refactor(proxy_server.py): using celery workers instead of rq for concurrency

Browse source
This commit is contained in:
Krrish Dholakia 2023-11-21 16:31:20 -08:00
parent 8c98a2c899
commit b16646e584
6 changed files with 84 additions and 32 deletions
Download patch file Download diff file Expand all files Collapse all files

9
litellm/proxy/queue/celery_worker.py Normal file
View file

@ -0,0 +1,9 @@
import os
from multiprocessing import Process
def run_worker():
os.system("celery worker -A your_project_name.celery_app --concurrency=10 --loglevel=info")
if __name__ == "__main__":
worker_process = Process(target=run_worker)
worker_process.start()