phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-25 18:54:30 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

refactor(proxy_server.py): using celery workers instead of rq for concurrency

Browse source
This commit is contained in:
Krrish Dholakia 2023-11-21 16:31:20 -08:00
parent 8c98a2c899
commit b16646e584
6 changed files with 84 additions and 32 deletions
Download patch file Download diff file Expand all files Collapse all files

7
litellm/proxy/queue/rq_worker.py
View file

@ -18,4 +18,9 @@ def start_rq_worker():
worker = Worker([queue], connection=redis_conn)
except Exception as e:
print(f"Error setting up worker: {e}")
exit()
exit()
with Connection(redis_conn):
worker.work()
start_rq_worker()