6 commits

Author	SHA1	Message	Date
Krrish Dholakia	e5fa4eb314	fix(celery_app.py): add retries to worker	2023-11-21 20:07:16 -08:00
Krrish Dholakia	9d97082eed	docs(routing.md): add queueing to docs	2023-11-21 18:01:02 -08:00
Krrish Dholakia	b16646e584	refactor(proxy_server.py): using celery workers instead of rq for concurrency	2023-11-21 16:31:56 -08:00
Krrish Dholakia	70f3159a2a	refactor(rq_worker.py): put rq worker behind function call (prevent default import)	2023-11-21 13:51:42 -08:00
Krrish Dholakia	a1f6b9b531	refactor(proxy_server.py): refactoring background rq worker	2023-11-21 13:47:09 -08:00
Krrish Dholakia	c6a4744947	feat(proxy_server.py): EXPERIMENTAL: adding queuing endpoints to openai proxy server	2023-11-21 12:06:23 -08:00