575 commits

Author	SHA1	Message	Date
Krrish Dholakia	813fb19620	fix: support async redis caching	2024-01-12 21:46:41 +05:30
Krrish Dholakia	36068b707a	fix(proxy_cli.py): read db url from config, not just environment	2024-01-11 19:19:29 +05:30
Krrish Dholakia	3028d0f622	feat(proxy_cli.py): move print statements to show actually deployed port	2024-01-10 22:09:58 +05:30
Ishaan Jaff	6d994996bc	Merge pull request #1399 from BerriAI/litellm_default_use_gunicorn ... LiteLLM Proxy - Use Gunicorn with Uvicorn workers	2024-01-10 21:46:04 +05:30
Krrish Dholakia	e08da07def	build(config.yml): reintroduce mounting config.yaml	2024-01-10 18:03:57 +05:30
ishaan-jaff	61e38e9d82	(feat) add comments on starting with gunicorn	2024-01-10 17:50:51 +05:30
ishaan-jaff	5e53ed8178	(fix) import gunicorn	2024-01-10 17:47:34 +05:30
ishaan-jaff	f310b6b7f3	(chore) remove old uvicorn logic	2024-01-10 17:39:05 +05:30
ishaan-jaff	fe122bf606	(fix) use gunicorn to start proxt	2024-01-10 17:09:03 +05:30
ishaan-jaff	ee90995272	v0	2024-01-10 16:29:38 +05:30
ishaan-jaff	829e750566	(fix) prisma setup	2024-01-09 14:56:43 +05:30
ishaan-jaff	588b2483c6	(debug) always do prisma_setup after intiialize	2024-01-09 14:26:30 +05:30
ishaan-jaff	ee52fee331	raise exception when prisma init fails	2024-01-09 13:36:02 +05:30
Krrish Dholakia	7f9808be56	fix(proxy_server.py): don't reconnect prisma if already connected	2024-01-09 11:38:42 +05:30
Krish Dholakia	28a5e17e73	Merge pull request #1367 from BerriAI/litellm_proxy_startup ... fix(proxy_server.py): add support for passing in config file via worker_config directly + testing	2024-01-08 19:46:48 +05:30
Krrish Dholakia	e99fe07ae0	fix(proxy_server.py): improve /health/readiness endpoint to give more details on connected services	2024-01-08 17:45:00 +05:30
Krrish Dholakia	10f05ad9a4	fix(proxy_server.py): add support for passing in config file via worker_config directly + testing	2024-01-08 16:47:15 +05:30
ishaan-jaff	c9324e9df9	(docs) control proxy debug using env vars	2024-01-08 16:15:33 +05:30
ishaan-jaff	4192d93f8a	(fix) proxy - show detailed_debug logs	2024-01-08 15:34:24 +05:30
ishaan-jaff	729637e2ad	(feat) allow users to opt into detailed debug on proxy	2024-01-08 12:53:41 +05:30
ishaan-jaff	5477b01490	(feat) use '-debug' with proxy logger	2024-01-08 10:35:49 +05:30
ishaan-jaff	a0e6fba652	(docs) show fallbacks on proxy_config	2024-01-08 08:54:10 +05:30
ishaan-jaff	0a5f8d564b	v0 proxy logger	2024-01-08 08:25:04 +05:30
Krrish Dholakia	b89dac5b78	build(Dockerfile): fixes the build time setup	2024-01-06 16:41:37 +05:30
ishaan-jaff	db37f925ef	(fix) proxy + cache - os.environ/ vars	2024-01-06 16:15:53 +05:30
Krish Dholakia	8cfae7bb1a	Merge pull request #1342 from BerriAI/litellm_dockerfile_updates ... build(Dockerfile): moves prisma logic to dockerfile	2024-01-06 16:03:25 +05:30
ishaan-jaff	d6d5a42115	(feat) cache+proxy - set os.environ/ on proxy config	2024-01-06 15:54:16 +05:30
Krrish Dholakia	40187ed52a	build(Dockerfile): moves prisma logic to dockerfile	2024-01-06 14:59:10 +05:30
ishaan-jaff	4a195f09f6	(fix) undo changes that led were trying to control prisma connections	2024-01-06 14:32:40 +05:30
Krrish Dholakia	f526340a5e	docs: fix pip install litellm[proxy] instruction	2024-01-06 13:49:15 +05:30
Krrish Dholakia	c51f012a56	fix(proxy/utils.py): increase http connection pool for prisma	2024-01-06 13:45:30 +05:30
ishaan-jaff	d5331b9f10	(ci/cd) temp fix - check if model_dump_json exists	2024-01-06 12:23:39 +05:30
ishaan-jaff	70ca7ce769	(ci/cd) run again	2024-01-06 11:57:31 +05:30
ishaan-jaff	973f418178	Revert "build(Dockerfile): move prisma build to dockerfile" ... This reverts commit 2741835605.	2024-01-06 09:51:44 +05:30
ishaan-jaff	b518c5edd9	(ci/cd) add print_verbose for /key/generate	2024-01-05 22:38:46 +05:30
ishaan-jaff	7b7799ace7	(fix) revert 469ae0a	2024-01-05 22:06:39 +05:30
ishaan-jaff	e781eb39c5	(fix) prisma set DATABASE_URL in env	2024-01-05 20:57:27 +05:30
ishaan-jaff	530e689ae8	(fix) proxy - self.connect() for get_data()	2024-01-05 20:48:16 +05:30
Krrish Dholakia	04dfde3fe5	build(Dockerfile): move prisma build to dockerfile ... Seems to solve - https://github.com/BerriAI/litellm/issues/1321	2024-01-05 19:03:41 +05:30
ishaan-jaff	9d4ce57801	(fix) re-connect prisma if not connected	2024-01-05 17:58:23 +05:30
ishaan-jaff	06ef89f65a	(ci/cd) proxy print_verbose on failing insert_data	2024-01-05 17:28:27 +05:30
ishaan-jaff	90042ad8ee	(fix) reading cache params on proxy	2024-01-05 13:36:48 +05:30
Krrish Dholakia	f3163d287c	fix(proxy_server.py): fix prisma client connection error	2024-01-04 18:28:18 +05:30
Krrish Dholakia	ee3f33ca00	fix(proxy_server.py): enable sending test connections when slack alerting added to proxy via ui	2024-01-04 17:00:07 +05:30
Krrish Dholakia	1fb856d3f4	fix(proxy_server.py): update proxy with full model list	2024-01-04 15:56:16 +05:30
Krrish Dholakia	5aecbced99	feat(proxy_server.py): abstract config update/writing and support persisting config in db ... allows user to opt into writing to db (SAVE_CONFIG_TO_DB) and removes any api keys before sending to db https://github.com/BerriAI/litellm/issues/1322	2024-01-04 14:44:59 +05:30
ishaan-jaff	c1c644de55	(docs) config with cloudflare exampel	2024-01-04 10:25:35 +05:30
ishaan-jaff	7a11f5dbba	(docs) use s3 Cache on litellm proxy	2024-01-03 17:56:44 +05:30
Krrish Dholakia	e898f3e49c	fix(proxy/utils.py): don't keep connecting to db if connection already established	2024-01-03 17:43:44 +05:30
Krrish Dholakia	36c903399d	feat(proxy_server.py): allow admins to update config via /config/update endpoint	2024-01-03 17:18:33 +05:30