603 commits

Author	SHA1	Message	Date
ishaan-jaff	893627cab4	(feat) use env variables to set host, port, num_workers	2024-01-16 08:36:29 -08:00
ishaan-jaff	6a09fcfa06	(feat) print num_workers when starting prox	2024-01-16 08:21:37 -08:00
ishaan-jaff	7b1c8471c5	v0 num_workers	2024-01-16 08:15:12 -08:00
ishaan-jaff	893a2c3c7b	(fix) proxy:sagemaker, bedrock fix - num_retries=0	2024-01-15 21:18:49 -08:00
ishaan-jaff	2873f587fd	(docs) add example post call rules to proxy	2024-01-15 20:58:50 -08:00
ishaan-jaff	58a0b4c03b	Revert "Revert "(fix) proxy only import dynamo_db when it's being used"" ... This reverts commit 8cce2f28ca.	2024-01-15 16:57:36 -08:00
ishaan-jaff	340cca5ac3	Revert "Revert "(fix) dynamoDB import issues"" ... This reverts commit 6181b95ab3.	2024-01-15 16:48:10 -08:00
ishaan-jaff	8cce2f28ca	Revert "(fix) proxy only import dynamo_db when it's being used" ... This reverts commit 8d3ca785ae.	2024-01-15 14:20:29 -08:00
ishaan-jaff	6181b95ab3	Revert "(fix) dynamoDB import issues" ... This reverts commit b931841e60.	2024-01-15 12:04:13 -08:00
ishaan-jaff	1f62637197	(fix) proxy + dynamo - add some debugging	2024-01-15 12:03:10 -08:00
ishaan-jaff	b43cf53473	(feat) proxy use ProxyException clas	2024-01-15 10:45:39 -08:00
ishaan-jaff	44a7e4157c	(test) proxy - add openai exception mapping error	2024-01-15 09:56:20 -08:00
ishaan-jaff	746213f5d1	(test) proxy - add JS OpenAI test	2024-01-15 09:53:57 -08:00
ishaan-jaff	9716108c80	(feat) proxy - introduce OpenAIException class	2024-01-15 09:52:23 -08:00
ishaan-jaff	70426cad76	(fix) run prisma_setup on startup event	2024-01-13 12:06:23 -08:00
ishaan-jaff	8d3ca785ae	(fix) proxy only import dynamo_db when it's being used	2024-01-13 11:43:50 -08:00
ishaan-jaff	b931841e60	(fix) dynamoDB import issues	2024-01-13 11:38:42 -08:00
ishaan-jaff	61dff3decb	(fix) gunicorn - show request logs like uvicorn	2024-01-13 11:22:16 -08:00
Krrish Dholakia	3d7c169a58	fix(proxy_cli.py): only run prisma db push if prisma in environment	2024-01-13 19:44:12 +05:30
Krrish Dholakia	8a7a745549	Merge branch 'litellm_dynamo_db_keys'	2024-01-13 18:38:43 +05:30
Krrish Dholakia	be1ebe36a1	fix(dynamo_db.py): allow user to specify table names	2024-01-13 18:35:19 +05:30
Krrish Dholakia	cd639a7f4b	fix(proxy_server.py): have /user/info return user info + related user keys	2024-01-12 22:52:13 +05:30
XD3000/高瑞雲	574d042655	#1424:gunicorn can't run in windows	2024-01-12 14:30:23 +08:00
Krrish Dholakia	352f943dcf	fix(dynamo_db.py): don't auto-create tables, allow database_type == 'dynamodb'	2024-01-12 11:33:40 +05:30
Krrish Dholakia	f94a37a836	fix(dynamo_db.py): add cost tracking support for key + user	2024-01-11 23:56:41 +05:30
Krrish Dholakia	9b3d78c4f3	fix(dynamo_db.py): if table create fails, tell user what the table + hash key needs to be	2024-01-11 23:01:28 +05:30
Krrish Dholakia	43533812a7	fix(proxy_cli.py): read db url from config, not just environment	2024-01-11 19:19:29 +05:30
Krrish Dholakia	5bc44353e0	feat(proxy_cli.py): move print statements to show actually deployed port	2024-01-10 22:09:58 +05:30
Ishaan Jaff	58d0366447	Merge pull request #1399 from BerriAI/litellm_default_use_gunicorn ... LiteLLM Proxy - Use Gunicorn with Uvicorn workers	2024-01-10 21:46:04 +05:30
Krrish Dholakia	b06d7f0cb6	build(config.yml): reintroduce mounting config.yaml	2024-01-10 18:03:57 +05:30
ishaan-jaff	2b9174c3d7	(feat) add comments on starting with gunicorn	2024-01-10 17:50:51 +05:30
ishaan-jaff	67dc9adc71	(fix) import gunicorn	2024-01-10 17:47:34 +05:30
ishaan-jaff	873965df22	(chore) remove old uvicorn logic	2024-01-10 17:39:05 +05:30
ishaan-jaff	5136d5980f	(fix) use gunicorn to start proxt	2024-01-10 17:09:03 +05:30
ishaan-jaff	c7fe33202d	v0	2024-01-10 16:29:38 +05:30
Krrish Dholakia	befbcbb7ac	fix: fix linting issues	2024-01-09 22:55:18 +05:30
Krrish Dholakia	ba7026639d	fix: fix linting errors	2024-01-09 22:16:16 +05:30
Krrish Dholakia	35f9666dc2	feat(proxy_server.py): adds working dynamo db support for key gen	2024-01-09 18:23:34 +05:30
ishaan-jaff	ebb5490d3c	(fix) prisma setup	2024-01-09 14:56:43 +05:30
ishaan-jaff	98d8dc3331	(debug) always do prisma_setup after intiialize	2024-01-09 14:26:30 +05:30
ishaan-jaff	599318b40e	raise exception when prisma init fails	2024-01-09 13:36:02 +05:30
Krrish Dholakia	cd350ab8d8	fix(proxy_server.py): don't reconnect prisma if already connected	2024-01-09 11:38:42 +05:30
Krish Dholakia	e949a2ada3	Merge pull request #1367 from BerriAI/litellm_proxy_startup ... fix(proxy_server.py): add support for passing in config file via worker_config directly + testing	2024-01-08 19:46:48 +05:30
Krrish Dholakia	2bcfe28ee9	fix(proxy_server.py): improve /health/readiness endpoint to give more details on connected services	2024-01-08 17:45:00 +05:30
Krrish Dholakia	8f8f961941	fix(proxy_server.py): add support for passing in config file via worker_config directly + testing	2024-01-08 16:47:15 +05:30
ishaan-jaff	fa74831d79	(docs) control proxy debug using env vars	2024-01-08 16:15:33 +05:30
ishaan-jaff	5d7646b30a	(fix) proxy - show detailed_debug logs	2024-01-08 15:34:24 +05:30
ishaan-jaff	6786e4f343	(feat) allow users to opt into detailed debug on proxy	2024-01-08 12:53:41 +05:30
ishaan-jaff	f63f9d02cc	(feat) use '-debug' with proxy logger	2024-01-08 10:35:49 +05:30
ishaan-jaff	119ff2fe05	(docs) show fallbacks on proxy_config	2024-01-08 08:54:10 +05:30