619 commits

Author	SHA1	Message	Date
Krrish Dholakia	73daee7e07	fix(proxy_cli.py): ensure proxy always retries if db push fails to connect to db	2024-01-17 17:37:59 -08:00
Krrish Dholakia	cff9f7fee6	fix(proxy_server.py): handle empty insert_data response	2024-01-17 17:28:23 -08:00
Krrish Dholakia	98b83fa780	feat(proxy_server.py): support model access groups	2024-01-17 15:45:31 -08:00
ishaan-jaff	179860863a	(v0) fix	2024-01-16 20:44:00 -08:00
ishaan-jaff	b06ebb886c	(ci/cd) undo change from PR 1464	2024-01-16 19:53:43 -08:00
ishaan-jaff	466fff4aaf	(fix) when budget, spend is None comparison	2024-01-16 17:35:39 -08:00
ishaan-jaff	d59ac23e82	(fix) proxy, dynamo - allow users to set ssl_verify False	2024-01-16 16:13:55 -08:00
ishaan-jaff	e4ba779d6a	(ci/cd) fixes	2024-01-16 16:03:42 -08:00
ishaan-jaff	90c8698b64	(temp) undo ssl_verify=False change	2024-01-16 15:56:21 -08:00
ishaan-jaff	87ff4ca55c	(fix) proxy check expires time	2024-01-16 15:38:58 -08:00
ishaan-jaff	de456678cd	(fix) reject Auth if user crosses budget	2024-01-16 14:58:00 -08:00
ishaan-jaff	a045bb90d4	(fix) check if budget crossed for api_key	2024-01-16 14:20:19 -08:00
ishaan-jaff	e16fa16442	(fix) improve unauthorized error message	2024-01-16 14:04:26 -08:00
ishaan-jaff	c15adf4fe4	(fix) proxy - improve invalid models exception msg	2024-01-16 14:01:01 -08:00
ishaan-jaff	7d9c953dee	(feat) proxy - auth - raise Value Error when master key is None	2024-01-16 13:27:50 -08:00
ishaan-jaff	6c6c62f032	(temp) ssl_verify=False for dynamo	2024-01-16 12:24:40 -08:00
ishaan-jaff	893627cab4	(feat) use env variables to set host, port, num_workers	2024-01-16 08:36:29 -08:00
ishaan-jaff	6a09fcfa06	(feat) print num_workers when starting prox	2024-01-16 08:21:37 -08:00
ishaan-jaff	7b1c8471c5	v0 num_workers	2024-01-16 08:15:12 -08:00
ishaan-jaff	893a2c3c7b	(fix) proxy:sagemaker, bedrock fix - num_retries=0	2024-01-15 21:18:49 -08:00
ishaan-jaff	2873f587fd	(docs) add example post call rules to proxy	2024-01-15 20:58:50 -08:00
ishaan-jaff	58a0b4c03b	Revert "Revert "(fix) proxy only import dynamo_db when it's being used"" ... This reverts commit 8cce2f28ca.	2024-01-15 16:57:36 -08:00
ishaan-jaff	340cca5ac3	Revert "Revert "(fix) dynamoDB import issues"" ... This reverts commit 6181b95ab3.	2024-01-15 16:48:10 -08:00
ishaan-jaff	8cce2f28ca	Revert "(fix) proxy only import dynamo_db when it's being used" ... This reverts commit 8d3ca785ae.	2024-01-15 14:20:29 -08:00
ishaan-jaff	6181b95ab3	Revert "(fix) dynamoDB import issues" ... This reverts commit b931841e60.	2024-01-15 12:04:13 -08:00
ishaan-jaff	1f62637197	(fix) proxy + dynamo - add some debugging	2024-01-15 12:03:10 -08:00
ishaan-jaff	b43cf53473	(feat) proxy use ProxyException clas	2024-01-15 10:45:39 -08:00
ishaan-jaff	44a7e4157c	(test) proxy - add openai exception mapping error	2024-01-15 09:56:20 -08:00
ishaan-jaff	746213f5d1	(test) proxy - add JS OpenAI test	2024-01-15 09:53:57 -08:00
ishaan-jaff	9716108c80	(feat) proxy - introduce OpenAIException class	2024-01-15 09:52:23 -08:00
ishaan-jaff	70426cad76	(fix) run prisma_setup on startup event	2024-01-13 12:06:23 -08:00
ishaan-jaff	8d3ca785ae	(fix) proxy only import dynamo_db when it's being used	2024-01-13 11:43:50 -08:00
ishaan-jaff	b931841e60	(fix) dynamoDB import issues	2024-01-13 11:38:42 -08:00
ishaan-jaff	61dff3decb	(fix) gunicorn - show request logs like uvicorn	2024-01-13 11:22:16 -08:00
Krrish Dholakia	3d7c169a58	fix(proxy_cli.py): only run prisma db push if prisma in environment	2024-01-13 19:44:12 +05:30
Krrish Dholakia	8a7a745549	Merge branch 'litellm_dynamo_db_keys'	2024-01-13 18:38:43 +05:30
Krrish Dholakia	be1ebe36a1	fix(dynamo_db.py): allow user to specify table names	2024-01-13 18:35:19 +05:30
Krrish Dholakia	cd639a7f4b	fix(proxy_server.py): have /user/info return user info + related user keys	2024-01-12 22:52:13 +05:30
XD3000/高瑞雲	574d042655	#1424:gunicorn can't run in windows	2024-01-12 14:30:23 +08:00
Krrish Dholakia	352f943dcf	fix(dynamo_db.py): don't auto-create tables, allow database_type == 'dynamodb'	2024-01-12 11:33:40 +05:30
Krrish Dholakia	f94a37a836	fix(dynamo_db.py): add cost tracking support for key + user	2024-01-11 23:56:41 +05:30
Krrish Dholakia	9b3d78c4f3	fix(dynamo_db.py): if table create fails, tell user what the table + hash key needs to be	2024-01-11 23:01:28 +05:30
Krrish Dholakia	43533812a7	fix(proxy_cli.py): read db url from config, not just environment	2024-01-11 19:19:29 +05:30
Krrish Dholakia	5bc44353e0	feat(proxy_cli.py): move print statements to show actually deployed port	2024-01-10 22:09:58 +05:30
Ishaan Jaff	58d0366447	Merge pull request #1399 from BerriAI/litellm_default_use_gunicorn ... LiteLLM Proxy - Use Gunicorn with Uvicorn workers	2024-01-10 21:46:04 +05:30
Krrish Dholakia	b06d7f0cb6	build(config.yml): reintroduce mounting config.yaml	2024-01-10 18:03:57 +05:30
ishaan-jaff	2b9174c3d7	(feat) add comments on starting with gunicorn	2024-01-10 17:50:51 +05:30
ishaan-jaff	67dc9adc71	(fix) import gunicorn	2024-01-10 17:47:34 +05:30
ishaan-jaff	873965df22	(chore) remove old uvicorn logic	2024-01-10 17:39:05 +05:30
ishaan-jaff	5136d5980f	(fix) use gunicorn to start proxt	2024-01-10 17:09:03 +05:30