406 commits

Author	SHA1	Message	Date
Krrish Dholakia	5242200243	feat(proxy_server.py): support model access groups	2024-01-17 15:45:31 -08:00
ishaan-jaff	1af44af91f	(v0) fix	2024-01-16 20:44:00 -08:00
ishaan-jaff	0011f9efa1	(ci/cd) undo change from PR 1464	2024-01-16 19:53:43 -08:00
ishaan-jaff	57af57d4e9	(fix) when budget, spend is None comparison	2024-01-16 17:35:39 -08:00
ishaan-jaff	ed93164e92	(ci/cd) fixes	2024-01-16 16:03:42 -08:00
ishaan-jaff	772547d625	(fix) proxy check expires time	2024-01-16 15:38:58 -08:00
ishaan-jaff	e8da289599	(fix) reject Auth if user crosses budget	2024-01-16 14:58:00 -08:00
ishaan-jaff	9bb5061815	(fix) check if budget crossed for api_key	2024-01-16 14:20:19 -08:00
ishaan-jaff	e1c4d3f41d	(fix) improve unauthorized error message	2024-01-16 14:04:26 -08:00
ishaan-jaff	8f047df13f	(fix) proxy - improve invalid models exception msg	2024-01-16 14:01:01 -08:00
ishaan-jaff	b09c982008	(feat) proxy - auth - raise Value Error when master key is None	2024-01-16 13:27:50 -08:00
ishaan-jaff	ae99784aee	(fix) proxy:sagemaker, bedrock fix - num_retries=0	2024-01-15 21:18:49 -08:00
ishaan-jaff	ed2287e966	(fix) proxy + dynamo - add some debugging	2024-01-15 12:03:10 -08:00
ishaan-jaff	ebf7168af8	(feat) proxy use ProxyException clas	2024-01-15 10:45:39 -08:00
ishaan-jaff	04db5b7bbf	(feat) proxy - introduce OpenAIException class	2024-01-15 09:52:23 -08:00
ishaan-jaff	c6c5bb959e	(fix) run prisma_setup on startup event	2024-01-13 12:06:23 -08:00
Krrish Dholakia	61cbac6b4f	fix(proxy_cli.py): only run prisma db push if prisma in environment	2024-01-13 19:44:12 +05:30
Krrish Dholakia	ae74c52a33	Merge branch 'litellm_dynamo_db_keys'	2024-01-13 18:38:43 +05:30
Krrish Dholakia	45b860d433	fix(proxy_server.py): have /user/info return user info + related user keys	2024-01-12 22:52:13 +05:30
Krrish Dholakia	ff0daf3daf	fix(dynamo_db.py): don't auto-create tables, allow database_type == 'dynamodb'	2024-01-12 11:33:40 +05:30
Krrish Dholakia	135e4b6ac4	fix(dynamo_db.py): add cost tracking support for key + user	2024-01-11 23:56:41 +05:30
Krrish Dholakia	3028d0f622	feat(proxy_cli.py): move print statements to show actually deployed port	2024-01-10 22:09:58 +05:30
ishaan-jaff	5e53ed8178	(fix) import gunicorn	2024-01-10 17:47:34 +05:30
Krrish Dholakia	53f0169c39	fix: fix linting errors	2024-01-09 22:16:16 +05:30
Krrish Dholakia	00c258c165	feat(proxy_server.py): adds working dynamo db support for key gen	2024-01-09 18:23:34 +05:30
ishaan-jaff	829e750566	(fix) prisma setup	2024-01-09 14:56:43 +05:30
ishaan-jaff	588b2483c6	(debug) always do prisma_setup after intiialize	2024-01-09 14:26:30 +05:30
ishaan-jaff	ee52fee331	raise exception when prisma init fails	2024-01-09 13:36:02 +05:30
Krrish Dholakia	7f9808be56	fix(proxy_server.py): don't reconnect prisma if already connected	2024-01-09 11:38:42 +05:30
Krish Dholakia	28a5e17e73	Merge pull request #1367 from BerriAI/litellm_proxy_startup ... fix(proxy_server.py): add support for passing in config file via worker_config directly + testing	2024-01-08 19:46:48 +05:30
Krrish Dholakia	e99fe07ae0	fix(proxy_server.py): improve /health/readiness endpoint to give more details on connected services	2024-01-08 17:45:00 +05:30
Krrish Dholakia	10f05ad9a4	fix(proxy_server.py): add support for passing in config file via worker_config directly + testing	2024-01-08 16:47:15 +05:30
ishaan-jaff	c9324e9df9	(docs) control proxy debug using env vars	2024-01-08 16:15:33 +05:30
ishaan-jaff	4192d93f8a	(fix) proxy - show detailed_debug logs	2024-01-08 15:34:24 +05:30
ishaan-jaff	729637e2ad	(feat) allow users to opt into detailed debug on proxy	2024-01-08 12:53:41 +05:30
ishaan-jaff	5477b01490	(feat) use '-debug' with proxy logger	2024-01-08 10:35:49 +05:30
ishaan-jaff	0a5f8d564b	v0 proxy logger	2024-01-08 08:25:04 +05:30
Krrish Dholakia	b89dac5b78	build(Dockerfile): fixes the build time setup	2024-01-06 16:41:37 +05:30
ishaan-jaff	db37f925ef	(fix) proxy + cache - os.environ/ vars	2024-01-06 16:15:53 +05:30
Krish Dholakia	8cfae7bb1a	Merge pull request #1342 from BerriAI/litellm_dockerfile_updates ... build(Dockerfile): moves prisma logic to dockerfile	2024-01-06 16:03:25 +05:30
ishaan-jaff	d6d5a42115	(feat) cache+proxy - set os.environ/ on proxy config	2024-01-06 15:54:16 +05:30
Krrish Dholakia	40187ed52a	build(Dockerfile): moves prisma logic to dockerfile	2024-01-06 14:59:10 +05:30
ishaan-jaff	4a195f09f6	(fix) undo changes that led were trying to control prisma connections	2024-01-06 14:32:40 +05:30
Krrish Dholakia	f526340a5e	docs: fix pip install litellm[proxy] instruction	2024-01-06 13:49:15 +05:30
ishaan-jaff	973f418178	Revert "build(Dockerfile): move prisma build to dockerfile" ... This reverts commit 2741835605.	2024-01-06 09:51:44 +05:30
ishaan-jaff	b518c5edd9	(ci/cd) add print_verbose for /key/generate	2024-01-05 22:38:46 +05:30
Krrish Dholakia	04dfde3fe5	build(Dockerfile): move prisma build to dockerfile ... Seems to solve - https://github.com/BerriAI/litellm/issues/1321	2024-01-05 19:03:41 +05:30
ishaan-jaff	90042ad8ee	(fix) reading cache params on proxy	2024-01-05 13:36:48 +05:30
Krrish Dholakia	f3163d287c	fix(proxy_server.py): fix prisma client connection error	2024-01-04 18:28:18 +05:30
Krrish Dholakia	ee3f33ca00	fix(proxy_server.py): enable sending test connections when slack alerting added to proxy via ui	2024-01-04 17:00:07 +05:30