630 commits

Author	SHA1	Message	Date
ishaan-jaff	16f3d7e0ed	(feat) use user_id passed to request - cost track	2024-01-18 17:51:48 -08:00
Krrish Dholakia	1e5efdfa37	fix(proxy_server.py): support setting tpm/rpm limits per user / per key	2024-01-18 17:03:18 -08:00
Ishaan Jaff	a8ba5df90e	Merge pull request #1500 from BerriAI/litellm_create_keys_with_team_id ... [Feat] /key/generate - create keys with`team_id`	2024-01-18 16:35:14 -08:00
ishaan-jaff	340706565f	(fix) add team_id to doc string	2024-01-18 15:23:05 -08:00
ishaan-jaff	2b6972111e	(feat) write team_id to User Table	2024-01-18 14:42:46 -08:00
Ishaan Jaff	a26267851f	Merge pull request #1498 from BerriAI/litellm_spend_tracking_logs ... [Feat] Proxy - Add Spend tracking logs	2024-01-18 14:21:51 -08:00
ishaan-jaff	90509a159a	(fix) write team_id to key table	2024-01-18 13:54:08 -08:00
ishaan-jaff	42ad12b2bd	(fix) support team_id for /key/generate	2024-01-18 13:48:52 -08:00
ishaan-jaff	4294657b99	(fix) use get_logging_payload	2024-01-18 13:40:48 -08:00
Krrish Dholakia	1ea3833ef7	fix(parallel_request_limiter.py): decrement count for failed llm calls ... https://github.com/BerriAI/litellm/issues/1477	2024-01-18 12:42:14 -08:00
ishaan-jaff	5b54bcc712	(feat) spendLogs table DynamoDB	2024-01-18 12:39:11 -08:00
ishaan-jaff	88cdfedf84	(feat) track cost streaming	2024-01-18 12:21:56 -08:00
ishaan-jaff	d14d36af9a	(v0 ) working - writing /chat/completion spend tracking	2024-01-18 11:54:15 -08:00
Krrish Dholakia	c8dd36db9e	fix(proxy_server.py): show all models user has access to in /models	2024-01-18 10:56:37 -08:00
Krrish Dholakia	96122a4f88	fix(proxy/utils.py): fix isoformat to string logic	2024-01-18 09:32:30 -08:00
Krish Dholakia	e9ac001005	Merge pull request #1483 from BerriAI/litellm_model_access_groups_feature ... feat(proxy_server.py): support model access groups	2024-01-17 18:16:53 -08:00
ishaan-jaff	f3a45ea044	(fix) cleanup	2024-01-17 17:54:18 -08:00
ishaan-jaff	8df3a86178	(feat) proxy - set endpoint called in callback	2024-01-17 17:44:28 -08:00
Krrish Dholakia	cff9f7fee6	fix(proxy_server.py): handle empty insert_data response	2024-01-17 17:28:23 -08:00
ishaan-jaff	00dfb5918c	(feat) proxy - log key metadata in calback	2024-01-17 16:42:49 -08:00
Krrish Dholakia	98b83fa780	feat(proxy_server.py): support model access groups	2024-01-17 15:45:31 -08:00
ishaan-jaff	66bcd431f6	(docs) add doc string for /key/delete	2024-01-17 15:27:48 -08:00
ishaan-jaff	0250492d95	(fix) /key/delete	2024-01-17 14:54:29 -08:00
ishaan-jaff	a0eec51ee6	(test) expired key prisma	2024-01-17 13:24:15 -08:00
ishaan-jaff	179860863a	(v0) fix	2024-01-16 20:44:00 -08:00
ishaan-jaff	b06ebb886c	(ci/cd) undo change from PR 1464	2024-01-16 19:53:43 -08:00
ishaan-jaff	466fff4aaf	(fix) when budget, spend is None comparison	2024-01-16 17:35:39 -08:00
ishaan-jaff	e4ba779d6a	(ci/cd) fixes	2024-01-16 16:03:42 -08:00
ishaan-jaff	87ff4ca55c	(fix) proxy check expires time	2024-01-16 15:38:58 -08:00
ishaan-jaff	de456678cd	(fix) reject Auth if user crosses budget	2024-01-16 14:58:00 -08:00
ishaan-jaff	a045bb90d4	(fix) check if budget crossed for api_key	2024-01-16 14:20:19 -08:00
ishaan-jaff	e16fa16442	(fix) improve unauthorized error message	2024-01-16 14:04:26 -08:00
ishaan-jaff	c15adf4fe4	(fix) proxy - improve invalid models exception msg	2024-01-16 14:01:01 -08:00
ishaan-jaff	7d9c953dee	(feat) proxy - auth - raise Value Error when master key is None	2024-01-16 13:27:50 -08:00
ishaan-jaff	893a2c3c7b	(fix) proxy:sagemaker, bedrock fix - num_retries=0	2024-01-15 21:18:49 -08:00
ishaan-jaff	1f62637197	(fix) proxy + dynamo - add some debugging	2024-01-15 12:03:10 -08:00
ishaan-jaff	b43cf53473	(feat) proxy use ProxyException clas	2024-01-15 10:45:39 -08:00
ishaan-jaff	9716108c80	(feat) proxy - introduce OpenAIException class	2024-01-15 09:52:23 -08:00
ishaan-jaff	70426cad76	(fix) run prisma_setup on startup event	2024-01-13 12:06:23 -08:00
Krrish Dholakia	3d7c169a58	fix(proxy_cli.py): only run prisma db push if prisma in environment	2024-01-13 19:44:12 +05:30
Krrish Dholakia	8a7a745549	Merge branch 'litellm_dynamo_db_keys'	2024-01-13 18:38:43 +05:30
Krrish Dholakia	cd639a7f4b	fix(proxy_server.py): have /user/info return user info + related user keys	2024-01-12 22:52:13 +05:30
Krrish Dholakia	007870390d	fix: support async redis caching	2024-01-12 21:46:41 +05:30
Krrish Dholakia	352f943dcf	fix(dynamo_db.py): don't auto-create tables, allow database_type == 'dynamodb'	2024-01-12 11:33:40 +05:30
Krrish Dholakia	f94a37a836	fix(dynamo_db.py): add cost tracking support for key + user	2024-01-11 23:56:41 +05:30
Krrish Dholakia	5bc44353e0	feat(proxy_cli.py): move print statements to show actually deployed port	2024-01-10 22:09:58 +05:30
ishaan-jaff	67dc9adc71	(fix) import gunicorn	2024-01-10 17:47:34 +05:30
Krrish Dholakia	ba7026639d	fix: fix linting errors	2024-01-09 22:16:16 +05:30
Krrish Dholakia	35f9666dc2	feat(proxy_server.py): adds working dynamo db support for key gen	2024-01-09 18:23:34 +05:30
ishaan-jaff	ebb5490d3c	(fix) prisma setup	2024-01-09 14:56:43 +05:30