92 commits

Author	SHA1	Message	Date
ishaan-jaff	9aae60f162	(FIX) improve slack alerting messages	2024-01-24 16:07:46 -08:00
ishaan-jaff	b993c62144	(fix) only alert users when requests are hanging	2024-01-24 15:58:07 -08:00
ishaan-jaff	6c13776701	(fix) alerting - show timestamps in alert	2024-01-24 15:25:40 -08:00
ishaan-jaff	8f4e256531	(feat) add request_info to slack alerts	2024-01-24 15:17:33 -08:00
ishaan-jaff	087bd5e267	(feat) slack alerting - log request/response	2024-01-24 14:55:21 -08:00
Ishaan Jaff	f76620b1d1	Merge branch 'main' into litellm_spend_per_user	2024-01-24 12:24:15 -08:00
ishaan-jaff	2692afca75	(feat) /spend/users endpoint	2024-01-24 11:34:28 -08:00
ishaan-jaff	a842e6520c	(test) setting model in SpendTable logs	2024-01-24 11:09:20 -08:00
Krish Dholakia	9784d03d65	Merge branch 'main' into litellm_reset_key_budget	2024-01-23 18:10:32 -08:00
Krrish Dholakia	d6844f43c8	test(test_keys.py): use correct model name for token counting	2024-01-23 17:46:14 -08:00
Krrish Dholakia	7b5e3b9934	refactor(proxy/utils.py): fix linting issue	2024-01-23 17:22:22 -08:00
Krish Dholakia	4ca4913468	Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking ... [WIP] fix(utils.py): fix proxy streaming spend tracking	2024-01-23 17:07:40 -08:00
ishaan-jaff	0e9339b390	(feat) /spend/logs	2024-01-23 16:57:51 -08:00
Krrish Dholakia	7e0adbb9bd	fix(proxy/utils.py): remove original auth sk-.. key before logging to spend logs	2024-01-23 16:19:32 -08:00
Krrish Dholakia	d52f5234b4	fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss ... ue for spend logs	2024-01-23 16:14:01 -08:00
ishaan-jaff	a2da9c30fb	(feat) add /spend/keys endpoint	2024-01-23 15:10:10 -08:00
Krrish Dholakia	afada01ffc	fix(utils.py): fix streaming cost tracking	2024-01-23 14:39:45 -08:00
Krrish Dholakia	b1a105e309	feat(proxy/utils.py): enable background process to reset key budgets	2024-01-23 12:33:13 -08:00
Krrish Dholakia	074ea17325	fix: support streaming custom cost completion tracking	2024-01-22 15:15:34 -08:00
ishaan-jaff	ddd9ca86a7	(feat) proxy - track cost for user_ids that do not exist	2024-01-18 17:44:39 -08:00
ishaan-jaff	73938080f2	(feat) track - api_key in spendLogs	2024-01-18 13:16:25 -08:00
ishaan-jaff	4a5f987512	(feat) insert_data to spend table	2024-01-18 10:09:02 -08:00
Krrish Dholakia	96122a4f88	fix(proxy/utils.py): fix isoformat to string logic	2024-01-18 09:32:30 -08:00
Krrish Dholakia	71034099c9	fix(proxy/utils.py): prisma client fix get data to handle list return	2024-01-18 07:49:13 -08:00
Krish Dholakia	e9ac001005	Merge pull request #1483 from BerriAI/litellm_model_access_groups_feature ... feat(proxy_server.py): support model access groups	2024-01-17 18:16:53 -08:00
Krrish Dholakia	98b83fa780	feat(proxy_server.py): support model access groups	2024-01-17 15:45:31 -08:00
ishaan-jaff	399f0ba620	(fix) prisma - non expiring keys	2024-01-17 12:56:26 -08:00
ishaan-jaff	ec68c3a29f	(feat) improve Prisma Auth Error	2024-01-17 11:57:48 -08:00
ishaan-jaff	87ff4ca55c	(fix) proxy check expires time	2024-01-16 15:38:58 -08:00
ishaan-jaff	58a0b4c03b	Revert "Revert "(fix) proxy only import dynamo_db when it's being used"" ... This reverts commit 8cce2f28ca.	2024-01-15 16:57:36 -08:00
ishaan-jaff	8cce2f28ca	Revert "(fix) proxy only import dynamo_db when it's being used" ... This reverts commit 8d3ca785ae.	2024-01-15 14:20:29 -08:00
ishaan-jaff	8d3ca785ae	(fix) proxy only import dynamo_db when it's being used	2024-01-13 11:43:50 -08:00
Krrish Dholakia	3d7c169a58	fix(proxy_cli.py): only run prisma db push if prisma in environment	2024-01-13 19:44:12 +05:30
Krrish Dholakia	8a7a745549	Merge branch 'litellm_dynamo_db_keys'	2024-01-13 18:38:43 +05:30
Krrish Dholakia	cd639a7f4b	fix(proxy_server.py): have /user/info return user info + related user keys	2024-01-12 22:52:13 +05:30
Krrish Dholakia	f94a37a836	fix(dynamo_db.py): add cost tracking support for key + user	2024-01-11 23:56:41 +05:30
Krrish Dholakia	b06d7f0cb6	build(config.yml): reintroduce mounting config.yaml	2024-01-10 18:03:57 +05:30
Krrish Dholakia	ba7026639d	fix: fix linting errors	2024-01-09 22:16:16 +05:30
Krrish Dholakia	35f9666dc2	feat(proxy_server.py): adds working dynamo db support for key gen	2024-01-09 18:23:34 +05:30
Krrish Dholakia	cd350ab8d8	fix(proxy_server.py): don't reconnect prisma if already connected	2024-01-09 11:38:42 +05:30
Krrish Dholakia	a7245dba07	build(Dockerfile): fixes the build time setup	2024-01-06 16:41:37 +05:30
Krrish Dholakia	bf56179da8	fix(proxy/utils.py): increase http connection pool for prisma	2024-01-06 13:45:30 +05:30
ishaan-jaff	250672eddc	(ci/cd) temp fix - check if model_dump_json exists	2024-01-06 12:23:39 +05:30
ishaan-jaff	65ac4c1acb	(ci/cd) run again	2024-01-06 11:57:31 +05:30
ishaan-jaff	357c6c56bd	Revert "build(Dockerfile): move prisma build to dockerfile" ... This reverts commit 2741835605.	2024-01-06 09:51:44 +05:30
ishaan-jaff	40aaac69cc	(ci/cd) add print_verbose for /key/generate	2024-01-05 22:38:46 +05:30
ishaan-jaff	d9fd38ae16	(fix) revert 469ae0a	2024-01-05 22:06:39 +05:30
ishaan-jaff	41f5cb7f04	(fix) prisma set DATABASE_URL in env	2024-01-05 20:57:27 +05:30
ishaan-jaff	898c072103	(fix) proxy - self.connect() for get_data()	2024-01-05 20:48:16 +05:30
Krrish Dholakia	2741835605	build(Dockerfile): move prisma build to dockerfile ... Seems to solve - https://github.com/BerriAI/litellm/issues/1321	2024-01-05 19:03:41 +05:30