470 commits

Author	SHA1	Message	Date
Krrish Dholakia	61f5e3b6e3	fix(proxy/utils.py): accept token hashes for deleting tokens	2024-01-26 13:29:16 -08:00
ishaan-jaff	07449d3cf3	(feat) SpendLogs show total_tokens, prompt_tokens, completion_tokens	2024-01-26 10:26:15 -08:00
ishaan-jaff	643554f4b9	(fix) SpendLogs stop logging model params	2024-01-26 10:13:34 -08:00
Sébastien Campion	a40b960585	fix print verbose take only one argument	2024-01-26 18:03:55 +01:00
ishaan-jaff	4cee08da5d	(fix) do nothing if alerting is not switched on	2024-01-25 16:40:23 -08:00
ishaan-jaff	cec08f6800	(fix) alerting debug statements	2024-01-25 16:40:23 -08:00
ishaan-jaff	9cd48b3b22	(fix) better alert message on budgets	2024-01-25 16:40:23 -08:00
ishaan-jaff	71a6f7fcc4	(feat) slack alerting budgets	2024-01-25 16:40:23 -08:00
ishaan-jaff	1f62453719	(feat) alerts proxy budgets	2024-01-25 16:40:23 -08:00
ishaan-jaff	1d36b8da31	v0 basic structure	2024-01-25 16:40:23 -08:00
Krrish Dholakia	402235dc5d	fix(utils.py): fix sagemaker async logging for sync streaming ... https://github.com/BerriAI/litellm/issues/1592	2024-01-25 12:49:45 -08:00
Krrish Dholakia	d1b563fbf4	fix(proxy/utils.py): handle item not existing during batch updates	2024-01-24 21:49:47 -08:00
Krrish Dholakia	2f25a8db8d	test(test_keys.py): reset proxy spend	2024-01-24 21:08:09 -08:00
Krish Dholakia	f1d309d700	Merge branch 'main' into litellm_global_spend_updates	2024-01-24 20:20:15 -08:00
ishaan-jaff	40a8c1af2d	(fix) log cache hits on SpendLogs table	2024-01-24 18:51:39 -08:00
ishaan-jaff	52fb8c5b40	(fix) use litellm.cache for getting key	2024-01-24 18:34:22 -08:00
ishaan-jaff	c8b2e5c80b	(feat) add cache_key in spend_log	2024-01-24 17:56:00 -08:00
Krrish Dholakia	7a8f10c1c0	test(test_key_generate_prisma.py): add unit testing for global proxy budget	2024-01-24 17:43:01 -08:00
ishaan-jaff	a0f2bae4e2	(fix) bug from bb7705b494	2024-01-24 17:34:17 -08:00
Krrish Dholakia	8518e2e2d1	fix(proxy_server.py): enforce budget limit if global proxy limit reached	2024-01-24 17:11:40 -08:00
Ishaan Jaff	6dac4ab8aa	Merge pull request #1601 from BerriAI/litellm_improve_slack_alertign ... [Feat] Proxy - Improve Slack Alerting	2024-01-24 16:43:23 -08:00
ishaan-jaff	2addde9279	(FIX) improve slack alerting messages	2024-01-24 16:07:46 -08:00
Krrish Dholakia	d536374be0	fix(proxy_server.py): track cost for global proxy	2024-01-24 16:06:10 -08:00
ishaan-jaff	2686d1f087	(fix) only alert users when requests are hanging	2024-01-24 15:58:07 -08:00
Krrish Dholakia	39ed3d42f4	test(test_users.py): test budgets with resets	2024-01-24 15:30:30 -08:00
ishaan-jaff	0f51cd0bab	(fix) alerting - show timestamps in alert	2024-01-24 15:25:40 -08:00
ishaan-jaff	44718e59e9	(feat) add request_info to slack alerts	2024-01-24 15:17:33 -08:00
Krish Dholakia	65c971e60e	Merge pull request #1600 from BerriAI/litellm_global_budget ... feat(proxy_server.py): support global budget and resets	2024-01-24 14:55:36 -08:00
ishaan-jaff	3fe475c9ce	(feat) slack alerting - log request/response	2024-01-24 14:55:21 -08:00
Krish Dholakia	e92cf9e6a3	Merge pull request #1590 from BerriAI/litellm_spend_logs_by_key ... feat(proxy_server.py): enable returning spend logs by api key	2024-01-24 14:45:25 -08:00
Krrish Dholakia	f21e003f5b	feat(proxy_server.py): support global budget and resets	2024-01-24 14:27:13 -08:00
ishaan-jaff	5211e5ca99	(fix) stop logging messages, response in SpendLogs	2024-01-24 13:16:34 -08:00
Ishaan Jaff	00c98f3169	Merge branch 'main' into litellm_spend_per_user	2024-01-24 12:24:15 -08:00
ishaan-jaff	b1c91a987a	(feat) /spend/users endpoint	2024-01-24 11:34:28 -08:00
ishaan-jaff	722a5a5132	(test) setting model in SpendTable logs	2024-01-24 11:09:20 -08:00
Krrish Dholakia	55344e836d	feat(proxy_server.py): enable returning spend logs by api key ... https://github.com/BerriAI/litellm/issues/1582	2024-01-24 10:48:23 -08:00
Krish Dholakia	89e420b243	Merge branch 'main' into litellm_reset_key_budget	2024-01-23 18:10:32 -08:00
Krrish Dholakia	503ce7020b	test(test_keys.py): use correct model name for token counting	2024-01-23 17:46:14 -08:00
Krrish Dholakia	3cf1623727	refactor(proxy/utils.py): fix linting issue	2024-01-23 17:22:22 -08:00
Krish Dholakia	2ba8863f75	Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking ... [WIP] fix(utils.py): fix proxy streaming spend tracking	2024-01-23 17:07:40 -08:00
ishaan-jaff	9ae3d8c243	(feat) /spend/logs	2024-01-23 16:57:51 -08:00
Krrish Dholakia	e53717f050	fix(proxy/utils.py): remove original auth sk-.. key before logging to spend logs	2024-01-23 16:19:32 -08:00
Krrish Dholakia	a5e53271d3	fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss ... ue for spend logs	2024-01-23 16:14:01 -08:00
ishaan-jaff	9c85d05d24	(feat) add /spend/keys endpoint	2024-01-23 15:10:10 -08:00
Krrish Dholakia	88486a3123	fix(utils.py): fix streaming cost tracking	2024-01-23 14:39:45 -08:00
Krrish Dholakia	e6f05e858b	feat(proxy/utils.py): enable background process to reset key budgets	2024-01-23 12:33:13 -08:00
Krrish Dholakia	e423aeff85	fix: support streaming custom cost completion tracking	2024-01-22 15:15:34 -08:00
ishaan-jaff	f4aef679c9	(feat) proxy - track cost for user_ids that do not exist	2024-01-18 17:44:39 -08:00
ishaan-jaff	b6af86a933	(feat) track - api_key in spendLogs	2024-01-18 13:16:25 -08:00
ishaan-jaff	772aa0ad8d	(feat) insert_data to spend table	2024-01-18 10:09:02 -08:00