3582 commits

Author	SHA1	Message	Date
ishaan-jaff	6bc715cf85	(test) logging cache_key in spendLogs	2024-01-24 18:54:23 -08:00
ishaan-jaff	2f3765a03f	(fix) log cache hits on SpendLogs table	2024-01-24 18:51:39 -08:00
ishaan-jaff	bf851ef19a	(fix) use litellm.cache for getting key	2024-01-24 18:34:22 -08:00
ishaan-jaff	2130a61b6e	(feat) add cache_key in spend_log	2024-01-24 17:56:00 -08:00
Krrish Dholakia	f148094d18	test(test_key_generate_prisma.py): add unit testing for global proxy budget	2024-01-24 17:43:01 -08:00
ishaan-jaff	d694993703	(fix) bug from bb7705b494	2024-01-24 17:34:17 -08:00
Krrish Dholakia	30a8071bf1	fix(proxy_server.py): enforce budget limit if global proxy limit reached	2024-01-24 17:11:40 -08:00
Ishaan Jaff	45ca7343d0	Merge pull request #1601 from BerriAI/litellm_improve_slack_alertign ... [Feat] Proxy - Improve Slack Alerting	2024-01-24 16:43:23 -08:00
ishaan-jaff	9aae60f162	(FIX) improve slack alerting messages	2024-01-24 16:07:46 -08:00
Krrish Dholakia	574208f005	fix(proxy_server.py): track cost for global proxy	2024-01-24 16:06:10 -08:00
ishaan-jaff	b993c62144	(fix) only alert users when requests are hanging	2024-01-24 15:58:07 -08:00
Krrish Dholakia	bb7705b494	test(test_users.py): test budgets with resets	2024-01-24 15:30:30 -08:00
ishaan-jaff	6c13776701	(fix) alerting - show timestamps in alert	2024-01-24 15:25:40 -08:00
ishaan-jaff	8f4e256531	(feat) add request_info to slack alerts	2024-01-24 15:17:33 -08:00
ishaan-jaff	47110180c8	(feat) proxy - add timestamp to debug logs	2024-01-24 15:16:18 -08:00
Krrish Dholakia	f9d159797a	fix(proxy_server.py): handle view spend logs for api key none object	2024-01-24 14:57:21 -08:00
Krish Dholakia	3e7ed4082a	Merge pull request #1600 from BerriAI/litellm_global_budget ... feat(proxy_server.py): support global budget and resets	2024-01-24 14:55:36 -08:00
ishaan-jaff	087bd5e267	(feat) slack alerting - log request/response	2024-01-24 14:55:21 -08:00
Krish Dholakia	ed77f2d682	Merge pull request #1590 from BerriAI/litellm_spend_logs_by_key ... feat(proxy_server.py): enable returning spend logs by api key	2024-01-24 14:45:25 -08:00
Krrish Dholakia	159e54d8be	feat(proxy_server.py): support global budget and resets	2024-01-24 14:27:13 -08:00
ishaan-jaff	fdcb588511	(fix) stop logging messages, response in SpendLogs	2024-01-24 13:16:34 -08:00
ishaan-jaff	63f18e7163	(fix) use get_attr for valid_token	2024-01-24 13:01:37 -08:00
ishaan-jaff	25332b4a60	(fix) LiteLLM_VerificationToken - use NULL default for max_budget	2024-01-24 12:59:50 -08:00
Ishaan Jaff	f76620b1d1	Merge branch 'main' into litellm_spend_per_user	2024-01-24 12:24:15 -08:00
ishaan-jaff	d812ae7e9a	(test) spend_user_fn, spend_key_fn	2024-01-24 12:09:16 -08:00
ishaan-jaff	2692afca75	(feat) /spend/users endpoint	2024-01-24 11:34:28 -08:00
ishaan-jaff	1872122bfb	(test) streaming spend logs test - actually run this	2024-01-24 11:27:27 -08:00
ishaan-jaff	3e53742a4f	(test) model in SpendLogs table	2024-01-24 11:10:13 -08:00
ishaan-jaff	a842e6520c	(test) setting model in SpendTable logs	2024-01-24 11:09:20 -08:00
ishaan-jaff	5e8a6fd80e	(test) writing spend logs table	2024-01-24 10:56:11 -08:00
Krrish Dholakia	dd05c6e6e3	feat(proxy_server.py): enable returning spend logs by api key ... https://github.com/BerriAI/litellm/issues/1582	2024-01-24 10:48:23 -08:00
ishaan-jaff	d3848b6e6c	(v0)	2024-01-24 10:13:57 -08:00
ishaan-jaff	2d26875eb0	(fix) together_ai use sync generator	2024-01-23 20:07:26 -08:00
ishaan-jaff	b0902f0a8c	(ci/cd) add more logging to timeout test	2024-01-23 18:39:19 -08:00
Ishaan Jaff	a0cd4e78fc	Merge branch 'main' into litellm_map_openai_auth_errors	2024-01-23 18:31:48 -08:00
Krish Dholakia	9784d03d65	Merge branch 'main' into litellm_reset_key_budget	2024-01-23 18:10:32 -08:00
Krrish Dholakia	d6844f43c8	test(test_keys.py): use correct model name for token counting	2024-01-23 17:46:14 -08:00
ishaan-jaff	b3ce0ac728	(test) proxy_custom_auth use new exceptions	2024-01-23 17:36:13 -08:00
ishaan-jaff	d2675a1ff3	(test) switch dynamodb test to use new exceptions	2024-01-23 17:34:18 -08:00
ishaan-jaff	feb367bbb9	(feat) all endpoints raise OpenAI compatible exceptions	2024-01-23 17:32:47 -08:00
ishaan-jaff	37dd1114f2	(test) update prisma test	2024-01-23 17:30:01 -08:00
Krrish Dholakia	7b5e3b9934	refactor(proxy/utils.py): fix linting issue	2024-01-23 17:22:22 -08:00
Krish Dholakia	4ca4913468	Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking ... [WIP] fix(utils.py): fix proxy streaming spend tracking	2024-01-23 17:07:40 -08:00
Ishaan Jaff	fdb6a7409b	Merge pull request #1575 from BerriAI/litellm_ui_view_spend ... [Feat] UI view spend per API Key	2024-01-23 17:02:19 -08:00
ishaan-jaff	0e9339b390	(feat) /spend/logs	2024-01-23 16:57:51 -08:00
ishaan-jaff	8ae8edfdb4	(fix) add doc string for /spend/keys	2024-01-23 16:27:25 -08:00
Krrish Dholakia	7e0adbb9bd	fix(proxy/utils.py): remove original auth sk-.. key before logging to spend logs	2024-01-23 16:19:32 -08:00
Krrish Dholakia	d52f5234b4	fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss ... ue for spend logs	2024-01-23 16:14:01 -08:00
Krrish Dholakia	f8870fb48e	fix(utils.py): fix proxy streaming spend tracking	2024-01-23 15:59:03 -08:00
ishaan-jaff	1158ff4995	(feat) use cli args to start streamlit	2024-01-23 15:58:14 -08:00