134 commits

Author	SHA1	Message	Date
Krrish Dholakia	ef0171e063	feat(utils.py): support cost tracking for openai/azure image gen models	2024-02-03 17:09:54 -08:00
Krrish Dholakia	5f9ea8a94f	fix(utils.py): add track cost callback to callback list for team id callbacks	2024-02-02 08:18:06 -08:00
Krrish Dholakia	92058cbcd4	fix(utils.py): override default success callbacks with dynamic callbacks if set	2024-02-02 06:21:43 -08:00
ishaan-jaff	e13e61ad3b	(docs) proxy ui	2024-02-01 16:17:04 -08:00
ishaan-jaff	44bf1409e0	(fix) ui link	2024-02-01 16:14:29 -08:00
ishaan-jaff	83cbed8b20	(fix) default UI use master key for auth	2024-02-01 16:05:23 -08:00
ishaan-jaff	26520dd4e4	(fix) ui improve default flow	2024-02-01 15:03:48 -08:00
Krish Dholakia	ce415a243d	Merge branch 'main' into litellm_no_store_cache_control	2024-01-30 21:44:57 -08:00
Krrish Dholakia	f9acad87dc	feat(proxy_server.py): enable cache controls per key + no-store cache flag	2024-01-30 20:46:50 -08:00
ishaan-jaff	8daabe16f4	(feat) allow users to use UI without SSO	2024-01-30 17:00:40 -08:00
Krrish Dholakia	bbe71c8375	fix(test_parallel_request_limiter): increase time limit for waiting for success logging event to happen	2024-01-30 13:26:17 -08:00
Sébastien Campion	4dd18b553a	Merge remote-tracking branch 'src/main'	2024-01-27 19:24:35 +01:00
Sébastien Campion	4ba809b835	Allow optional usage of the tls encryption for SMTPA ... For local dev, a local SMTP server like mailhog is useful and allow to manually manage user creation	2024-01-27 19:16:53 +01:00
ishaan-jaff	8b52333b08	(feat) fix alert formats for budgets	2024-01-26 17:14:47 -08:00
Krrish Dholakia	e989175c10	fix(proxy/utils.py): accept token hashes for deleting tokens	2024-01-26 13:29:16 -08:00
ishaan-jaff	64f1301033	(feat) SpendLogs show total_tokens, prompt_tokens, completion_tokens	2024-01-26 10:26:15 -08:00
ishaan-jaff	b9fc2c3735	(fix) SpendLogs stop logging model params	2024-01-26 10:13:34 -08:00
Sébastien Campion	a5d120a68b	fix print verbose take only one argument	2024-01-26 18:03:55 +01:00
ishaan-jaff	5264a3eb53	(fix) do nothing if alerting is not switched on	2024-01-25 16:40:23 -08:00
ishaan-jaff	1c9b02ad99	(fix) alerting debug statements	2024-01-25 16:40:23 -08:00
ishaan-jaff	229e4920df	(fix) better alert message on budgets	2024-01-25 16:40:23 -08:00
ishaan-jaff	7a2a7e047f	(feat) slack alerting budgets	2024-01-25 16:40:23 -08:00
ishaan-jaff	55115a75b0	(feat) alerts proxy budgets	2024-01-25 16:40:23 -08:00
ishaan-jaff	565531fe9e	v0 basic structure	2024-01-25 16:40:23 -08:00
Krrish Dholakia	09ec6d6458	fix(utils.py): fix sagemaker async logging for sync streaming ... https://github.com/BerriAI/litellm/issues/1592	2024-01-25 12:49:45 -08:00
Krrish Dholakia	81846ffdec	fix(proxy/utils.py): handle item not existing during batch updates	2024-01-24 21:49:47 -08:00
Krrish Dholakia	8e1157fc92	test(test_keys.py): reset proxy spend	2024-01-24 21:08:09 -08:00
Krish Dholakia	6501fdb76e	Merge branch 'main' into litellm_global_spend_updates	2024-01-24 20:20:15 -08:00
ishaan-jaff	2f3765a03f	(fix) log cache hits on SpendLogs table	2024-01-24 18:51:39 -08:00
ishaan-jaff	bf851ef19a	(fix) use litellm.cache for getting key	2024-01-24 18:34:22 -08:00
ishaan-jaff	2130a61b6e	(feat) add cache_key in spend_log	2024-01-24 17:56:00 -08:00
Krrish Dholakia	f148094d18	test(test_key_generate_prisma.py): add unit testing for global proxy budget	2024-01-24 17:43:01 -08:00
ishaan-jaff	d694993703	(fix) bug from bb7705b494	2024-01-24 17:34:17 -08:00
Krrish Dholakia	30a8071bf1	fix(proxy_server.py): enforce budget limit if global proxy limit reached	2024-01-24 17:11:40 -08:00
Ishaan Jaff	45ca7343d0	Merge pull request #1601 from BerriAI/litellm_improve_slack_alertign ... [Feat] Proxy - Improve Slack Alerting	2024-01-24 16:43:23 -08:00
ishaan-jaff	9aae60f162	(FIX) improve slack alerting messages	2024-01-24 16:07:46 -08:00
Krrish Dholakia	574208f005	fix(proxy_server.py): track cost for global proxy	2024-01-24 16:06:10 -08:00
ishaan-jaff	b993c62144	(fix) only alert users when requests are hanging	2024-01-24 15:58:07 -08:00
Krrish Dholakia	bb7705b494	test(test_users.py): test budgets with resets	2024-01-24 15:30:30 -08:00
ishaan-jaff	6c13776701	(fix) alerting - show timestamps in alert	2024-01-24 15:25:40 -08:00
ishaan-jaff	8f4e256531	(feat) add request_info to slack alerts	2024-01-24 15:17:33 -08:00
Krish Dholakia	3e7ed4082a	Merge pull request #1600 from BerriAI/litellm_global_budget ... feat(proxy_server.py): support global budget and resets	2024-01-24 14:55:36 -08:00
ishaan-jaff	087bd5e267	(feat) slack alerting - log request/response	2024-01-24 14:55:21 -08:00
Krish Dholakia	ed77f2d682	Merge pull request #1590 from BerriAI/litellm_spend_logs_by_key ... feat(proxy_server.py): enable returning spend logs by api key	2024-01-24 14:45:25 -08:00
Krrish Dholakia	159e54d8be	feat(proxy_server.py): support global budget and resets	2024-01-24 14:27:13 -08:00
ishaan-jaff	fdcb588511	(fix) stop logging messages, response in SpendLogs	2024-01-24 13:16:34 -08:00
Ishaan Jaff	f76620b1d1	Merge branch 'main' into litellm_spend_per_user	2024-01-24 12:24:15 -08:00
ishaan-jaff	2692afca75	(feat) /spend/users endpoint	2024-01-24 11:34:28 -08:00
ishaan-jaff	a842e6520c	(test) setting model in SpendTable logs	2024-01-24 11:09:20 -08:00
Krrish Dholakia	dd05c6e6e3	feat(proxy_server.py): enable returning spend logs by api key ... https://github.com/BerriAI/litellm/issues/1582	2024-01-24 10:48:23 -08:00