913 commits

Author	SHA1	Message	Date
Krrish Dholakia	159e54d8be	feat(proxy_server.py): support global budget and resets	2024-01-24 14:27:13 -08:00
ishaan-jaff	fdcb588511	(fix) stop logging messages, response in SpendLogs	2024-01-24 13:16:34 -08:00
ishaan-jaff	63f18e7163	(fix) use get_attr for valid_token	2024-01-24 13:01:37 -08:00
ishaan-jaff	25332b4a60	(fix) LiteLLM_VerificationToken - use NULL default for max_budget	2024-01-24 12:59:50 -08:00
Ishaan Jaff	f76620b1d1	Merge branch 'main' into litellm_spend_per_user	2024-01-24 12:24:15 -08:00
ishaan-jaff	2692afca75	(feat) /spend/users endpoint	2024-01-24 11:34:28 -08:00
ishaan-jaff	a842e6520c	(test) setting model in SpendTable logs	2024-01-24 11:09:20 -08:00
Krrish Dholakia	dd05c6e6e3	feat(proxy_server.py): enable returning spend logs by api key ... https://github.com/BerriAI/litellm/issues/1582	2024-01-24 10:48:23 -08:00
ishaan-jaff	d3848b6e6c	(v0)	2024-01-24 10:13:57 -08:00
ishaan-jaff	2d26875eb0	(fix) together_ai use sync generator	2024-01-23 20:07:26 -08:00
Ishaan Jaff	a0cd4e78fc	Merge branch 'main' into litellm_map_openai_auth_errors	2024-01-23 18:31:48 -08:00
Krish Dholakia	9784d03d65	Merge branch 'main' into litellm_reset_key_budget	2024-01-23 18:10:32 -08:00
Krrish Dholakia	d6844f43c8	test(test_keys.py): use correct model name for token counting	2024-01-23 17:46:14 -08:00
ishaan-jaff	feb367bbb9	(feat) all endpoints raise OpenAI compatible exceptions	2024-01-23 17:32:47 -08:00
Krrish Dholakia	7b5e3b9934	refactor(proxy/utils.py): fix linting issue	2024-01-23 17:22:22 -08:00
Krish Dholakia	4ca4913468	Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking ... [WIP] fix(utils.py): fix proxy streaming spend tracking	2024-01-23 17:07:40 -08:00
ishaan-jaff	0e9339b390	(feat) /spend/logs	2024-01-23 16:57:51 -08:00
ishaan-jaff	8ae8edfdb4	(fix) add doc string for /spend/keys	2024-01-23 16:27:25 -08:00
Krrish Dholakia	7e0adbb9bd	fix(proxy/utils.py): remove original auth sk-.. key before logging to spend logs	2024-01-23 16:19:32 -08:00
Krrish Dholakia	d52f5234b4	fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss ... ue for spend logs	2024-01-23 16:14:01 -08:00
Krrish Dholakia	f8870fb48e	fix(utils.py): fix proxy streaming spend tracking	2024-01-23 15:59:03 -08:00
ishaan-jaff	1158ff4995	(feat) use cli args to start streamlit	2024-01-23 15:58:14 -08:00
ishaan-jaff	a2da9c30fb	(feat) add /spend/keys endpoint	2024-01-23 15:10:10 -08:00
Krrish Dholakia	afada01ffc	fix(utils.py): fix streaming cost tracking	2024-01-23 14:39:45 -08:00
Krrish Dholakia	b1a105e309	feat(proxy/utils.py): enable background process to reset key budgets	2024-01-23 12:33:13 -08:00
ishaan-jaff	44e213e842	(fix) select_data_generator	2024-01-23 12:13:34 -08:00
ishaan-jaff	a61dbc1613	(fix) select_data_generator - sagemaker	2024-01-23 12:08:58 -08:00
ishaan-jaff	bd37a9cb5e	(fix) proxy - streaming sagemaker	2024-01-23 11:12:16 -08:00
ishaan-jaff	fa2c94aacb	(docs) remove custom_auth in example config.yaml	2024-01-23 08:40:21 -08:00
ishaan-jaff	bc3332fc7c	(docs) use proxy + Sagemaker stream test	2024-01-22 22:11:06 -08:00
Krish Dholakia	bedb08bdef	Merge pull request #1557 from BerriAI/litellm_emit_spend_logs ... feat(utils.py): emit response cost as part of logs	2024-01-22 21:02:40 -08:00
Krrish Dholakia	11e3ee4411	test: fix tests	2024-01-22 20:20:17 -08:00
Krrish Dholakia	3e8c8ef507	fix(openai.py): fix linting issue	2024-01-22 18:20:15 -08:00
Krrish Dholakia	e917d0eee6	feat(utils.py): emit response cost as part of logs	2024-01-22 15:53:04 -08:00
Ishaan Jaff	db68774d60	Merge branch 'main' into litellm_budget_per_key	2024-01-22 15:49:57 -08:00
Krrish Dholakia	074ea17325	fix: support streaming custom cost completion tracking	2024-01-22 15:15:34 -08:00
Ishaan Jaff	5700d60e1a	Merge pull request #1538 from BerriAI/litellm_use_custom_key_gen ... [Feat] Proxy Auth - Use custom_key_generate	2024-01-22 14:21:19 -08:00
ishaan-jaff	9d34281025	(fix) spend tracking per key - when no cache hit	2024-01-22 13:18:33 -08:00
ishaan-jaff	6120e1c36d	(fix) dynamo max_budget per key	2024-01-22 12:50:14 -08:00
ishaan-jaff	de7663ead3	(fix) make max_budget optional for LiteLLM_VerificationToken	2024-01-22 12:20:38 -08:00
ishaan-jaff	8979b74d49	(feat) working budgets per key	2024-01-22 12:13:19 -08:00
ishaan-jaff	7ed3141c7d	(feat) working create budgets per key	2024-01-22 11:58:20 -08:00
ishaan-jaff	8b599d4398	v0 max_budget per key	2024-01-22 11:33:34 -08:00
Krrish Dholakia	e2831e9c80	fix: fix proxy logging	2024-01-20 18:22:45 -08:00
Krrish Dholakia	09b7235b31	fix: support info level logging on pkg + proxy	2024-01-20 17:45:47 -08:00
Krrish Dholakia	3e5b743b89	fix(caching.py): add logging module support for caching	2024-01-20 17:34:29 -08:00
ishaan-jaff	13eb40e7bd	v0 using custom_key_generate	2024-01-20 08:39:52 -08:00
Krrish Dholakia	7cf0bb475f	fix(proxy_server.py): run all endpoints through custom auth	2024-01-19 20:24:33 -08:00
Krrish Dholakia	2c2163e4e5	fix(proxy_server.py): fix key info to handle pydantic v1	2024-01-19 18:52:09 -08:00
Krrish Dholakia	f05aba1f85	fix(utils.py): add metadata to logging obj on setup, if exists	2024-01-19 17:29:47 -08:00