520 commits

Author	SHA1	Message	Date
Krrish Dholakia	eea4325e60	test(test_keys.py): add more retries for checking if budget updated	2024-01-31 10:44:19 -08:00
Krrish Dholakia	a0022410fa	test(test_users.py): add more reattempts and delays	2024-01-31 10:05:35 -08:00
Krrish Dholakia	70d5f9ef96	test(test_keys.py): reorder tests	2024-01-31 09:37:37 -08:00
Krrish Dholakia	f9acad87dc	feat(proxy_server.py): enable cache controls per key + no-store cache flag	2024-01-30 20:46:50 -08:00
ishaan-jaff	6097102c21	(test) /health/readiness	2024-01-29 15:27:25 -08:00
ishaan-jaff	9c4d9c2f58	(test) /key/info	2024-01-26 19:26:55 -08:00
ishaan-jaff	2a60af7164	(test) key crossing budget	2024-01-26 14:43:16 -08:00
ishaan-jaff	55b95e87dd	(fix) SpendLogs Table	2024-01-26 13:23:51 -08:00
Krrish Dholakia	554f1a090d	test(test_keys.py): add delay for test check ... n	2024-01-25 18:31:07 -08:00
Krrish Dholakia	09ec6d6458	fix(utils.py): fix sagemaker async logging for sync streaming ... https://github.com/BerriAI/litellm/issues/1592	2024-01-25 12:49:45 -08:00
Krrish Dholakia	8e1157fc92	test(test_keys.py): reset proxy spend	2024-01-24 21:08:09 -08:00
Krrish Dholakia	624da17698	test(test_users.py): add testing for global proxy spend tracking	2024-01-24 16:24:50 -08:00
Krrish Dholakia	bb7705b494	test(test_users.py): test budgets with resets	2024-01-24 15:30:30 -08:00
Krrish Dholakia	e471157d57	test(test_keys.py): add testing to make sure budget resets are working as expected	2024-01-24 15:13:11 -08:00
Krrish Dholakia	f0ada5c950	test(test_spend_logs): new endpoint test for /spend/logs	2024-01-24 11:20:31 -08:00
Krrish Dholakia	d6844f43c8	test(test_keys.py): use correct model name for token counting	2024-01-23 17:46:14 -08:00
Krrish Dholakia	f47db44b4f	test(test_keys.py): fix streaming test	2024-01-23 16:27:45 -08:00
Krrish Dholakia	f8870fb48e	fix(utils.py): fix proxy streaming spend tracking	2024-01-23 15:59:03 -08:00
Krrish Dholakia	f5ced089d6	test(tests/): add unit testing for proxy server endpoints	2024-01-19 14:54:29 -08:00
Krrish Dholakia	1a29272b47	fix(parallel_request_limiter.py): handle tpm/rpm limits being null	2024-01-19 10:22:27 -08:00