31 commits

Author	SHA1	Message	Date
Krrish Dholakia	4185a262ed	test: increase time before checking budget reset - avoid deadlocking	2024-03-06 22:16:59 -08:00
Krrish Dholakia	c963e2761b	feat(proxy_server.py): retry if virtual key is rate limited ... currently for chat completions	2024-03-05 19:00:03 -08:00
Krrish Dholakia	36972a3476	test(test_keys.py): add more duration for test	2024-03-05 15:42:19 -08:00
Krrish Dholakia	60ff533994	test(test_keys.py): extend time for test	2024-03-02 21:19:34 -08:00
Krrish Dholakia	82bced7183	fix(proxy/utils.py): fix resetting budget logic	2024-03-02 20:52:54 -08:00
Krrish Dholakia	366eeb5f29	test: skip sagemaker test - aws account suspended	2024-02-28 15:00:53 -08:00
Krrish Dholakia	5ca2144486	test: testing fixes	2024-02-27 20:35:42 -08:00
Krrish Dholakia	c429dfa746	fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections	2024-02-06 19:39:49 -08:00
Krrish Dholakia	c28d72ca8d	fix(proxy_server.py): prisma client fixes for high traffic	2024-02-06 17:30:36 -08:00
Krrish Dholakia	96c2c64dce	feat(utils.py): support cost tracking for openai/azure image gen models	2024-02-03 17:09:54 -08:00
ishaan-jaff	5e0578db39	(fix) show error in test_keys	2024-02-02 19:15:03 -08:00
Krrish Dholakia	b1c695ae23	test(test_keys.py): separate streaming key info test from normal completion key info test	2024-02-02 19:03:47 -08:00
ishaan-jaff	4867b2b3f3	(ci/cd) run again	2024-02-02 18:56:03 -08:00
Krrish Dholakia	c8fec24976	test(test_keys.py): fix test	2024-01-31 11:26:49 -08:00
Krrish Dholakia	1aa14bff1c	build(config.yml): add more logging for docker build and test	2024-01-31 10:58:25 -08:00
Krrish Dholakia	11940e9f7f	test(test_keys.py): add more retries for checking if budget updated	2024-01-31 10:44:19 -08:00
Krrish Dholakia	59d9bec4b0	test(test_keys.py): reorder tests	2024-01-31 09:37:37 -08:00
Krrish Dholakia	f5c88018dd	feat(proxy_server.py): enable cache controls per key + no-store cache flag	2024-01-30 20:46:50 -08:00
ishaan-jaff	b9388fc792	(test) /key/info	2024-01-26 19:26:55 -08:00
ishaan-jaff	6d6077ec4c	(test) key crossing budget	2024-01-26 14:43:16 -08:00
ishaan-jaff	b370ed137c	(fix) SpendLogs Table	2024-01-26 13:23:51 -08:00
Krrish Dholakia	30abb19d83	test(test_keys.py): add delay for test check ... n	2024-01-25 18:31:07 -08:00
Krrish Dholakia	402235dc5d	fix(utils.py): fix sagemaker async logging for sync streaming ... https://github.com/BerriAI/litellm/issues/1592	2024-01-25 12:49:45 -08:00
Krrish Dholakia	2f25a8db8d	test(test_keys.py): reset proxy spend	2024-01-24 21:08:09 -08:00
Krrish Dholakia	39ed3d42f4	test(test_users.py): test budgets with resets	2024-01-24 15:30:30 -08:00
Krrish Dholakia	c56b677d8e	test(test_keys.py): add testing to make sure budget resets are working as expected	2024-01-24 15:13:11 -08:00
Krrish Dholakia	d563e9a540	test(test_spend_logs): new endpoint test for /spend/logs	2024-01-24 11:20:31 -08:00
Krrish Dholakia	503ce7020b	test(test_keys.py): use correct model name for token counting	2024-01-23 17:46:14 -08:00
Krrish Dholakia	887e962e5e	test(test_keys.py): fix streaming test	2024-01-23 16:27:45 -08:00
Krrish Dholakia	344e232549	fix(utils.py): fix proxy streaming spend tracking	2024-01-23 15:59:03 -08:00
Krrish Dholakia	beca1eaae7	test(tests/): add unit testing for proxy server endpoints	2024-01-19 14:54:29 -08:00