51 commits

Author	SHA1	Message	Date
Ishaan Jaff	556f34937d	mark test_key_info_spend_values_streaming as flaky	2024-08-29 14:39:53 -07:00
Krrish Dholakia	3d4672ba53	fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111	2024-08-08 10:30:15 -07:00
Krrish Dholakia	2a5a30fa7a	fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors ... standardizes error code for budget exceeded errors to status code 400	2024-06-11 16:10:58 -07:00
Ishaan Jaff	dc51fec22e	fix migrate to LitellmUserRoles	2024-05-30 13:57:50 -07:00
Krrish Dholakia	0cbce770a2	fix(proxy_server.py): fix model list returned for /model/info when team has restricted access	2024-05-25 13:21:33 -07:00
Krrish Dholakia	b0afacf7e3	fix(proxy_server.py): fix model check for /v1/models endpoint when team has restricted access	2024-05-25 13:02:03 -07:00
Ishaan Jaff	38f2e5fbd7	fix test_key_model_list	2024-05-22 20:49:19 -07:00
Krrish Dholakia	f503929918	fix(proxy_server.py): fix /v1/models bug where it would return empty list ... handle 'all-team-models' being set for a given key	2024-05-07 13:43:15 -07:00
Ishaan Jaff	c43024744d	(ci/cd) add detailed debugging info	2024-05-06 11:40:16 -07:00
Krrish Dholakia	572f426839	test: skip hanging test	2024-05-05 00:27:38 -07:00
Krrish Dholakia	545da57dc0	build(test_keys.py): improve error message for test	2024-05-01 08:22:28 -07:00
Krrish Dholakia	ae04330348	fix(proxy_server.py): fix setting offset-aware datetime	2024-04-25 21:18:32 -07:00
Ishaan Jaff	030b0cc543	test fix - test_key_delete_ui	2024-04-20 12:30:58 -07:00
Ishaan Jaff	06fc285ed2	fix - test keys	2024-04-20 11:43:43 -07:00
Krrish Dholakia	1b3a75c302	fix(proxy_server.py): fix key create logic + add unit tests	2024-04-16 13:08:34 -07:00
Ishaan Jaff	779ea41e4f	test - delete keys	2024-04-15 16:37:20 -07:00
Krrish Dholakia	cda0c49b20	fix(proxy_server.py): fix /key/update endpoint to update key duration ... also adds a test for this to our ci/cd	2024-03-29 21:47:10 -07:00
Krrish Dholakia	ed3681d9bd	fix(proxy_server.py): fix model info check	2024-03-23 15:59:17 -07:00
Krrish Dholakia	fac0bb72df	test: handle flaky tests locally - causing db timeout issues on circle ci	2024-03-19 20:39:53 -07:00
Krrish Dholakia	6c578db2c2	fix(proxy_server.py): fix spend log update	2024-03-18 20:26:28 -07:00
Krrish Dholakia	4185a262ed	test: increase time before checking budget reset - avoid deadlocking	2024-03-06 22:16:59 -08:00
Krrish Dholakia	c963e2761b	feat(proxy_server.py): retry if virtual key is rate limited ... currently for chat completions	2024-03-05 19:00:03 -08:00
Krrish Dholakia	36972a3476	test(test_keys.py): add more duration for test	2024-03-05 15:42:19 -08:00
Krrish Dholakia	60ff533994	test(test_keys.py): extend time for test	2024-03-02 21:19:34 -08:00
Krrish Dholakia	82bced7183	fix(proxy/utils.py): fix resetting budget logic	2024-03-02 20:52:54 -08:00
Krrish Dholakia	366eeb5f29	test: skip sagemaker test - aws account suspended	2024-02-28 15:00:53 -08:00
Krrish Dholakia	5ca2144486	test: testing fixes	2024-02-27 20:35:42 -08:00
Krrish Dholakia	c429dfa746	fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections	2024-02-06 19:39:49 -08:00
Krrish Dholakia	c28d72ca8d	fix(proxy_server.py): prisma client fixes for high traffic	2024-02-06 17:30:36 -08:00
Krrish Dholakia	96c2c64dce	feat(utils.py): support cost tracking for openai/azure image gen models	2024-02-03 17:09:54 -08:00
ishaan-jaff	5e0578db39	(fix) show error in test_keys	2024-02-02 19:15:03 -08:00
Krrish Dholakia	b1c695ae23	test(test_keys.py): separate streaming key info test from normal completion key info test	2024-02-02 19:03:47 -08:00
ishaan-jaff	4867b2b3f3	(ci/cd) run again	2024-02-02 18:56:03 -08:00
Krrish Dholakia	c8fec24976	test(test_keys.py): fix test	2024-01-31 11:26:49 -08:00
Krrish Dholakia	1aa14bff1c	build(config.yml): add more logging for docker build and test	2024-01-31 10:58:25 -08:00
Krrish Dholakia	11940e9f7f	test(test_keys.py): add more retries for checking if budget updated	2024-01-31 10:44:19 -08:00
Krrish Dholakia	59d9bec4b0	test(test_keys.py): reorder tests	2024-01-31 09:37:37 -08:00
Krrish Dholakia	f5c88018dd	feat(proxy_server.py): enable cache controls per key + no-store cache flag	2024-01-30 20:46:50 -08:00
ishaan-jaff	b9388fc792	(test) /key/info	2024-01-26 19:26:55 -08:00
ishaan-jaff	6d6077ec4c	(test) key crossing budget	2024-01-26 14:43:16 -08:00
ishaan-jaff	b370ed137c	(fix) SpendLogs Table	2024-01-26 13:23:51 -08:00
Krrish Dholakia	30abb19d83	test(test_keys.py): add delay for test check ... n	2024-01-25 18:31:07 -08:00
Krrish Dholakia	402235dc5d	fix(utils.py): fix sagemaker async logging for sync streaming ... https://github.com/BerriAI/litellm/issues/1592	2024-01-25 12:49:45 -08:00
Krrish Dholakia	2f25a8db8d	test(test_keys.py): reset proxy spend	2024-01-24 21:08:09 -08:00
Krrish Dholakia	39ed3d42f4	test(test_users.py): test budgets with resets	2024-01-24 15:30:30 -08:00
Krrish Dholakia	c56b677d8e	test(test_keys.py): add testing to make sure budget resets are working as expected	2024-01-24 15:13:11 -08:00
Krrish Dholakia	d563e9a540	test(test_spend_logs): new endpoint test for /spend/logs	2024-01-24 11:20:31 -08:00
Krrish Dholakia	503ce7020b	test(test_keys.py): use correct model name for token counting	2024-01-23 17:46:14 -08:00
Krrish Dholakia	887e962e5e	test(test_keys.py): fix streaming test	2024-01-23 16:27:45 -08:00
Krrish Dholakia	344e232549	fix(utils.py): fix proxy streaming spend tracking	2024-01-23 15:59:03 -08:00