514 commits

Author	SHA1	Message	Date
Krrish Dholakia	2dfdc8dd69	Revert "Merge pull request #2593 from BerriAI/litellm_reset_budget_fix" ... This reverts commit afd363129f, reversing changes made to c94bc94ad5.	2024-03-19 20:25:41 -07:00
Krrish Dholakia	b9f222f8fb	test(test_users.py): skip flaky circle ci test	2024-03-19 20:09:38 -07:00
Krrish Dholakia	97e7113b87	test(test_users.py): fix test	2024-03-19 19:48:44 -07:00
Krrish Dholakia	9140453d0c	test: make test call more reliable	2024-03-19 19:47:18 -07:00
Krrish Dholakia	0822f6283f	test(test_users.py): reposition test ... trying to identify why endpoint isn't being called	2024-03-19 19:40:41 -07:00
Krrish Dholakia	f588bff69b	fix(proxy_server.py): fix spend log update	2024-03-18 20:26:28 -07:00
ishaan-jaff	992aba2a77	(fix) predict/spend/logs test	2024-03-13 14:09:51 -07:00
ishaan-jaff	ba5cc19edf	(test) using get_predict_spend_logs	2024-03-13 14:00:04 -07:00
Krrish Dholakia	fa45c569fd	feat: add cost tracking + caching for transcription calls	2024-03-09 15:43:38 -08:00
Krish Dholakia	caa99f43bf	Merge branch 'main' into litellm_load_balancing_transcription_endpoints	2024-03-08 23:08:47 -08:00
Krrish Dholakia	7ff8fa09d6	test(test_whisper.py): hardcode api base	2024-03-08 22:51:17 -08:00
Krrish Dholakia	c0c76707a1	test(test_whisper.py): cleanup test	2024-03-08 22:44:22 -08:00
Krrish Dholakia	0432c85bf7	test(test_whisper.py): add debugging for circle ci error	2024-03-08 22:43:07 -08:00
Krrish Dholakia	fac01f8481	fix(azure.py): add pre call logging for transcription calls	2024-03-08 22:23:21 -08:00
Krrish Dholakia	0fb7afe820	feat(proxy_server.py): working /audio/transcription endpoint	2024-03-08 18:20:27 -08:00
Krrish Dholakia	fe125a5131	test(test_whisper.py): add testing for load balancing whisper endpoints on router	2024-03-08 14:19:37 -08:00
Krrish Dholakia	9274245a0b	test(test_whisper.py): fix getting path for audio file in test	2024-03-08 14:10:19 -08:00
Krrish Dholakia	6fa585d001	test(test_whisper.py): fix test	2024-03-08 14:02:34 -08:00
Krrish Dholakia	6b1049217e	feat(azure.py): add support for calling whisper endpoints on azure	2024-03-08 13:48:38 -08:00
Krrish Dholakia	696eb54455	feat(main.py): support openai transcription endpoints ... enable user to load balance between openai + azure transcription endpoints	2024-03-08 10:25:19 -08:00
Krrish Dholakia	dd78a1956a	fix(proxy_server.py): fix model alias map + add back testing	2024-03-07 07:56:51 -08:00
Krrish Dholakia	b9854a99d2	test: increase time before checking budget reset - avoid deadlocking	2024-03-06 22:16:59 -08:00
Krrish Dholakia	ad55f4dbb5	feat(proxy_server.py): retry if virtual key is rate limited ... currently for chat completions	2024-03-05 19:00:03 -08:00
Krrish Dholakia	2b595bfdc9	test(test_keys.py): add more duration for test	2024-03-05 15:42:19 -08:00
Krrish Dholakia	4f3d1ee11f	test(test_keys.py): extend time for test	2024-03-02 21:19:34 -08:00
Krrish Dholakia	37ad5efc61	fix(proxy/utils.py): fix resetting budget logic	2024-03-02 20:52:54 -08:00
Krrish Dholakia	6fb19c5d42	test(test_organizations.py): add testing for /organization/new endpoint	2024-03-02 12:13:54 -08:00
Krrish Dholakia	6b8b0f40cf	feat(proxy_server.py): add new team_member delete endpoint	2024-03-01 09:14:08 -08:00
Krrish Dholakia	f7a2d3faef	test: skip sagemaker test - aws account suspended	2024-02-28 15:00:53 -08:00
Krrish Dholakia	5265d9042d	test: testing fixes	2024-02-27 20:35:42 -08:00
Krrish Dholakia	20def3805c	test(test_openai_endpoints.py): fix test	2024-02-23 22:57:20 -08:00
Krrish Dholakia	a7229c9253	fix(proxy_server.py): enable proxy /team/delete endpoint	2024-02-21 16:53:12 -08:00
Krrish Dholakia	dca9103b09	refactor(test_team.py): trigger new devrelease	2024-02-16 09:57:51 -08:00
Krrish Dholakia	faa7892b4c	test(test_team.py): trigger new build	2024-02-16 08:56:08 -08:00
Krrish Dholakia	3af2fb25be	test(test_team.py): adding testing for team endpoints	2024-02-16 08:55:21 -08:00
Krrish Dholakia	83d43809a7	fix(proxy_server.py): fix proxy server team id bug	2024-02-13 22:33:56 -08:00
Krrish Dholakia	4a0df3cb4f	fix(proxy_cli.py-&&-proxy_server.py): bump reset budget intervals and fix pool limits for prisma connections	2024-02-06 19:39:49 -08:00
Krrish Dholakia	b6adeec347	fix(proxy_server.py): prisma client fixes for high traffic	2024-02-06 17:30:36 -08:00
Krrish Dholakia	ef0171e063	feat(utils.py): support cost tracking for openai/azure image gen models	2024-02-03 17:09:54 -08:00
ishaan-jaff	419bddae93	(fix) show error in test_keys	2024-02-02 19:15:03 -08:00
Krrish Dholakia	bfe2faa454	test(test_keys.py): separate streaming key info test from normal completion key info test	2024-02-02 19:03:47 -08:00
ishaan-jaff	d7d1aa1266	(ci/cd) run again	2024-02-02 18:56:03 -08:00
Krrish Dholakia	92ebe132e8	test(test_keys.py): fix test	2024-01-31 11:26:49 -08:00
Krrish Dholakia	ecc6855e49	build(config.yml): add more logging for docker build and test	2024-01-31 10:58:25 -08:00
Krrish Dholakia	eea4325e60	test(test_keys.py): add more retries for checking if budget updated	2024-01-31 10:44:19 -08:00
Krrish Dholakia	a0022410fa	test(test_users.py): add more reattempts and delays	2024-01-31 10:05:35 -08:00
Krrish Dholakia	70d5f9ef96	test(test_keys.py): reorder tests	2024-01-31 09:37:37 -08:00
Krrish Dholakia	f9acad87dc	feat(proxy_server.py): enable cache controls per key + no-store cache flag	2024-01-30 20:46:50 -08:00
ishaan-jaff	6097102c21	(test) /health/readiness	2024-01-29 15:27:25 -08:00
ishaan-jaff	9c4d9c2f58	(test) /key/info	2024-01-26 19:26:55 -08:00