1851 commits

Author	SHA1	Message	Date
ishaan-jaff	2130a61b6e	(feat) add cache_key in spend_log	2024-01-24 17:56:00 -08:00
Krrish Dholakia	f148094d18	test(test_key_generate_prisma.py): add unit testing for global proxy budget	2024-01-24 17:43:01 -08:00
Ishaan Jaff	f76620b1d1	Merge branch 'main' into litellm_spend_per_user	2024-01-24 12:24:15 -08:00
ishaan-jaff	d812ae7e9a	(test) spend_user_fn, spend_key_fn	2024-01-24 12:09:16 -08:00
ishaan-jaff	1872122bfb	(test) streaming spend logs test - actually run this	2024-01-24 11:27:27 -08:00
ishaan-jaff	3e53742a4f	(test) model in SpendLogs table	2024-01-24 11:10:13 -08:00
ishaan-jaff	a842e6520c	(test) setting model in SpendTable logs	2024-01-24 11:09:20 -08:00
ishaan-jaff	5e8a6fd80e	(test) writing spend logs table	2024-01-24 10:56:11 -08:00
ishaan-jaff	b0902f0a8c	(ci/cd) add more logging to timeout test	2024-01-23 18:39:19 -08:00
ishaan-jaff	b3ce0ac728	(test) proxy_custom_auth use new exceptions	2024-01-23 17:36:13 -08:00
ishaan-jaff	d2675a1ff3	(test) switch dynamodb test to use new exceptions	2024-01-23 17:34:18 -08:00
ishaan-jaff	37dd1114f2	(test) update prisma test	2024-01-23 17:30:01 -08:00
Ishaan Jaff	5702be1601	Merge pull request #1572 from BerriAI/litellm_use_same_response_id_across_chunks ... [Fix] Streaming - Use same `response_id` across chunks	2024-01-23 14:40:50 -08:00
ishaan-jaff	b40176810e	(test) dynamic timeouts - router	2024-01-23 13:27:49 -08:00
ishaan-jaff	64a387d09b	(test) test chunk_ids match across chunks for bedrock	2024-01-23 13:06:05 -08:00
ishaan-jaff	d455833dfb	(test) same response id across chunks	2024-01-23 12:57:04 -08:00
Krrish Dholakia	05754ef238	test(test_router.py): add more testing for dynamically passing params to router	2024-01-23 10:31:49 -08:00
ishaan-jaff	6c1f8378c1	(test) fix sagemaker stream test	2024-01-23 10:07:13 -08:00
ishaan-jaff	3f37cf0bec	(test) router.py revert to stable version	2024-01-23 09:05:19 -08:00
ishaan-jaff	d5b1cc7150	(ci/cd) run prisma.connect() before test	2024-01-23 08:36:49 -08:00
ishaan-jaff	5ad0971c5a	(test) fix incorrect test lol	2024-01-23 08:21:14 -08:00
Krrish Dholakia	fd4d65adcd	fix(__init__.py): enable logging.debug to true if set verbose is true	2024-01-23 07:32:30 -08:00
Krrish Dholakia	ca5fb3f7f1	test(test_router.py): fix test check	2024-01-23 07:07:30 -08:00
Krrish Dholakia	502f8b478c	test(test_exceptions.py): fix test name	2024-01-23 06:57:18 -08:00
Krrish Dholakia	23b59ac9b8	fix(utils.py): fix content policy violation check for streaming	2024-01-23 06:55:04 -08:00
Krrish Dholakia	53b879bc6c	fix(router.py): ensure no unsupported args are passed to completion()	2024-01-22 22:33:06 -08:00
Krrish Dholakia	f19f0dad89	fix(router.py): fix client init	2024-01-22 22:15:39 -08:00
Ishaan Jaff	6d105754d7	Merge pull request #1561 from BerriAI/litellm_sagemaker_streaming ... [Feat] Add REAL Sagemaker streaming	2024-01-22 22:10:20 -08:00
ishaan-jaff	bccbb0852d	(test) test_completion_sagemaker_stream	2024-01-22 21:57:26 -08:00
Krrish Dholakia	fe489ec22b	test(test_key_generate_dynamodb.py): fix test	2024-01-22 21:45:30 -08:00
Krrish Dholakia	4babd67c79	test(test_key_generate_dynamodb.py): fix test	2024-01-22 21:44:13 -08:00
Krrish Dholakia	7079b951de	test(test_key_generate_prisma.py): fix test	2024-01-22 21:12:03 -08:00
Krish Dholakia	bedb08bdef	Merge pull request #1557 from BerriAI/litellm_emit_spend_logs ... feat(utils.py): emit response cost as part of logs	2024-01-22 21:02:40 -08:00
Krrish Dholakia	42a2a2fe94	test(test_custom_callback_input.py): fix assert	2024-01-22 20:39:14 -08:00
Krrish Dholakia	11e3ee4411	test: fix tests	2024-01-22 20:20:17 -08:00
Krrish Dholakia	3e8c8ef507	fix(openai.py): fix linting issue	2024-01-22 18:20:15 -08:00
ishaan-jaff	c9e5e07a96	(chore) fix merge conflicts	2024-01-22 15:53:12 -08:00
Krrish Dholakia	e917d0eee6	feat(utils.py): emit response cost as part of logs	2024-01-22 15:53:04 -08:00
Ishaan Jaff	db68774d60	Merge branch 'main' into litellm_budget_per_key	2024-01-22 15:49:57 -08:00
Krrish Dholakia	25311293e4	fix(utils.py): fix sync/async stream logging	2024-01-22 15:15:34 -08:00
Krrish Dholakia	39a1b4c3b5	fix(main.py): support custom pricing for embedding calls	2024-01-22 15:15:34 -08:00
Krrish Dholakia	276a685a59	feat(utils.py): support custom cost tracking per second ... https://github.com/BerriAI/litellm/issues/1374	2024-01-22 15:15:34 -08:00
Ishaan Jaff	6f8a6e1dae	Merge pull request #1555 from BerriAI/litellm_fix_router_tracking_tpm_rpm_with_fallbacks ... [Fix] Router - Usage Based Routing with fallbacks (Track the correct tpm/rpm)	2024-01-22 14:45:49 -08:00
ishaan-jaff	5807718a69	(test) usage based routing with fallbacks	2024-01-22 14:21:30 -08:00
Ishaan Jaff	5700d60e1a	Merge pull request #1538 from BerriAI/litellm_use_custom_key_gen ... [Feat] Proxy Auth - Use custom_key_generate	2024-01-22 14:21:19 -08:00
ishaan-jaff	8e41ec96b3	(test) dynamoDB Budgets per key	2024-01-22 12:54:37 -08:00
ishaan-jaff	152456e10d	(test) test_call_with_key_over_budget_stream	2024-01-22 12:16:16 -08:00
ishaan-jaff	e846b8fca8	(test) ExceededTokenBudget	2024-01-22 12:13:41 -08:00
ishaan-jaff	de1502658d	(test) budgets per key	2024-01-22 11:58:55 -08:00
ishaan-jaff	9988a39169	(ci/cd) deploy again	2024-01-22 08:25:17 -08:00