1626 commits

Author	SHA1	Message	Date
ishaan-jaff	35adab5ed6	(test) fix custom_auth test to be OpenAI compatible	2024-01-23 14:31:12 -08:00
ishaan-jaff	a05b64cb8c	(fix) move test_key_gen to use e.message not e.detail	2024-01-23 14:04:42 -08:00
ishaan-jaff	cedeb1ffbe	(test) dynamic timeouts - router	2024-01-23 13:47:37 -08:00
Krrish Dholakia	c9fd46e07e	test(test_router.py): add more testing for dynamically passing params to router	2024-01-23 13:47:37 -08:00
ishaan-jaff	e6c8a5cd79	(test) fix sagemaker stream test	2024-01-23 13:47:37 -08:00
ishaan-jaff	a7794d2e6e	(test) router.py revert to stable version	2024-01-23 13:47:37 -08:00
ishaan-jaff	bb7c0ec0ed	(ci/cd) run prisma.connect() before test	2024-01-23 13:47:37 -08:00
ishaan-jaff	5bd10e303a	(test) fix incorrect test lol	2024-01-23 13:47:37 -08:00
Krrish Dholakia	947ddf1dd7	fix(__init__.py): enable logging.debug to true if set verbose is true	2024-01-23 13:47:37 -08:00
Krrish Dholakia	503fca88d4	test(test_router.py): fix test check	2024-01-23 13:47:37 -08:00
Krrish Dholakia	373a627f54	test(test_exceptions.py): fix test name	2024-01-23 13:47:37 -08:00
Krrish Dholakia	572346fabe	fix(utils.py): fix content policy violation check for streaming	2024-01-23 13:47:37 -08:00
Krrish Dholakia	93866b8cd5	fix(router.py): ensure no unsupported args are passed to completion()	2024-01-23 13:47:37 -08:00
Krrish Dholakia	eb46ea8f8b	fix(router.py): fix client init	2024-01-23 13:47:37 -08:00
ishaan-jaff	e7e8e7cf95	(test) test_completion_sagemaker_stream	2024-01-23 13:47:37 -08:00
Krrish Dholakia	b6a6942867	test(test_key_generate_dynamodb.py): fix test	2024-01-23 13:47:37 -08:00
Krrish Dholakia	1e381be998	test(test_key_generate_dynamodb.py): fix test	2024-01-23 13:47:37 -08:00
Krrish Dholakia	7f27026f87	test(test_key_generate_prisma.py): fix test	2024-01-23 13:47:37 -08:00
Krrish Dholakia	4ab99adaa2	test(test_custom_callback_input.py): fix assert	2024-01-23 13:47:37 -08:00
Krrish Dholakia	616fe11145	test: fix tests	2024-01-23 13:47:37 -08:00
Krrish Dholakia	d57e57234e	fix(openai.py): fix linting issue	2024-01-23 13:47:37 -08:00
Krrish Dholakia	e4fda7c840	feat(utils.py): emit response cost as part of logs	2024-01-23 13:47:37 -08:00
ishaan-jaff	f31838e983	(chore) fix merge conflicts	2024-01-23 13:47:37 -08:00
ishaan-jaff	c1ccf3025a	(test) dynamoDB Budgets per key	2024-01-23 13:47:21 -08:00
ishaan-jaff	3c32dfd344	(test) test_call_with_key_over_budget_stream	2024-01-23 13:47:21 -08:00
ishaan-jaff	be2ec980d7	(test) ExceededTokenBudget	2024-01-23 13:47:21 -08:00
ishaan-jaff	c1d8b93289	(test) budgets per key	2024-01-23 13:47:21 -08:00
ishaan-jaff	9cbc388bd9	(test) auth errors - OpenAI compatible	2024-01-22 16:24:59 -08:00
Krrish Dholakia	25311293e4	fix(utils.py): fix sync/async stream logging	2024-01-22 15:15:34 -08:00
Krrish Dholakia	39a1b4c3b5	fix(main.py): support custom pricing for embedding calls	2024-01-22 15:15:34 -08:00
Krrish Dholakia	276a685a59	feat(utils.py): support custom cost tracking per second ... https://github.com/BerriAI/litellm/issues/1374	2024-01-22 15:15:34 -08:00
Ishaan Jaff	6f8a6e1dae	Merge pull request #1555 from BerriAI/litellm_fix_router_tracking_tpm_rpm_with_fallbacks ... [Fix] Router - Usage Based Routing with fallbacks (Track the correct tpm/rpm)	2024-01-22 14:45:49 -08:00
ishaan-jaff	5807718a69	(test) usage based routing with fallbacks	2024-01-22 14:21:30 -08:00
Ishaan Jaff	5700d60e1a	Merge pull request #1538 from BerriAI/litellm_use_custom_key_gen ... [Feat] Proxy Auth - Use custom_key_generate	2024-01-22 14:21:19 -08:00
ishaan-jaff	9988a39169	(ci/cd) deploy again	2024-01-22 08:25:17 -08:00
ishaan-jaff	ccfcc39681	(test) custom key/generate	2024-01-20 10:13:32 -08:00
ishaan-jaff	480f237fb5	(test) add custom_key_generate test	2024-01-20 09:59:04 -08:00
Ishaan Jaff	435d4b9279	Merge pull request #1534 from BerriAI/litellm_custom_cooldown_times ... [Feat] Litellm.Router set custom cooldown times	2024-01-19 20:49:17 -08:00
ishaan-jaff	ccbc47122c	(fix) test caching	2024-01-19 20:45:10 -08:00
ishaan-jaff	84684c50fa	(fix) router - timeout exception mapping	2024-01-19 20:30:41 -08:00
Krrish Dholakia	b07677c6be	fix(gemini.py): support streaming	2024-01-19 20:21:34 -08:00
ishaan-jaff	0fa9d8af82	(test) custom cooldown times - router	2024-01-19 19:41:52 -08:00
Krrish Dholakia	1be4f7d2d1	fix(test_key_generate_prisma.py): fix testing ... n	2024-01-19 16:53:46 -08:00
ishaan-jaff	6bc7cc46b4	(docs) router debugging	2024-01-19 15:18:00 -08:00
Ishaan Jaff	73684bc93f	Merge pull request #1525 from BerriAI/litellm_router_improvements ... [Feat] Router improvements	2024-01-19 15:02:05 -08:00
ishaan-jaff	8a4f2c198b	(test) test_usage_based_routing	2024-01-19 14:59:56 -08:00
Krrish Dholakia	f5ced089d6	test(tests/): add unit testing for proxy server endpoints	2024-01-19 14:54:29 -08:00
ishaan-jaff	f408162449	(test) debug logs test - router	2024-01-19 14:22:18 -08:00
ishaan-jaff	0196ac6376	(test) router-fallbacks	2024-01-19 14:12:09 -08:00
ishaan-jaff	57a20100e4	(test) usage based routing	2024-01-19 13:58:08 -08:00