3426 commits

Author	SHA1	Message	Date
ishaan-jaff	35adab5ed6	(test) fix custom_auth test to be OpenAI compatible	2024-01-23 14:31:12 -08:00
ishaan-jaff	a05b64cb8c	(fix) move test_key_gen to use e.message not e.detail	2024-01-23 14:04:42 -08:00
ishaan-jaff	f0e17a4322	(fix) raise ProxyException	2024-01-23 13:59:35 -08:00
ishaan-jaff	cedeb1ffbe	(test) dynamic timeouts - router	2024-01-23 13:47:37 -08:00
ishaan-jaff	47648fa37b	(fix) sagemaker streaming support	2024-01-23 13:47:37 -08:00
ishaan-jaff	d2fa9ac4c3	(fix) select_data_generator	2024-01-23 13:47:37 -08:00
ishaan-jaff	00d18cbc86	(fix) select_data_generator - sagemaker	2024-01-23 13:47:37 -08:00
ishaan-jaff	67dddc94d9	(fix) proxy - streaming sagemaker	2024-01-23 13:47:37 -08:00
Krrish Dholakia	c9fd46e07e	test(test_router.py): add more testing for dynamically passing params to router	2024-01-23 13:47:37 -08:00
ishaan-jaff	e6c8a5cd79	(test) fix sagemaker stream test	2024-01-23 13:47:37 -08:00
ishaan-jaff	a7794d2e6e	(test) router.py revert to stable version	2024-01-23 13:47:37 -08:00
ishaan-jaff	bb7c0ec0ed	(ci/cd) run prisma.connect() before test	2024-01-23 13:47:37 -08:00
ishaan-jaff	5bd10e303a	(test) fix incorrect test lol	2024-01-23 13:47:37 -08:00
Ishaan Jaff	2fdd41ac1e	Merge pull request #1534 from BerriAI/litellm_custom_cooldown_times ... [Feat] Litellm.Router set custom cooldown times	2024-01-23 13:47:37 -08:00
ishaan-jaff	ea94011952	(fix) router - update model_group on fallback	2024-01-23 13:47:37 -08:00
ishaan-jaff	3692d7ffa4	(fix) revert router.py to stable version	2024-01-23 13:47:37 -08:00
ishaan-jaff	69530ffb70	Revert "(feat) add typehints for litellm.acompletion" ... This reverts commit a9cf6cec80.	2024-01-23 13:47:37 -08:00
ishaan-jaff	9192712841	Revert "v0" ... This reverts commit b730482aaf.	2024-01-23 13:47:37 -08:00
Krrish Dholakia	947ddf1dd7	fix(__init__.py): enable logging.debug to true if set verbose is true	2024-01-23 13:47:37 -08:00
Krrish Dholakia	0783bd1785	fix(router.py): fix dereferencing param order	2024-01-23 13:47:37 -08:00
Krrish Dholakia	503fca88d4	test(test_router.py): fix test check	2024-01-23 13:47:37 -08:00
Krrish Dholakia	373a627f54	test(test_exceptions.py): fix test name	2024-01-23 13:47:37 -08:00
Krrish Dholakia	572346fabe	fix(utils.py): fix content policy violation check for streaming	2024-01-23 13:47:37 -08:00
Krrish Dholakia	93866b8cd5	fix(router.py): ensure no unsupported args are passed to completion()	2024-01-23 13:47:37 -08:00
Krrish Dholakia	eb46ea8f8b	fix(router.py): fix client init	2024-01-23 13:47:37 -08:00
ishaan-jaff	278cc75603	(docs) use proxy + Sagemaker stream test	2024-01-23 13:47:37 -08:00
ishaan-jaff	e7e8e7cf95	(test) test_completion_sagemaker_stream	2024-01-23 13:47:37 -08:00
ishaan-jaff	85c16e1c32	v0 sagemaker_stream	2024-01-23 13:47:37 -08:00
ishaan-jaff	3ee672c35f	(v0) sagemaker streaming	2024-01-23 13:47:37 -08:00
ishaan-jaff	998094d38d	v0 add TokenIterator, stream support	2024-01-23 13:47:37 -08:00
Krrish Dholakia	b6a6942867	test(test_key_generate_dynamodb.py): fix test	2024-01-23 13:47:37 -08:00
Krrish Dholakia	1e381be998	test(test_key_generate_dynamodb.py): fix test	2024-01-23 13:47:37 -08:00
Krrish Dholakia	b78b99c8a0	fix(router.py): fix order of dereferenced dictionaries	2024-01-23 13:47:37 -08:00
Krrish Dholakia	7f27026f87	test(test_key_generate_prisma.py): fix test	2024-01-23 13:47:37 -08:00
Krrish Dholakia	4ab99adaa2	test(test_custom_callback_input.py): fix assert	2024-01-23 13:47:37 -08:00
Krrish Dholakia	616fe11145	test: fix tests	2024-01-23 13:47:37 -08:00
Krrish Dholakia	d57e57234e	fix(openai.py): fix linting issue	2024-01-23 13:47:37 -08:00
Krrish Dholakia	e4fda7c840	feat(utils.py): emit response cost as part of logs	2024-01-23 13:47:37 -08:00
Krrish Dholakia	32a62ac0e9	refactor(__init__.py): adds init.py file in tokenizers	2024-01-23 13:47:37 -08:00
Krrish Dholakia	3234f19ad4	fix(utils.py): move from pkg_resources to importlib	2024-01-23 13:47:37 -08:00
ishaan-jaff	f31838e983	(chore) fix merge conflicts	2024-01-23 13:47:37 -08:00
ishaan-jaff	b0e642d3d9	(fix) spend tracking per key - when no cache hit	2024-01-23 13:47:21 -08:00
ishaan-jaff	c1ccf3025a	(test) dynamoDB Budgets per key	2024-01-23 13:47:21 -08:00
ishaan-jaff	10060bf051	(fix) dynamo max_budget per key	2024-01-23 13:47:21 -08:00
ishaan-jaff	8d3c30b01f	(fix) make max_budget optional for LiteLLM_VerificationToken	2024-01-23 13:47:21 -08:00
ishaan-jaff	3c32dfd344	(test) test_call_with_key_over_budget_stream	2024-01-23 13:47:21 -08:00
ishaan-jaff	be2ec980d7	(test) ExceededTokenBudget	2024-01-23 13:47:21 -08:00
ishaan-jaff	2539ed9b0a	(feat) working budgets per key	2024-01-23 13:47:21 -08:00
ishaan-jaff	c1d8b93289	(test) budgets per key	2024-01-23 13:47:21 -08:00
ishaan-jaff	1640a9d58e	(feat) working create budgets per key	2024-01-23 13:47:21 -08:00