3353 commits

Author	SHA1	Message	Date
Krrish Dholakia	f0f900d69e	fix(router.py): add reason for fallback failure to client-side exception string ... make it easier to debug why a fallback failed to occur	2024-08-07 13:02:47 -07:00
Ishaan Jaff	9a8fa9f047	emit deployment_partial_outage on prometheus	2024-08-07 09:56:01 -07:00
Krish Dholakia	c82fc0cac2	Merge branch 'main' into litellm_support_lakera_config_thresholds	2024-08-06 22:47:13 -07:00
Ishaan Jaff	ab920ab461	fix pass through endpoint tests	2024-08-06 21:16:07 -07:00
Ishaan Jaff	7173cef822	clean up unused func	2024-08-06 20:58:51 -07:00
Krrish Dholakia	2dd27a4e12	feat(utils.py): support validating json schema client-side if user opts in	2024-08-06 19:35:33 -07:00
Ishaan Jaff	a1c1ad60d2	fix forward ui requests when base url set	2024-08-06 18:10:34 -07:00
Ishaan Jaff	d08f59ae09	add redirect_ui_middleware	2024-08-06 18:01:23 -07:00
Ishaan Jaff	237c3a0244	Merge pull request #5077 from BerriAI/litellm_fix_ui_emails ... [Fix] Fix testing emails through Admin UI	2024-08-06 16:41:01 -07:00
Krrish Dholakia	907d83e5d9	fix(lakera_ai.py): fix hardcoded prompt_injection string in lakera integration	2024-08-06 16:12:54 -07:00
Ishaan Jaff	e5e5628fc8	update alerting settings on ui	2024-08-06 16:05:33 -07:00
Ishaan Jaff	206acaae9e	fix email health checks	2024-08-06 15:59:26 -07:00
Ishaan Jaff	7024fcacec	add debug statements on docker	2024-08-06 15:29:49 -07:00
Krrish Dholakia	0e222cf76b	feat(lakera_ai.py): support lakera custom thresholds + custom api base ... Allows user to configure thresholds to trigger prompt injection rejections	2024-08-06 15:21:45 -07:00
Krish Dholakia	a17593dafb	Merge pull request #5071 from BerriAI/litellm_auth_restricted_domains ... feat(proxy_server.py): allow restricting allowed email domains for UI	2024-08-06 14:18:57 -07:00
Krrish Dholakia	2abd4d5363	feat(proxy_server.py): allow restricting allowed email domains for the UI	2024-08-06 12:53:03 -07:00
Ishaan Jaff	645d3ae09d	Merge pull request #5062 from BerriAI/litellm_forward_headers ... [Fix-Proxy] allow forwarding headers from request	2024-08-06 12:34:25 -07:00
Krrish Dholakia	834b437eb4	fix(utils.py): fix types	2024-08-06 12:23:22 -07:00
Ishaan Jaff	c277a71c1e	init pass through endpoints	2024-08-06 12:04:04 -07:00
Krrish Dholakia	4d0c22f258	fix(encrypt_decrypt_utils.py): add helper line, explaining why there might be a key decryption error	2024-08-06 11:35:40 -07:00
Ishaan Jaff	bd1f323297	use helper to forward headers from request	2024-08-06 11:34:10 -07:00
Ishaan Jaff	1ef814dc97	use prints	2024-08-06 11:07:12 -07:00
Krish Dholakia	036a6821d5	Merge pull request #5057 from BerriAI/litellm_rds_iam_auth ... feat(proxy_cli.py): support iam-based auth to rds	2024-08-06 10:44:33 -07:00
Krrish Dholakia	511f4d33d1	feat(utils.py): check env var for api base for openai-compatible endpoints ... Closes https://github.com/BerriAI/litellm/issues/5066	2024-08-06 08:32:44 -07:00
Ishaan Jaff	d1b8c4e08d	forward headers from request	2024-08-05 21:45:44 -07:00
Krrish Dholakia	f2fe887e73	fix(rds_iam_token.py): support sts based auth	2024-08-05 21:01:17 -07:00
Ishaan Jaff	d91b1c93d1	use safe init_verbose_loggers	2024-08-05 20:56:48 -07:00
Krrish Dholakia	818a70838d	fix(user_api_key_auth.py): fix _get_user_role	2024-08-05 20:54:27 -07:00
Krish Dholakia	2f304c92e4	Merge pull request #5052 from BerriAI/litellm_stability_fixes ... fix: bump default allowed_fails + reduce default db pool limit	2024-08-05 20:54:23 -07:00
Ishaan Jaff	764b1ed869	Merge pull request #5058 from BerriAI/litellm_add_debug_statements_connecting_prisma ... Fix - add debug statements when connecting to prisma DB	2024-08-05 20:53:55 -07:00
Ishaan Jaff	da848696e3	Merge pull request #5059 from BerriAI/litelm_log_otel_args ... OTEL - Log DB queries / functions on OTEL	2024-08-05 20:51:11 -07:00
Ishaan Jaff	bec0350127	otel fix async_service_failure_hook	2024-08-05 20:18:40 -07:00
Ishaan Jaff	09105277cd	use otel callbacks	2024-08-05 20:00:06 -07:00
Ishaan Jaff	8dcea009b8	log event_metadata on otel service loggers	2024-08-05 19:58:55 -07:00
Krrish Dholakia	5c6dcd6029	test: improve debugging for test	2024-08-05 19:41:08 -07:00
Ishaan Jaff	8ec184b93f	add debugging utils to print when connecting to prisma	2024-08-05 19:19:28 -07:00
Ishaan Jaff	a5cd041ccf	add debug statements when connected to prisma db	2024-08-05 19:13:46 -07:00
Krrish Dholakia	1cc7c7fc59	feat(proxy_cli.py): support iam-based auth to rds ... Initial pr for iam-based auth support for rds	2024-08-05 17:35:48 -07:00
Ishaan Jaff	091449e81b	build ui on custom path	2024-08-05 16:34:37 -07:00
Ishaan Jaff	900e89c0ad	set PROXY_BASE_URL when server root path set	2024-08-05 15:48:44 -07:00
Krrish Dholakia	936640948d	fix: bump default allowed_fails + reduce default db pool limit ... Fixes issues with running proxy server in production	2024-08-05 15:07:46 -07:00
Ishaan Jaff	6d2063d1cb	fix get_request_route	2024-08-05 10:33:40 -07:00
Ishaan Jaff	aa7174c270	use get_request_route	2024-08-05 10:13:47 -07:00
Ishaan Jaff	13f01ed57f	add get_request_route	2024-08-05 10:12:34 -07:00
Krrish Dholakia	f610fba58f	fix(user_api_key_auth.py): handle older user_role's ... Fixes issue where older user_role's (e.g. app_user) weren't being recognized. + Adds testing for it	2024-08-05 08:57:06 -07:00
Krish Dholakia	bca71019ad	Merge branch 'main' into litellm_anthropic_api_streaming	2024-08-03 21:16:50 -07:00
Krish Dholakia	9ba8e3047f	Merge branch 'main' into litellm_loadbalancing_test	2024-08-03 20:29:54 -07:00
Krrish Dholakia	ac6c39c283	feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint ... Fixes https://github.com/BerriAI/litellm/issues/5011	2024-08-03 20:16:19 -07:00
Ishaan Jaff	e73eb19678	docs default vertex	2024-08-03 18:09:48 -07:00
Ishaan Jaff	c8438715af	add vertex ai countTokens endpoint	2024-08-03 17:34:10 -07:00