[SPARK-6305] Add support for log4j 2.x to Spark

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: Build
• Assignee: L. C. Hsieh
• Reporter: Tal Sliwowicz
• Created: 12/Mar/15 12:57
• Updated: 19/May/22 04:54
• Resolved: 18/Dec/21 05:41

Description

log4j 2 requires replacing the slf4j binding and adding the log4j jars in the classpath. Since there are shaded jars, it must be done during the build.

Issue Links

• is depended upon by: LOG4J2-1479 Help Apache Spark project to upgrade from Log4j 1.x to 2.x
• is duplicated by: SPARK-37630 Security issue from Log4j 1.X exploit
• is duplicated by: SPARK-39009 Spark Log4j vul - CVE-2021-44228
• is duplicated by: SPARK-37625 update log4j to 2.15
• is related to: SPARK-37630 Security issue from Log4j 1.X exploit
• is related to: SPARK-2646 log4j initialization not quite compatible with log4j 2.x
• is related to: SPARK-16416 Logging in shutdown hook does not work properly with Log4j 2.x
• is related to: SPARK-37625 update log4j to 2.15
• is related to: SPARK-4147 Reduce log4j dependency
• relates to: SPARK-37684 Upgrade log4j to 2.17
• relates to: SPARK-37685 Make log event immutable for LogAppender
• relates to: ZOOKEEPER-2342 Migrate to Log4J 2.
• relates to: HADOOP-12956 Inevitable Log4j2 migration via slf4j
• relates to: SPARK-26888 Upgrade to Log4j 2.x
• relates to: SPARK-37733 Change log level of tests to WARN
• links to: [Github] Pull Request #4998 (liorchaga)
• links to: [Github] Pull Request #34895 (viirya)
• links to: [Github] Pull Request #34941 (viirya)
• links to: [Github] Pull Request #34959 (viirya)
• links to: [Github] Pull Request #34965 (viirya)