[PIG-5456] Upgrade Spark to 3.4.3

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.19.0
• Component/s: spark
• Hadoop Flags: Reviewed
• Assignee: Koji Noguchi
• Reporter: Koji Noguchi
• Created: 08/Jul/24 21:01
• Updated: 25/Sep/24 20:22
• Resolved: 25/Sep/24 20:10

Description

Major blocker for upgrading to Spark 3.4.3 was Spark started using log4j2. 
Simple upgrade failing a lot of tests with  

java.lang.VerifyError: class org.apache.log4j.bridge.LogEventAdapter overrides final method getTimeStamp.()J