[SPARK-29250] Upgrade to Hadoop 3.3.1

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: Build
• Labels: releasenotes
• Target Version/s: 3.2.0
• Assignee: Chao Sun
• Reporter: Dongjoon Hyun
• Created: 25/Sep/19 23:24
• Updated: 13/Jun/22 17:59
• Resolved: 16/Jun/21 20:28

Issue Links

• is blocked by: HADOOP-17324 Don't relocate org.bouncycastle in shaded client jars
• is blocked by: SPARK-30272 Remove usage of Guava that breaks in Guava 27
• is related to: SPARK-35868 Add fs.s3a.downgrade.syncable.exceptions if not set
• is related to: SPARK-35878 add fs.s3a.endpoint if unset and fs.s3a.endpoint.region is null
• is related to: SPARK-31644 Make Spark's guava version configurable from the maven command line.
• relates to: SPARK-37600 Upgrade to Hadoop 3.3.2
• requires: SPARK-33212 Upgrade to Hadoop 3.2.2 and move to shaded clients for Hadoop 3.x profile
• links to: [Github] Pull Request #29843 (sunchao)
• links to: [Github] Pull Request #29843 (sunchao)
• links to: [Github] Pull Request #30135 (sunchao)
• links to: GitHub Pull Request #25932
• links to: GitHub Pull Request #27009