[SPARK-33772] Build and Run Spark on Java 17

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: Build
• Labels: releasenotes
• Target Version/s: 3.3.0
• Assignee: Yang Jie
• Reporter: Dongjoon Hyun
• Created: 14/Dec/20 01:39
• Updated: 05/Jan/23 07:20
• Resolved: 11/Nov/21 17:01

Description

Apache Spark supports Java 8 and Java 11 (LTS). The next Java LTS version is 17.

Version	Release Date
Java 17 (LTS)	September 2021

Apache Spark has a release plan and `Spark 3.2 Code freeze` was July along with the release branch cut.

• https://spark.apache.org/versioning-policy.html

Supporting new Java version is considered as a new feature which we cannot allow to backport.

Issue Links

• is related to: SPARK-35781 Support Spark on Apple Silicon on macOS natively on Java 17
• is related to: SPARK-38396 Improve K8s Integration Tests
• is required by: BEAM-12240 Make Beam compatible with next Java LTS version (Java 17)
• relates to: HADOOP-17177 Java 17 support