[KUDU-2104] Upgrade to Spark 2.2.0

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.5.0
• Component/s: java
• Target Version/s: 1.5.0
• Assignee: Grant Henke
• Reporter: Grant Henke
• Created: 18/Aug/17 17:28
• Updated: 26/Aug/17 15:58
• Resolved: 26/Aug/17 15:58

Description

We should upgrade to Spark 2.2.0 to stay current. However, Spark 2.2 has dropped support for Java 7. (See more details in the release notes here and the jira SPARK-19493)

As discussed on the dev mailing list (here) we should upgrade and document that the Spark 2 modules require JDK 8. Additionally we will need to use JDK 8 when running the Jenkins build.