[SPARK-28114] Add Jenkins job for `Hadoop-3.2` profile

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Component/s: Project Infra
• Assignee: Shane Knapp
• Reporter: Dongjoon Hyun
• Created: 19/Jun/19 22:38
• Updated: 28/Jun/19 17:42
• Resolved: 24/Jun/19 18:28

Description

Spark 3.0 is a major version change. We want to have the following new Jobs.

1. SBT with hadoop-3.2
2. Maven with hadoop-3.2 (on JDK8 and JDK11)

Also, shall we have a limit for the concurrent run for the following existing job? Currently, it invokes multiple jobs concurrently. We can save the resource by limiting to 1 like the other jobs.

• https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-2.7-jdk-11-ubuntu-testing

We will drop four `branch-2.3` jobs at the end of August, 2019.