[SPARK-29066] Remove old Jenkins jobs for EOL versions or obsolete combinations

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Project Infra
• Assignee: Shane Knapp
• Reporter: Dongjoon Hyun
• Created: 12/Sep/19 07:17
• Updated: 22/Jan/20 22:00
• Resolved: 12/Sep/19 18:52

Description

This issue aims to remove the old Jenkins jobs for EOL versions (1.6 ~ 2.3) and some obsolete combinations.

1. https://amplab.cs.berkeley.edu/jenkins/view/Spark%20Packaging/
2. https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Compile/ (Here, `spark-master-compile-maven-hadoop-2.6` is an invalid combination.)
3. https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test/
4. https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/
5. https://amplab.cs.berkeley.edu/jenkins/view/spark%20k8s%20builds/

For 1~3, we need additional scroll-down in laptop environments. It's inconvenient.

This cleanup will make us more room when we add `branch-3.0` later.

Issue Links

• is duplicated by: SPARK-26731 remove EOLed spark jobs from jenkins