[SPARK-32353] Update docker/spark-test and clean up unused stuff

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.0.1, 3.1.0
• Component/s: Tests
• Assignee: William Hyun
• Reporter: William Hyun
• Created: 17/Jul/20 18:49
• Updated: 17/Jul/20 19:06
• Resolved: 17/Jul/20 19:06

Description

This issue aims to update the docker/spark-test and clean up unused stuff.
Since Spark 3.0.0, Java 11 is supported. We had better use the latest Java and OS.

Issue Links

• links to: [Github] Pull Request #29150 (williamhyun)
• links to: [Github] Pull Request #29150 (williamhyun)