[SPARK-27274] Refer to Scala 2.12 in docs; deprecate Scala 2.11 support in 2.4.1

• Type: Task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.4.1
• Component/s: Documentation, Spark Core
• Labels: release-notes
• Target Version/s: 2.4.1
• Assignee: Sean R. Owen
• Reporter: Sean R. Owen
• Created: 25/Mar/19 22:22
• Updated: 23/Apr/19 06:23
• Resolved: 26/Mar/19 00:06

Description

Scala 2.11 support is removed in Spark 3.0, so we should at least call it deprecated in 2.4.x.

The 2.4.x docs current refer to Scala 2.11 artifacts. As 2.12 has been supported since 2.4.0 without any significant issues, we should refer to 2.12 artifacts in the docs by default as well.

You could say this implicitly declares it 'unexperimental', if it ever was deemed experimental, as we'd certainly support 2.12 and not change that support for the foreseeable future.

Issue Links

• is related to: SPARK-27544 Fix Python test script to work on Scala-2.12 build
• links to: GitHub Pull Request #24210