[SPARK-27487] Spark - Scala 2.12 compatibility

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.4.1
• Component/s: Build, Deploy

Environment

Scala 2.12.7, Hadoop 2.7.7, Spark 2.4.1.

• Assignee: Unassigned
• Reporter: Vadym Holubnychyi
• Created: 17/Apr/19 10:52
• Updated: 12/Dec/22 18:11
• Resolved: 19/Apr/19 11:42

Description

Hi, I've faced one interesting problem during the development. It's written that Spark 2.4.1 is compatible with Scala 2.12 (a minor version is not specified!). So I tried to deploy an application that was written on Scala 2.12.7 and I got a lot of serialization errors. Later I checked that Spark had been built on Scala 2.12.8 and I switched on it, and everything works well now. Isn't it an error that Spark 2.4.1 doesn't support other minor versions?