Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27487

Spark - Scala 2.12 compatibility

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Invalid
    • Affects Version/s: 2.4.1
    • Fix Version/s: None
    • Component/s: Build, Deploy
    • Labels:
      None
    • Environment:

      Scala 2.12.7, Hadoop 2.7.7, Spark 2.4.1.

      Description

      Hi, I've faced one interesting problem during the development. It's written that Spark 2.4.1 is compatible with Scala 2.12 (a minor version is not specified!). So I tried to deploy an application that was written on Scala 2.12.7 and I got a lot of serialization errors. Later I checked that Spark had been built on Scala 2.12.8 and I switched on it, and everything works well now. Isn't it an error that Spark 2.4.1 doesn't support other minor versions?

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              v.holubnychyi Vadym Holubnychyi
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: