Details

    • Type: Task
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.1.0
    • Fix Version/s: 2.3.0
    • Component/s: ML, Spark Core, SQL
    • Labels:
      None
    • Target Version/s:

      Description

      This tracks the removal of Scala 2.10 support, as discussed in http://apache-spark-developers-list.1001551.n3.nabble.com/Straw-poll-dropping-support-for-things-like-Scala-2-10-td19553.html and other lists.

      The primary motivations are to simplify the code and build, and to enable Scala 2.12 support later.

        Issue Links

          Activity

          Hide
          apachespark Apache Spark added a comment -

          User 'srowen' has created a pull request for this issue:
          https://github.com/apache/spark/pull/17150

          Show
          apachespark Apache Spark added a comment - User 'srowen' has created a pull request for this issue: https://github.com/apache/spark/pull/17150
          Hide
          mshen Min Shen added a comment -

          Sean Owen,

          Want to get an idea regarding the timeline for removing Scala 2.10.
          We have heavy usage of Spark at LinkedIn, and we are right now still deploying Spark built with Scala 2.10 due to various dependencies on other systems we have which still rely on Scala 2.10.
          While we also have plans to upgrade our various internal systems to start using Scala 2.11, it will take a while for that to happen.
          In the mean time, if support for Scala 2.10 is removed in Spark 2.2, this is going to potentially block us from upgrading to Spark 2.2+ while we haven't fully moved off Scala 2.10 yet.
          Want to raise this concern here and also to understand the timeline for removing Scala 2.10 in Spark.

          Show
          mshen Min Shen added a comment - Sean Owen , Want to get an idea regarding the timeline for removing Scala 2.10. We have heavy usage of Spark at LinkedIn, and we are right now still deploying Spark built with Scala 2.10 due to various dependencies on other systems we have which still rely on Scala 2.10. While we also have plans to upgrade our various internal systems to start using Scala 2.11, it will take a while for that to happen. In the mean time, if support for Scala 2.10 is removed in Spark 2.2, this is going to potentially block us from upgrading to Spark 2.2+ while we haven't fully moved off Scala 2.10 yet. Want to raise this concern here and also to understand the timeline for removing Scala 2.10 in Spark.
          Hide
          srowen Sean Owen added a comment -

          Per discussion yesterday and the Target here it is currently targeted for 2.3.0.

          You can stay on maintenance releases of a version of you must not update to later version. In that sense 2.10 would be supported as long as 2.2.x is supported. That will be the end of the year or so, I imagine, even if 2.3 is out before then.

          Show
          srowen Sean Owen added a comment - Per discussion yesterday and the Target here it is currently targeted for 2.3.0. You can stay on maintenance releases of a version of you must not update to later version. In that sense 2.10 would be supported as long as 2.2.x is supported. That will be the end of the year or so, I imagine, even if 2.3 is out before then.
          Hide
          cloud_fan Wenchen Fan added a comment -

          Issue resolved by pull request 17150
          https://github.com/apache/spark/pull/17150

          Show
          cloud_fan Wenchen Fan added a comment - Issue resolved by pull request 17150 https://github.com/apache/spark/pull/17150
          Hide
          apachespark Apache Spark added a comment -

          User 'srowen' has created a pull request for this issue:
          https://github.com/apache/spark/pull/18646

          Show
          apachespark Apache Spark added a comment - User 'srowen' has created a pull request for this issue: https://github.com/apache/spark/pull/18646
          Hide
          apachespark Apache Spark added a comment -

          User 'srowen' has created a pull request for this issue:
          https://github.com/apache/spark/pull/18703

          Show
          apachespark Apache Spark added a comment - User 'srowen' has created a pull request for this issue: https://github.com/apache/spark/pull/18703

            People

            • Assignee:
              srowen Sean Owen
              Reporter:
              srowen Sean Owen
            • Votes:
              7 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development