Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25075

Build and test Spark against Scala 2.13

    XMLWordPrintableJSON

    Details

    • Type: Umbrella
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0
    • Fix Version/s: None
    • Component/s: Build, MLlib, Project Infra, Spark Core, SQL
    • Labels:
      None
    • Target Version/s:

      Description

      This umbrella JIRA tracks the requirements for building and testing Spark against the current Scala 2.13 milestone.

        Attachments

        1.
        		 Use scala-xml explicitly Sub-task Resolved Unassigned
        2.
        		 Remove usage of Traversable Sub-task Resolved Sean R. Owen
        3.
        		 Avoid use of Scala collection classes that are removed in 2.13 Sub-task Resolved Sean R. Owen
        4.
        		 Remove usage of TraversableOnce Sub-task Open Sean R. Owen
        5.
        		 Upgrade breeze to 1.0 Sub-task Resolved Sean R. Owen
        6.
        		 Update scalatest, scalacheck, scopt, scala-parser-combinators, clapper classutil Sub-task Resolved Sean R. Owen
        7.
        		 Update twitter chill for 2.13 when available, or remove it Sub-task Open Sean R. Owen
        8.
        		 Remove use of procedure-like method definition for 2.13 Sub-task Resolved Sean R. Owen
        9.
        		 Fix internal usages of mutable collection for Seq in 2.13 Sub-task Open Sean R. Owen
        10.
        		 Move scalafmt to Scala 2.12 profile; bump to 0.12 Sub-task Resolved Sean R. Owen
        11.
        		 Update Kafka to a verison that supports Scala 2.13 Sub-task Open Unassigned
        12.
        		 Use scala-parallel-collections library in 2.13 Sub-task Resolved Sean R. Owen
        13.
        		 Remove use of deprecated symbol literal " 'name " syntax in favor Symbol("name") Sub-task Resolved Sean R. Owen
        14.
        		 Replace ambiguous varargs call parallelize(Array) with parallelize(Seq) Sub-task Resolved Sean R. Owen
        15.
        		 Remove use of Unit companion object in favor of () Sub-task Resolved Sean R. Owen
        16.
        		 Remove use of TraversableLike Sub-task Resolved Sean R. Owen
        17.
        		 Replace Array.deep comparisons with Array.sameElements Sub-task Resolved Sean R. Owen
        18.
        		 Upgrade scala-maven-plugin to 4.3.0 for Scala 2.13.1 Sub-task Resolved Dongjoon Hyun
        19.
        		 Replace Ordering.Double with Ordering.Double.TotalOrdering Sub-task Resolved Sean R. Owen
        20.
        		 Remove deprecated SparkConf.setAll(Traversable) Sub-task Open Unassigned
        21.
        		 Use DoubleAsIfIntegral / FloatAsIfIntegral workalike in 2.13 Sub-task Resolved Sean R. Owen
        22.
        		 Change classes extending scala collection classes to work with 2.13 Sub-task Resolved Sean R. Owen
        23.
        		 No parens for calls to BigDecimal.longValue() etc. Sub-task Resolved Sean R. Owen
        24.
        		 Update REPL for 2.13 Sub-task Open Unassigned
        25.
        		 Scala 2.13 compile errors from Hadoop LocalFileSystem subclasses Sub-task Open Unassigned
        26.
        		 Resolve ambiguous overload from RegexParsers in 2.13 Sub-task Resolved Sean R. Owen
        27.
        		 Resolve Array + reference type compile problems in 2.13, with sc.parallelize Sub-task Resolved Sean R. Owen
        28.
        		 Some imports, function need more explicit resolution in 2.13 Sub-task Resolved Sean R. Owen

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              MasseGuillaume Guillaume Massé
              Shepherd:
              Sean R. Owen
            • Votes:
              4 Vote for this issue
              Watchers:
              23 Start watching this issue

              Dates

              • Created:
                Updated: