Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25075 Build and test Spark against Scala 2.13
  3. SPARK-30012

Change classes extending scala collection classes to work with 2.13

Attach filesAttach ScreenshotVotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • Spark Core, SQL
    • None

    Description

      Several classes in the code base extend Scala collection classes, like:

      • ExternalAppendOnlyMap
      • CaseInsensitiveMap
      • AttributeMap
      • (probably more I haven't gotten to yet)

      The collection hierarchy changed in 2.13, and like elsewhere, I don't see that it's possible to use a compat library or clever coding to bridge the difference. I think we need to maintain two implementations in parallel source trees, possibly with a common ancestor with the commonalities.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            srowen Sean R. Owen
            srowen Sean R. Owen
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment