Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18555

na.fill miss up original values in long integers

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.0.0, 2.0.1, 2.0.2
    • Fix Version/s: 2.0.3, 2.1.1, 2.2.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Manly the issue is clarified in the following example:
      Given a Dataset:

      scala> data.show

      a b
      1 2
      -1 -2
      9123146099426677101 9123146560113991650

      theoretically when we call na.fill(0) nothing should change, while the current result is:

      scala> data.na.fill(0).show

      a b
      1 2
      -1 -2
      9123146099426676736 9123146560113991680

        Attachments

          Activity

            People

            • Assignee:
              windpiger Song Jun
              Reporter:
              mahmoudr Mahmoud Rawas

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment