Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26211

Fix InSet for binary, and struct and array with null.

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.2, 2.4.0
    • Fix Version/s: 2.3.3, 2.4.1, 3.0.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Currently InSet doesn't work properly for binary type, or struct and array type with null value in the set.
      Because, as for binary type, the HashSet doesn't work properly for Array[Byte], and as for struct and array type with null value in the set, the ordering will throw a NPE.

        Attachments

          Activity

            People

            • Assignee:
              ueshin Takuya Ueshin
              Reporter:
              ueshin Takuya Ueshin

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment