Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26211

Fix InSet for binary, and struct and array with null.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.2, 2.4.0
    • Fix Version/s: 2.3.3, 2.4.1, 3.0.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Currently InSet doesn't work properly for binary type, or struct and array type with null value in the set.
      Because, as for binary type, the HashSet doesn't work properly for Array[Byte], and as for struct and array type with null value in the set, the ordering will throw a NPE.

        Attachments

          Activity

            People

            • Assignee:
              ueshin Takuya Ueshin
              Reporter:
              ueshin Takuya Ueshin
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: