Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-33591

NULL is recognized as the "null" string in partition specs

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.0.2, 3.1.1, 3.2.0
    • SQL

    Description

      For example:

      spark-sql> CREATE TABLE tbl5 (col1 INT, p1 STRING) USING PARQUET PARTITIONED BY (p1);
      spark-sql> INSERT INTO TABLE tbl5 PARTITION (p1 = null) SELECT 0;
      spark-sql> SELECT isnull(p1) FROM tbl5;
      false
      

      The p1 = null is not recognized as a partition with NULL value.

      Attachments

        Activity

          People

            maxgekk Max Gekk
            maxgekk Max Gekk
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: