Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-34203

FileSource table null partition can not be dropped

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.1, 3.1.0, 3.2.0
    • Fix Version/s: 3.0.2, 3.1.1, 3.2.0
    • Component/s: SQL
    • Labels:
      None

      Description

      case to reproduce

      create table ppp(i string, j string) using parquet partitioned by (j);

      INSERT INTO ppp PARTITION (j=null) VALUES ('1');
      alter table ppp drop partition(j=null); — success

      INSERT OVERWRITE ppp VALUES ('1', null); — error
      Error in query: No partition is dropped. One partition spec 'Map(j -> null)' does not exist in table 'ppp' database 'default';

      alter table ppp drop partition(j='_HIVE_DEFAULT_PARTITION_'); — then, this is need

        Attachments

          Activity

            People

            • Assignee:
              maxgekk Max Gekk
              Reporter:
              Qin Yao Kent Yao
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: