Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8065 Support HDFS encryption functionality on Hive
  3. HIVE-10910

Alter table drop partition queries in encrypted zone failing to remove data from HDFS

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.2.1
    • Component/s: Hive
    • Labels:
      None

      Description

      Alter table query trying to drop partition removes metadata of partition but fails to remove the data from HDFS

      hive> create table table_1(name string, age int, gpa double) partitioned by (b string) stored as textfile;
      OK
      Time taken: 0.732 seconds
      hive> alter table table_1 add partition (b='2010-10-10');
      OK
      Time taken: 0.496 seconds
      hive> show partitions table_1;
      OK
      b=2010-10-10
      Time taken: 0.781 seconds, Fetched: 1 row(s)
      hive> alter table table_1 drop partition (b='2010-10-10');
      FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Got exception: java.io.IOException Failed to move to trash: hdfs://<ip-address>:8020/<warehouse-dir>/table_1/b=2010-10-10
      hive> show partitions table_1;
      OK
      Time taken: 0.622 seconds

        Attachments

        1. HIVE-10910.patch
          18 kB
          Eugene Koifman
        2. HIVE-10910.2.patch
          18 kB
          Gunther Hagleitner

          Issue Links

            Activity

              People

              • Assignee:
                ekoifman Eugene Koifman
                Reporter:
                asreekumar Aswathy Chellammal Sreekumar
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: