Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8065 Support HDFS encryption functionality on Hive
  3. HIVE-10910

Alter table drop partition queries in encrypted zone failing to remove data from HDFS

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.2.0
    • 1.2.1
    • Hive
    • None

    Description

      Alter table query trying to drop partition removes metadata of partition but fails to remove the data from HDFS

      hive> create table table_1(name string, age int, gpa double) partitioned by (b string) stored as textfile;
      OK
      Time taken: 0.732 seconds
      hive> alter table table_1 add partition (b='2010-10-10');
      OK
      Time taken: 0.496 seconds
      hive> show partitions table_1;
      OK
      b=2010-10-10
      Time taken: 0.781 seconds, Fetched: 1 row(s)
      hive> alter table table_1 drop partition (b='2010-10-10');
      FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Got exception: java.io.IOException Failed to move to trash: hdfs://<ip-address>:8020/<warehouse-dir>/table_1/b=2010-10-10
      hive> show partitions table_1;
      OK
      Time taken: 0.622 seconds

      Attachments

        1. HIVE-10910.patch
          18 kB
          Eugene Koifman
        2. HIVE-10910.2.patch
          18 kB
          Gunther Hagleitner

        Issue Links

          Activity

            People

              ekoifman Eugene Koifman
              asreekumar Aswathy Chellammal Sreekumar
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: