Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-26510

Minor compaction creates empty delta files when no prior delta file exists

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      Hive is creating empty delta files after minor compaction even when 0 delta files exists before compaction.

      Steps to reproduce:

      DROP TABLE IF EXISTS test_major_delete_minor;
      CREATE TABLE test_major_delete_minor (name VARCHAR(50), age TINYINT, num_clicks BIGINT) stored as orc;
      insert into test_major_delete_minor values ('amy', 35, 12341234);
      insert into test_major_delete_minor values ('bob', 66, 1234712348712);
      insert into test_major_delete_minor values ('cal', 21, 431);
      insert into test_major_delete_minor values ('fse', 28, 8456);
      ALTER TABLE test_major_delete_minor  COMPACT 'major';
      DELETE FROM test_major_delete_minor WHERE name='bob';
      DELETE FROM test_major_delete_minor WHERE name='fse';
      ALTER TABLE test_major_delete_minor  COMPACT 'minor'; 

      Attachments

        Issue Links

          Activity

            People

              sbadhya Sourabh Badhya
              sbadhya Sourabh Badhya
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1.5h
                  1.5h