Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17562

ACID 1.0 + ETL strategy should treat empty compacted files as uncovered deltas

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 2.4.0, 2.2.1, 2.3.1
    • Component/s: Transactions
    • Labels:
      None
    • Target Version/s:

      Description

      In branch-2, with ACID 1.0, following sequence will result in incorrect results
      1) Set split strategy to ETL
      2) Insert some rows
      3) Delete all rows
      4) Alter table compact MAJOR
      5) Insert some rows
      6) Select * query will not return any rows that is written at last (step 5)

      The reason for that, compaction essentially voids the first insert in step 2. Now when ETL split strategy is chosen, there will not be any stripes in the base files. So no split gets generated and any subsequent deltas gets ignored.

        Attachments

        1. HIVE-17562-branch-2.patch
          9 kB
          Prasanth Jayachandran
        2. HIVE-17562-branch-2.patch
          9 kB
          Prasanth Jayachandran
        3. HIVE-17562.1.branch-2.patch
          9 kB
          Prasanth Jayachandran

          Issue Links

            Activity

              People

              • Assignee:
                prasanth_j Prasanth Jayachandran
                Reporter:
                prasanth_j Prasanth Jayachandran
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: