Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17526

Disable conversion to ACID if table has _copy_N files on branch-1

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0
    • Component/s: Transactions
    • Labels:
      None

      Description

      As discussed in HIVE-16177, non-ACID to ACID conversion can lead to data loss if the table has *_copy_N files.

      The patch for HIVE-16177 is quite massive and would basically need a reimplementation to apply for branch-1 since the related code paths have diverged a lot. We could disable the conversion to ACID if there are *_copy_N files instead.

        Attachments

        1. HIVE-17526.1-branch-1.patch
          20 kB
          Daniel Voros

          Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HIVE-17947 Concurrent inserts might fail for ACID table since HIVE-17526 on branch-1

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HIVE-16177 non Acid to acid conversion doesn't handle _copy_N files

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

            Activity

              People

              • Assignee:
                dvoros Daniel Voros
                Reporter:
                dvoros Daniel Voros
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: