Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19749 Acid V1 to V2 upgrade
  3. HIVE-19598

Add Acid V1 to V2 upgrade module

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 3.0.0
    • 3.1.0
    • Transactions
    • None

    Description

      The on-disk layout for full acid (transactional) tables has changed 3.0.

      Any transactional table that has any update/delete events in any deltas that have not been Major compacted, must go through a Major compaction before upgrading to 3.0.  No more update/delete/merge should be run after/during major compaction.

      Not doing so will result in data corruption/loss.

       

      Need to create a utility tool to help with this process.  HIVE-19233 started this but it needs more work.

      Attachments

        1. HIVE-19598.01-branch-3.patch
          88 kB
          Eugene Koifman
        2. HIVE-19598.06.patch
          88 kB
          Eugene Koifman
        3. HIVE-19598.05.patch
          87 kB
          Eugene Koifman
        4. HIVE-19598.02.patch
          57 kB
          Eugene Koifman

        Issue Links

          Activity

            People

              ekoifman Eugene Koifman
              ekoifman Eugene Koifman
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: