Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17089

make acid 2.0 the default

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0
    • Component/s: Transactions
    • Labels:
      None
    • Target Version/s:

      Description

      acid 2.0 is introduced in HIVE-14035. It replaces Update events with a combination of Delete + Insert events. This now makes U=D+I the default (and only) supported acid table type in Hive 3.0.

      The expectation for upgrade is that Major compaction has to be run on all acid tables in the existing Hive cluster and that no new writes to these table take place since the start of compaction (Need to add a mechanism to put a table in read-only mode - this way it can still be read while it's being compacted). Then upgrade to Hive 3.0 can take place.

        Attachments

        1. HIVE-17089.16.patch
          204 kB
          Eugene Koifman
        2. HIVE-17089.15.patch
          204 kB
          Eugene Koifman
        3. HIVE-17089.14.patch
          204 kB
          Eugene Koifman
        4. HIVE-17089.13.patch
          203 kB
          Eugene Koifman
        5. HIVE-17089.12.patch
          203 kB
          Eugene Koifman
        6. HIVE-17089.11.patch
          203 kB
          Eugene Koifman
        7. HIVE-17089.10.patch
          189 kB
          Eugene Koifman
        8. HIVE-17089.10.patch
          186 kB
          Eugene Koifman
        9. HIVE-17089.07.patch
          174 kB
          Eugene Koifman
        10. HIVE-17089.06.patch
          128 kB
          Eugene Koifman
        11. HIVE-17089.05.patch
          111 kB
          Eugene Koifman
        12. HIVE-17089.03.patch
          81 kB
          Eugene Koifman
        13. HIVE-17089.01.patch
          1 kB
          Eugene Koifman

          Issue Links

            Activity

              People

              • Assignee:
                ekoifman Eugene Koifman
                Reporter:
                ekoifman Eugene Koifman
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: