Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9675 Support START TRANSACTION/COMMIT/ROLLBACK commands
  3. HIVE-11030

Enhance storage layer to create one delta file per write

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.3.0
    • Component/s: Transactions
    • Labels:
      None

      Description

      Currently each txn using ACID insert/update/delete will generate a delta directory like delta_0000100_0000101. In order to support multi-statement transactions we must generate one delta per operation within the transaction so the deltas would be named like delta_0000100_0000101_0001, etc.

      Support for MERGE (HIVE-10924) would need the same.

        Attachments

        1. HIVE-11030.8.patch
          82 kB
          Eugene Koifman
        2. HIVE-11030.8.branch1.patch
          81 kB
          Eugene Koifman
        3. HIVE-11030.7.patch
          83 kB
          Eugene Koifman
        4. HIVE-11030.6.patch
          83 kB
          Eugene Koifman
        5. HIVE-11030.5.patch
          82 kB
          Eugene Koifman
        6. HIVE-11030.4.patch
          82 kB
          Eugene Koifman
        7. HIVE-11030.3.patch
          69 kB
          Eugene Koifman
        8. HIVE-11030.2.patch
          72 kB
          Eugene Koifman

          Issue Links

          blocks

          Sub-task - The sub-task of the issue HIVE-11077 Add support in parser and wire up to txn manager

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HIVE-10924 add support for MERGE statement

          • Major - Major loss of function.
          • Resolved
          breaks

          Bug - A problem which impairs or prevents the functions of the product. HIVE-12202 NPE thrown when reading legacy ACID delta files

          • Major - Major loss of function.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-10165 Improve hive-hcatalog-streaming extensibility and support updates and deletes.

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                ekoifman Eugene Koifman
                Reporter:
                ekoifman Eugene Koifman
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: