Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9675 Support START TRANSACTION/COMMIT/ROLLBACK commands
  3. HIVE-11030

Enhance storage layer to create one delta file per write

          Details

          • Type: Sub-task
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 1.2.0
          • Fix Version/s: 1.3.0
          • Component/s: Transactions
          • Labels:
            None

            Description

            Currently each txn using ACID insert/update/delete will generate a delta directory like delta_0000100_0000101. In order to support multi-statement transactions we must generate one delta per operation within the transaction so the deltas would be named like delta_0000100_0000101_0001, etc.

            Support for MERGE (HIVE-10924) would need the same.

              Attachments

              1. HIVE-11030.2.patch
                72 kB
                Eugene Koifman
              2. HIVE-11030.3.patch
                69 kB
                Eugene Koifman
              3. HIVE-11030.4.patch
                82 kB
                Eugene Koifman
              4. HIVE-11030.5.patch
                82 kB
                Eugene Koifman
              5. HIVE-11030.6.patch
                83 kB
                Eugene Koifman
              6. HIVE-11030.7.patch
                83 kB
                Eugene Koifman
              7. HIVE-11030.8.branch1.patch
                81 kB
                Eugene Koifman
              8. HIVE-11030.8.patch
                82 kB
                Eugene Koifman

                Issue Links

                blocks

                Sub-task - The sub-task of the issue HIVE-11077 Add support in parser and wire up to txn manager

                • Major - Major loss of function.
                • Resolved

                New Feature - A new feature of the product, which has yet to be developed. HIVE-10924 add support for MERGE statement

                • Major - Major loss of function.
                • Resolved
                breaks

                Bug - A problem which impairs or prevents the functions of the product. HIVE-12202 NPE thrown when reading legacy ACID delta files

                • Major - Major loss of function.
                • Closed
                relates to

                Improvement - An improvement or enhancement to an existing feature or task. HIVE-10165 Improve hive-hcatalog-streaming extensibility and support updates and deletes.

                • Major - Major loss of function.
                • Closed

                  Activity

                    People

                    • Assignee:
                      ekoifman Eugene Koifman
                      Reporter:
                      ekoifman Eugene Koifman
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      5 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: