Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9675 Support START TRANSACTION/COMMIT/ROLLBACK commands
  3. HIVE-11030

Enhance storage layer to create one delta file per write

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.2.0
    • 1.3.0
    • Transactions
    • None

    Description

      Currently each txn using ACID insert/update/delete will generate a delta directory like delta_0000100_0000101. In order to support multi-statement transactions we must generate one delta per operation within the transaction so the deltas would be named like delta_0000100_0000101_0001, etc.

      Support for MERGE (HIVE-10924) would need the same.

      Attachments

        1. HIVE-11030.8.patch
          82 kB
          Eugene Koifman
        2. HIVE-11030.8.branch1.patch
          81 kB
          Eugene Koifman
        3. HIVE-11030.7.patch
          83 kB
          Eugene Koifman
        4. HIVE-11030.6.patch
          83 kB
          Eugene Koifman
        5. HIVE-11030.5.patch
          82 kB
          Eugene Koifman
        6. HIVE-11030.4.patch
          82 kB
          Eugene Koifman
        7. HIVE-11030.3.patch
          69 kB
          Eugene Koifman
        8. HIVE-11030.2.patch
          72 kB
          Eugene Koifman

        Issue Links

        blocks

        Sub-task - The sub-task of the issue HIVE-11077 Add support in parser and wire up to txn manager

        • Major - Major loss of function.
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. HIVE-10924 add support for MERGE statement

        • Major - Major loss of function.
        • Resolved
        breaks

        Bug - A problem which impairs or prevents the functions of the product. HIVE-12202 NPE thrown when reading legacy ACID delta files

        • Major - Major loss of function.
        • Closed
        relates to

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-10165 Improve hive-hcatalog-streaming extensibility and support updates and deletes.

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ekoifman Eugene Koifman Assign to me
            ekoifman Eugene Koifman
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment