Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18320 Support ACID Tables Replication
  3. HIVE-19089

Create/Replicate Allocate write-id event

    XMLWordPrintableJSON

Details

    Description

      EVENT_ALLOCATE_WRITE_ID
      Source Warehouse:

      • Create new event type EVENT_ALLOCATE_WRITE_ID with related message format etc.
      • Capture this event when allocate a table write ID from the sequence table by ACID operation.
      • Repl dump should read this event from EventNotificationTable and dump the message.

      Target Warehouse:

      • Repl load should read the event from the dump and get the message.
      • Validate if source txn ID from the event is there in the source-target txn ID map. If not there, just noop the event.
      • If valid, then Allocate table write ID from sequence table

      Extend listener notify event API to add two new parameter , dbconn and sqlgenerator to add the events to notification_log table within the same transaction 

      Attachments

        1. HIVE-19089.01.patch
          1.42 MB
          mahesh kumar behera
        2. HIVE-19089.02.patch
          1.42 MB
          mahesh kumar behera
        3. HIVE-19089.03.patch
          1.11 MB
          mahesh kumar behera
        4. HIVE-19089.04.patch
          1.11 MB
          mahesh kumar behera
        5. HIVE-19089.05.patch
          1.14 MB
          mahesh kumar behera
        6. HIVE-19089.06.patch
          1.14 MB
          mahesh kumar behera
        7. HIVE-19089.07.patch
          1.15 MB
          mahesh kumar behera
        8. HIVE-19089.08.patch
          1.15 MB
          mahesh kumar behera

        Issue Links

          Activity

            People

              maheshk114 mahesh kumar behera
              maheshk114 mahesh kumar behera
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: