Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14841 Replication - Phase 2
  3. HIVE-15180

Extend JSONMessageFactory to store additional information about metadata objects on different table events

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.2.0
    • Component/s: repl
    • Labels:
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      We want the NOTIFICATION_LOG table to capture additional information about the metadata objects when DbNotificationListener captures different events for a table (create/drop/alter) and a partition (create/alter/drop). We'll use the messages field to add json objects for table and partitions for create and alter events. The drop events message remains unchanged. These messages can then be used to replay these events on the destination in event of a replication, in a way that will put the destination in a state that's consistent with one of the past states of the source.

        Attachments

        1. HIVE-15180.1.patch
          21 kB
          Vaibhav Gumashta
        2. HIVE-15180.2.patch
          58 kB
          Vaibhav Gumashta
        3. HIVE-15180.3.patch
          59 kB
          Vaibhav Gumashta
        4. HIVE-15180.3.patch
          59 kB
          Vaibhav Gumashta
        5. HIVE-15180.4.patch
          52 kB
          Vaibhav Gumashta
        6. HIVE-15180.5.patch
          105 kB
          Vaibhav Gumashta
        7. HIVE-15180.6.patch
          137 kB
          Vaibhav Gumashta
        8. HIVE-15180.6.patch
          137 kB
          Vaibhav Gumashta
        9. HIVE-15180.7.patch
          146 kB
          Vaibhav Gumashta
        10. HIVE-15180.7.patch
          146 kB
          Vaibhav Gumashta

          Issue Links

            Activity

              People

              • Assignee:
                vgumashta Vaibhav Gumashta
                Reporter:
                vgumashta Vaibhav Gumashta
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: