Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14841 Replication - Phase 2
  3. HIVE-15180

Extend JSONMessageFactory to store additional information about metadata objects on different table events

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.2.0
    • repl
    • Reviewed

    Description

      We want the NOTIFICATION_LOG table to capture additional information about the metadata objects when DbNotificationListener captures different events for a table (create/drop/alter) and a partition (create/alter/drop). We'll use the messages field to add json objects for table and partitions for create and alter events. The drop events message remains unchanged. These messages can then be used to replay these events on the destination in event of a replication, in a way that will put the destination in a state that's consistent with one of the past states of the source.

      Attachments

        1. HIVE-15180.1.patch
          21 kB
          Vaibhav Gumashta
        2. HIVE-15180.2.patch
          58 kB
          Vaibhav Gumashta
        3. HIVE-15180.3.patch
          59 kB
          Vaibhav Gumashta
        4. HIVE-15180.3.patch
          59 kB
          Vaibhav Gumashta
        5. HIVE-15180.4.patch
          52 kB
          Vaibhav Gumashta
        6. HIVE-15180.5.patch
          105 kB
          Vaibhav Gumashta
        7. HIVE-15180.6.patch
          137 kB
          Vaibhav Gumashta
        8. HIVE-15180.6.patch
          137 kB
          Vaibhav Gumashta
        9. HIVE-15180.7.patch
          146 kB
          Vaibhav Gumashta
        10. HIVE-15180.7.patch
          146 kB
          Vaibhav Gumashta

        Issue Links

          Activity

            People

              vgumashta Vaibhav Gumashta
              vgumashta Vaibhav Gumashta
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: