[HIVE-9174] Enable queuing of HCatalog notification events in metastore DB

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: HCatalog, Metastore
• Labels: TODOC15
• Release Note: Introduces new DbNotificationListener as another possible Metastore EventListener. This enables integration with external tools like Falcon to implement Replication.
• Assignee: Alan Gates
• Reporter: Alan Gates
• Created: 19/Dec/14 20:08
• Updated: 07/Dec/16 02:29
• Resolved: 07/Jan/15 20:16

Description

HCatalog supports notifying listeners of events such as table creation, etc. using the MetaStoreEventListener interface. The only non-test implementation of this interface today is NotificationListerner, which currently sends notifications via JMS. This requires a JMS service to be set up in the cluster.

This JIRA proposes adding a new DbNotificationListener, that will store events directly in the metastore, and allow users to access those events via HiveMetastoreClient. This avoids the need for a 3rd tool to install and manage when listening for events.

Issue Links

• is depended upon by: HIVE-9184 Modify HCatClient to support new notification methods in HiveMetaStoreClient
• is related to: HIVE-15373 DbNotificationListener should use thread-local RawStore
• relates to: HIVE-9296 Need to add schema upgrade changes for queueing events in the database