[HBASE-13153] Bulk Loaded HFile Replication

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0, 2.0.0
• Component/s: Replication
• Hadoop Flags: Reviewed

Release Note

This enhances the HBase replication to support replication of bulk loaded data. This is configurable, by default it is set to false which means it will not replicate the bulk loaded data to its peer(s). To enable it set "hbase.replication.bulkload.enabled" to true.

Following are the additional configurations added for this enhancement,
 a. hbase.replication.cluster.id - This is manadatory to configure in cluster where replication for bulk loaded data is enabled. A source cluster is uniquely identified by sink cluster using this id. This should be configured in the source cluster configuration file for all the RS.
 b. hbase.replication.conf.dir - This represents the directory where all the active cluster's file system client configurations are defined in subfolders corresponding to their respective replication cluster id in peer cluster. This should be configured in the peer cluster configuration file for all the RS. Default is HBASE_CONF_DIR.
 c. hbase.replication.source.fs.conf.provider - This represents the class which provides the source cluster file system client configuration to peer cluster. This should be configured in the peer cluster configuration file for all the RS. Default is org.apache.hadoop.hbase.replication.regionserver.DefaultSourceFSConfigurationProvider

 For example: If source cluster FS client configurations are copied in peer cluster under directory /home/user/dc1/ then hbase.replication.cluster.id should be configured as dc1 and hbase.replication.conf.dir as /home/user

Note:
 a. Any modification to source cluster FS client configuration files in peer cluster side replication configuration directory then it needs to restart all its peer(s) cluster RS with default hbase.replication.source.fs.conf.provider.
 b. Only 'xml' type files will be loaded by the default hbase.replication.source.fs.conf.provider.

As part of this we have made following changes to LoadIncrementalHFiles class which is marked as Public and Stable class,
 a. Raised the visibility scope of LoadQueueItem class from package private to public.
 b. Added a new method loadHFileQueue, which loads the queue of LoadQueueItem into the table as per the region keys provided.

• Assignee: Ashish Singhi
• Reporter: sunhaitao
• Created: 04/Mar/15 11:12
• Updated: 17/Jun/22 18:42
• Resolved: 10/Dec/15 07:43

Description

Currently we plan to use HBase Replication feature to deal with disaster tolerance scenario.But we encounter an issue that we will use bulkload very frequently,because bulkload bypass write path, and will not generate WAL, so the data will not be replicated to backup cluster. It's inappropriate to bukload twice both on active cluster and backup cluster. So i advise do some modification to bulkload feature to enable bukload to both active cluster and backup cluster

Issue Links

• blocks: HBASE-14937 Make rpc call timeout for replication adaptive
• breaks: HBASE-15578 Handle HBASE-15234 for ReplicationHFileCleaner
• incorporates: HBASE-14938 Limit the number of znodes for ZK in bulk loaded hfile replication
• is related to: HBASE-22380 break circle replication when doing bulkload
• relates to: HBASE-15397 Create bulk load replication znode(hfile-refs) in ZK replication queue by default
• relates to: HBASE-15425 Failing to write bulk load event marker in the WAL is ignored
• relates to: HBASE-15669 HFile size is not considered correctly in a replication request
• relates to: HBASE-15952 Bulk load data replication is not working when RS user does not have permission on hfile-refs node
• relates to: HBASE-17290 Potential loss of data for replication of bulk loaded hfiles
• relates to: HBASE-15424 Add bulk load hfile-refs for replication in ZK after the event is appended in the WAL
• relates to: HBASE-15668 HFileReplicator$Copier fails to replicate other hfiles in the request when a hfile in not found in FS anywhere
• relates to: HBASE-14945 Backport HBASE-13153 (Bulk loaded HFile replication) to 0.98
• relates to: HBASE-14939 Document bulk loaded hfile replication
• relates to: HBASE-15888 Extend HBASE-12769 for bulk load data replication
• links to: Review Board