[HBASE-17290] Potential loss of data for replication of bulk loaded hfiles

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.0
• Fix Version/s: 1.4.0, 2.0.0
• Labels: replication
• Hadoop Flags: Reviewed
• Assignee: Ashish Singhi
• Reporter: Ted Yu
• Created: 11/Dec/16 17:22
• Updated: 17/Jun/22 18:43
• Resolved: 06/Jan/17 12:04

Description

Currently the support for replication of bulk loaded hfiles relies on bulk load marker written in the WAL.

The move of bulk loaded hfile(s) (into region directory) may succeed but the write of bulk load marker may fail.
This means that although bulk loaded hfile is being served in source cluster, the replication wouldn't happen.

Normally operator is supposed to retry the bulk load. But relying on human retry is not robust solution.

Issue Links

• is related to: HBASE-13153 Bulk Loaded HFile Replication