[HBASE-6758] [replication] The replication-executor should make sure the file that it is replicating is closed before declaring success on that file

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.95.0
• Hadoop Flags: Reviewed
• Assignee: Devaraj Das
• Reporter: Devaraj Das
• Created: 11/Sep/12 17:52
• Updated: 23/Sep/13 18:30
• Resolved: 19/Oct/12 19:11

Description

I have seen cases where the replication-executor would lose data to replicate since the file hasn't been closed yet. Upon closing, the new data becomes visible. Before that happens the ZK node shouldn't be deleted in ReplicationSourceManager.logPositionAndCleanOldLogs. Changes need to be made in ReplicationSource.processEndOfFile as well (currentPath related).

Issue Links

• relates to: HBASE-7017 Backport "[replication] The replication-executor should make sure the file that it is replicating is closed before declaring success on that file" to 0.94