[HBASE-11442] ReplicationSourceManager doesn't cleanup the queues for recovered sources

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.99.0, 0.98.4
• Component/s: Replication
• Hadoop Flags: Reviewed
• Assignee: Virag Kothari
• Reporter: Virag Kothari
• Created: 30/Jun/14 21:29
• Updated: 06/Apr/18 17:50
• Resolved: 14/Jul/14 23:57

Description

Currently, ReplicationSourceManager only cleanups the queues for recovered sources when the queue is being closed. This can cause the already read WAL's files to be read again when a region server doing failover also dies. This can cause replication to possibly happen again

For e.g lets say RS1 dies with 5 files in queue and RS2 is doing the failover. Now, lets say RS2 dies after going thru 3 files in queue and RS3 is doing the failover. In this case, RS3 will again read those 3 files as they were not removed from the queue. (Though it will read the first file from the set pos. in ZK)