[HBASE-21421] Do not kill RS if reportOnlineRegions fails

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.1, 2.0.2
• Fix Version/s: 3.0.0-alpha-1, 2.2.0, 2.0.3, 2.1.2
• Assignee: Allan Yang
• Reporter: Allan Yang
• Created: 01/Nov/18 11:28
• Updated: 23/Apr/19 11:51
• Resolved: 06/Nov/18 06:59

Description

In the periodic regionServerReport from RS to master, we will call master.getAssignmentManager().reportOnlineRegions() to make sure the RS has a same state with Master. If RS holds a region which master think should be on another RS, the Master will kill the RS.

But, the regionServerReport could be lagging(due to network or something), which can't represent the current state of RegionServer. Besides, we will call reportRegionStateTransition and try forever until it successfully reported to master when online a region. We can count on reportRegionStateTransition calls.

I have encountered cases that the regions are closed on the RS and reportRegionStateTransition to master successfully. But later, a lagging regionServerReport tells the master the region is online on the RS(Which is not at the moment, this call may generated some time ago and delayed by network somehow), the the master think the region should be on another RS, and kill the RS, which should not be.

Issue Links

• is duplicated by: HBASE-21531 race between region report and region move causes master to kill RS