[HBASE-18575] [AMv2] Enable and fix TestRestartCluster#testRetainAssignmentOnRestart on master

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Component/s: amv2
• Hadoop Flags: Reviewed
• Assignee: Umesh Agashe
• Reporter: Umesh Agashe
• Created: 11/Aug/17 21:30
• Updated: 01/Aug/18 06:20
• Resolved: 23/Aug/17 17:12

Description

• Test creates 3 node cluster (master + 2 RS) and creates 3 tables with 1 region each.
• It then takes a snapshot of region assignments
• Shuts down the cluster and restarts with 4 nodes (2 RS on same ports, 1 RS on port where master was running previously and master on new port)
• Takes snapshot of region assignments
• Expected behavior is regions will be retained on RS with appropriate ports

Debugging done so far shows that, when cluster is restarted meta is loaded but meta has old entries (though the ports are same for RSs, start timestamps are different). AssignmentManager#processofflineServersWithOnlineRegions() finds that old RS with different timestamps are not online even though regions assigned to them are online; triggering submitting SCP for each those RSs. Subprocedure AssignProcedure of SCP has forceNewPlan set to true. Which triggers re-assignment of regions.

Issue Links

• Is contained by: HBASE-18110 [AMv2] Reenable tests temporarily disabled
• is related to: HBASE-18511 Default no regions on master