[HBASE-3446] ProcessServerShutdown fails if META moves, orphaning lots of regions

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.90.0
• Fix Version/s: 0.92.0
• Component/s: master
• Hadoop Flags: Reviewed
• Release Note: Makes catalog/* classes retry: e.g. MetaEditor, MetaReader and CatalogTracker. Previously they would try once and unless successful, fail. Retrying is courtesy of HTable instances.
• Assignee: Michael Stack
• Reporter: Todd Lipcon
• Created: 17/Jan/11 02:27
• Updated: 20/Nov/15 12:41
• Resolved: 13/Oct/11 23:37

Description

I ran a rolling restart on a 5 node cluster with lots of regions, and afterwards had LOTS of regions left orphaned. The issue appears to be that ProcessServerShutdown failed because the server hosting META was restarted around the same time as another server was being processed

Issue Links

• blocks: HBASE-3138 When new master joins running cluster but meta is yanked from it as processing RIT, gets unexpected state
• is related to: HBASE-3478 HBase fails to recover from failed DNS resolution of stale meta connection info