[HBASE-5916] RS restart just before master intialization we make the cluster non operative

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.92.1, 0.94.0
• Fix Version/s: 0.92.2, 0.94.1, 0.95.0
• Hadoop Flags: Reviewed
• Assignee: ramkrishna.s.vasudevan
• Reporter: ramkrishna.s.vasudevan
• Created: 02/May/12 09:22
• Updated: 18/Sep/13 20:47
• Resolved: 29/May/12 16:35

Description

Consider a case where my master is getting restarted. RS that was alive when the master restart started, gets restarted before the master initializes the ServerShutDownHandler.

serverShutdownHandlerEnabled = true;

In this case when the RS tries to register with the master, the master will try to expire the server but the server cannot be expired as still the serverShutdownHandler is not enabled.

This case may happen when i have only one RS gets restarted or all the RS gets restarted at the same time.(before assignRootandMeta).

LOG.info(message);
      if (existingServer.getStartcode() < serverName.getStartcode()) {
        LOG.info("Triggering server recovery; existingServer " +
          existingServer + " looks stale, new server:" + serverName);
        expireServer(existingServer);
      }

If another RS is brought up then the cluster comes back to normalcy.

May be a very corner case.

Issue Links

• is related to: HBASE-6227 SSH and cluster startup causes data loss