[HDFS-7739] ZKFC - transitionToActive is indefinitely waiting to complete fenceOldActive

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Not A Problem
• Affects Version/s: 2.6.0
• Component/s: auto-failover
• Assignee: Brahma Reddy Battula
• Reporter: Brahma Reddy Battula
• Created: 05/Feb/15 14:33
• Updated: 07/May/15 15:58
• Resolved: 07/May/15 11:36

Description

Scenario:

One of the cluster disk got full and ZKFC making tranisionToAcitve ,To fence old active node it needs to execute the command and wait for tge result, since disk got full, strempumper thread will be indefinitely waiting( Even after free the disk also, it will not come out)...

Please check the attached thread dump of ZKFC ..

Better to maintain the timeout for stream-pumper thread .

protected void pump() throws IOException {
    InputStreamReader inputStreamReader = new InputStreamReader(stream);
    BufferedReader br = new BufferedReader(inputStreamReader);
    String line = null;
    while ((line = br.readLine()) != null) {
      if (type == StreamType.STDOUT) {
        log.info(logPrefix + ": " + line);
      } else {
        log.warn(logPrefix + ": " + line);          
      }