Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-1125

Removing a datanode (failed or decommissioned) should not require a namenode restart

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Duplicate
    • Affects Version/s: 0.20.2
    • Fix Version/s: None
    • Component/s: namenode
    • Labels:
      None

      Description

      I've heard of several Hadoop users using dfsadmin -report to monitor the number of dead nodes, and alert if that number is not 0. This mechanism tends to work pretty well, except when a node is decommissioned or fails, because then the namenode requires a restart for said node to be entirely removed from HDFS. More details here:

      http://markmail.org/search/?q=decommissioned%20node%20showing%20up%20ad%20dead%20node%20in%20web%20based%09interface%20to%20namenode#query:decommissioned%20node%20showing%20up%20ad%20dead%20node%20in%20web%20based%09interface%20to%20namenode+page:1+mid:7gwqwdkobgfuszb4+state:results

      Removal from the exclude file and a refresh should get rid of the dead node.

        Issue Links

          Activity

          Alex Loddengaard created issue -
          Allen Wittenauer made changes -
          Field Original Value New Value
          Affects Version/s 0.20.2 [ 12314204 ]
          Arun Ramakrishnan made changes -
          Link This issue is related to HDFS-1290 [ HDFS-1290 ]
          Arun Ramakrishnan made changes -
          Link This issue relates to HDFS-1290 [ HDFS-1290 ]
          Allen Wittenauer made changes -
          Fix Version/s 0.22.0 [ 12314241 ]
          Allen Wittenauer made changes -
          Priority Minor [ 4 ] Blocker [ 1 ]
          Nigel Daley made changes -
          Issue Type Bug [ 1 ] Improvement [ 4 ]
          Fix Version/s 0.22.0 [ 12314241 ]
          Priority Blocker [ 1 ] Critical [ 2 ]
          Allen Wittenauer made changes -
          Priority Critical [ 2 ] Blocker [ 1 ]
          Harsh J made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Duplicate [ 3 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Alex Loddengaard
            • Votes:
              6 Vote for this issue
              Watchers:
              21 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development