Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2126 Improve Namenode startup time [umbrella task]
  3. HDFS-1541

Not marking datanodes dead When namenode in safemode

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.0
    • 0.20.204.0, 0.23.0
    • namenode
    • None
    • Reviewed

    Description

      In a big cluster, when namenode starts up, it takes a long time for namenode to process block reports from all datanodes. Because heartbeats processing get delayed, some datanodes are erroneously marked as dead, then later on they have to register again, thus wasting time.

      It would speed up starting time if the checking of dead nodes is disabled when namenode in safemode.

      Attachments

        1. deadnodescheck1_0.20-security.patch
          0.6 kB
          Matthew Foley
        2. deadnodescheck1.patch
          0.6 kB
          Hairong Kuang
        3. deadnodescheck.patch
          0.6 kB
          Hairong Kuang

        Activity

          People

            hairong Hairong Kuang
            hairong Hairong Kuang
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: