Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1623 High Availability Framework for HDFS NN
  3. HDFS-2804

SBN should not mark blocks under-replicated when exiting safemode

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HA branch (HDFS-1623)
    • HA branch (HDFS-1623)
    • ha, namenode
    • None

    Description

      In testing on a cluster, I restarted with one fewer datanodes than previously. This caused a few thousand blocks to be under-replicated. Similar to HDFS-2795, I saw the under-replicated blocks on the SBN, slowly decreasing as the replication thread ran. This seems to be because we process the replication queue when exiting safemode, even if in standby mode. It also reports many "missing blocks" in the NN UI which are slowly decreasing.

      Attachments

        1. hdfs-2804.txt
          6 kB
          Todd Lipcon
        2. hdfs-2804.txt
          6 kB
          Todd Lipcon

        Activity

          People

            tlipcon Todd Lipcon
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: