Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1623 High Availability Framework for HDFS NN
  3. HDFS-2804

SBN should not mark blocks under-replicated when exiting safemode

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: HA branch (HDFS-1623)
    • Fix Version/s: HA branch (HDFS-1623)
    • Component/s: ha, namenode
    • Labels:
      None

      Description

      In testing on a cluster, I restarted with one fewer datanodes than previously. This caused a few thousand blocks to be under-replicated. Similar to HDFS-2795, I saw the under-replicated blocks on the SBN, slowly decreasing as the replication thread ran. This seems to be because we process the replication queue when exiting safemode, even if in standby mode. It also reports many "missing blocks" in the NN UI which are slowly decreasing.

        Attachments

        1. hdfs-2804.txt
          6 kB
          Todd Lipcon
        2. hdfs-2804.txt
          6 kB
          Todd Lipcon

          Activity

            People

            • Assignee:
              tlipcon Todd Lipcon
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: