Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11090

Leave safemode immediately if all blocks have reported in

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.7.3
    • None
    • namenode
    • None

    Description

      Startup safemode is triggered by two thresholds: % blocks reported in, and min # datanodes. It's extended by an interval (default 30s) until these two thresholds are met.

      Safemode extension is helpful when the cluster has data, and the default % blocks threshold (0.99) is used. It gives DNs a little extra time to report in and thus avoid unnecessary replication work.

      However, we can leave startup safemode early if 100% of blocks have reported in.

      Note that operators sometimes change the % blocks threshold to > 1 to never automatically leave safemode. We should maintain this behavior.

      Attachments

        1. HDFS-11090.001.patch
          2 kB
          Yiqun Lin

        Issue Links

          Activity

            People

              linyiqun Yiqun Lin
              andrew.wang Andrew Wang
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated: