Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14201

Ability to disallow safemode NN to become active

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.1, 2.9.2
    • Fix Version/s: 3.3.0
    • Component/s: auto-failover
    • Labels:
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Currently with HA, Namenode in safemode can be possibly selected as active, for availability of both read and write, Namenodes not in safemode are better choices to become active though.

      It can take tens of minutes for a cold started Namenode to get out of safemode, especially when there are large number of files and blocks in HDFS, that means if a Namenode in safemode become active, the cluster will be not fully functioning for quite a while, even if it can while there is some Namenode not in safemode.

      The proposal here is to add an option, to allow Namenode to report itself as UNHEALTHY to ZKFC, if it's in safemode, so as to only allow fully functioning Namenode to become active, improving the general availability of the cluster.

        Attachments

        1. HDFS-14201.001.patch
          3 kB
          Xiaoqiao He
        2. HDFS-14201.002.patch
          5 kB
          Xiaoqiao He
        3. HDFS-14201.003.patch
          7 kB
          Xiao Liang
        4. HDFS-14201.004.patch
          10 kB
          Xiao Liang
        5. HDFS-14201.005.patch
          11 kB
          Xiaoqiao He
        6. HDFS-14201.006.patch
          11 kB
          Xiaoqiao He
        7. HDFS-14201.007.patch
          11 kB
          Xiaoqiao He
        8. HDFS-14201.008.patch
          13 kB
          Xiaoqiao He
        9. HDFS-14201.009.patch
          13 kB
          Xiaoqiao He

          Issue Links

            Activity

              People

              • Assignee:
                surmountian Xiao Liang
                Reporter:
                surmountian Xiao Liang
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: