Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14201

Ability to disallow safemode NN to become active

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.1, 2.9.2
    • Fix Version/s: 3.3.0
    • Component/s: auto-failover
    • Labels:
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Currently with HA, Namenode in safemode can be possibly selected as active, for availability of both read and write, Namenodes not in safemode are better choices to become active though.

      It can take tens of minutes for a cold started Namenode to get out of safemode, especially when there are large number of files and blocks in HDFS, that means if a Namenode in safemode become active, the cluster will be not fully functioning for quite a while, even if it can while there is some Namenode not in safemode.

      The proposal here is to add an option, to allow Namenode to report itself as UNHEALTHY to ZKFC, if it's in safemode, so as to only allow fully functioning Namenode to become active, improving the general availability of the cluster.

        Attachments

        1. HDFS-14201.001.patch
          3 kB
          Xiaoqiao He
        2. HDFS-14201.002.patch
          5 kB
          Xiaoqiao He
        3. HDFS-14201.003.patch
          7 kB
          Xiao Liang
        4. HDFS-14201.004.patch
          10 kB
          Xiao Liang
        5. HDFS-14201.005.patch
          11 kB
          Xiaoqiao He
        6. HDFS-14201.006.patch
          11 kB
          Xiaoqiao He
        7. HDFS-14201.007.patch
          11 kB
          Xiaoqiao He
        8. HDFS-14201.008.patch
          13 kB
          Xiaoqiao He
        9. HDFS-14201.009.patch
          13 kB
          Xiaoqiao He

        Issue Links

          Activity

            People

            • Assignee:
              surmountian Xiao Liang
              Reporter:
              surmountian Xiao Liang

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment