Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-4288

NN accepts incremental BR as IBR in safemode

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.0, 2.0.0-alpha, 3.0.0
    • Fix Version/s: 2.0.3-alpha, 0.23.7
    • Component/s: namenode
    • Labels:
      None

      Description

      If a DN is ready to send an incremental BR and the NN goes down, the DN will repeatedly try to reconnect. The NN will then process the DN's incremental BR as an initial BR. The NN now thinks the DN has only a few blocks, and will ignore all subsequent BRs from that DN until out of safemode – which it may never do because of all the "missing" blocks on the affected DNs.

      1. HDFS-4288.patch
        7 kB
        Daryn Sharp
      2. HDFS-4288.patch
        8 kB
        Daryn Sharp
      3. HDFS-4288.branch-23.patch
        3 kB
        Daryn Sharp
      4. HDFS-4288.branch-23.patch
        10 kB
        Daryn Sharp

        Issue Links

          Activity

          Daryn Sharp created issue -
          Daryn Sharp made changes -
          Field Original Value New Value
          Attachment HDFS-4288.branch-23.patch [ 12560875 ]
          Suresh Srinivas made changes -
          Link This issue relates to HDFS-4379 [ HDFS-4379 ]
          Daryn Sharp made changes -
          Attachment HDFS-4288.patch [ 12564286 ]
          Daryn Sharp made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Todd Lipcon made changes -
          Fix Version/s 3.0.0 [ 12320356 ]
          Fix Version/s 2.0.3-alpha [ 12323274 ]
          Todd Lipcon made changes -
          Fix Version/s 2.0.3-alpha [ 12323274 ]
          Fix Version/s 3.0.0 [ 12320356 ]
          Thomas Graves made changes -
          Target Version/s 3.0.0, 2.0.3-alpha, 0.23.6 [ 12320356, 12323274, 12323503 ] 3.0.0, 2.0.3-alpha, 0.23.7 [ 12320356, 12323274, 12323955 ]
          Daryn Sharp made changes -
          Attachment HDFS-4288.branch-23.patch [ 12565166 ]
          Attachment HDFS-4288.patch [ 12565167 ]
          Kihwal Lee made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 2.0.3-alpha [ 12323274 ]
          Fix Version/s 0.23.7 [ 12323955 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Daryn Sharp
              Reporter:
              Daryn Sharp
            • Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development