Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2822

processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0, 0.24.0
    • Fix Version/s: 0.24.0, 0.23.1
    • Component/s: ha, namenode
    • Labels:
      None

      Description

      When the NN processes mis-replicated blocks while exiting safemode, it considers under-construction blocks as under-replicated, inserting them into the neededReplicationsQueue. This makes them show up as corrupt in the metrics and UI momentarily, until they're pulled off the queue. At that point, it realizes that they aren't in fact under-replicated, correctly. This affects both the HA branch and trunk/23, best I can tell.

      1. hdfs-2822.txt
        5 kB
        Todd Lipcon

        Activity

        Todd Lipcon created issue -
        Todd Lipcon made changes -
        Field Original Value New Value
        Attachment hdfs-2822.txt [ 12511474 ]
        Todd Lipcon made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Target Version/s 0.23.1, 0.24.0, HA branch (HDFS-1623) [ 12318885, 12317653, 12317568 ] HA branch (HDFS-1623), 0.24.0, 0.23.1 [ 12317568, 12317653, 12318885 ]
        Todd Lipcon made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Target Version/s 0.23.1, 0.24.0, HA branch (HDFS-1623) [ 12318885, 12317653, 12317568 ] HA branch (HDFS-1623), 0.24.0, 0.23.1 [ 12317568, 12317653, 12318885 ]
        Fix Version/s 0.24.0 [ 12317653 ]
        Fix Version/s 0.23.1 [ 12318885 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Todd Lipcon
            Reporter:
            Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development