Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9535

Newly completed blocks in IBR should not be considered under-replicated too quickly

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      TestReplication#testNoExtraReplicationWhenBlockReceivedIsLate failed in several Jenkins run (e.g., https://builds.apache.org/job/PreCommit-HDFS-Build/13818/testReport/). The failure is on the last assertNoReplicationWasPerformed check.

      This test failure reveals a scenario that HDFS-1172 missed: if a block is first committed by the client, and then the first IBR comes to the NN, as proposed by HDFS-1172, we should still put the remaining expected replicas into the pending queue, instead of the under-replicated queue. Please see Mingliang Liu's comment here for more details.

        Attachments

        1. HDFS-9535.000.patch
          2 kB
          Mingliang Liu
        2. HDFS-9535.001.patch
          0.9 kB
          Mingliang Liu
        3. HDFS-9535.002.patch
          1.0 kB
          Mingliang Liu

          Issue Links

            Activity

              People

              • Assignee:
                liuml07 Mingliang Liu
                Reporter:
                jingzhao Jing Zhao
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: