[HDFS-10810] Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.8.0, 3.0.0-alpha2
• Component/s: namenode
• Hadoop Flags: Reviewed
• Assignee: Brahma Reddy Battula
• Reporter: Brahma Reddy Battula
• Created: 27/Aug/16 02:32
• Updated: 04/Oct/16 03:10
• Resolved: 04/Oct/16 02:09

Description

1)Batch IBR is enabled with number of committed blocks allowed=1
2) Written one block and closed the file without waiting for IBR
3)Setreplication called immediately on the file.

So till the finalized IBR Received, block will not be added to neededReconstruction since following check will be false as block is not marked as complete.

if (isNeededReconstruction(block, repl.liveReplicas())) {
        neededReconstruction.update(block, repl.liveReplicas(),
            repl.readOnlyReplicas(), repl.decommissionedAndDecommissioning(),
            curExpectedReplicas, curReplicasDelta, expectedReplicasDelta);
      }.

Hence block will not marked as under-replicated.

Issue Links

• relates to: HDFS-8999 Allow a file to be closed with COMMITTED but not yet COMPLETE blocks.
• relates to: HDFS-9600 do not check replication if the block is under construction
• relates to: HDFS-9710 Change DN to send block receipt IBRs in batches