Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10810

Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha2
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      1)Batch IBR is enabled with number of committed blocks allowed=1
      2) Written one block and closed the file without waiting for IBR
      3)Setreplication called immediately on the file.

      So till the finalized IBR Received, block will not be added to neededReconstruction since following check will be false as block is not marked as complete.

      if (isNeededReconstruction(block, repl.liveReplicas())) {
              neededReconstruction.update(block, repl.liveReplicas(),
                  repl.readOnlyReplicas(), repl.decommissionedAndDecommissioning(),
                  curExpectedReplicas, curReplicasDelta, expectedReplicasDelta);
            }.

      Hence block will not marked as under-replicated.

        Attachments

        1. HDFS-10810-branch-2.patch
          5 kB
          Brahma Reddy Battula
        2. HDFS-10810-003.patch
          5 kB
          Brahma Reddy Battula
        3. HDFS-10810-002.patch
          4 kB
          Brahma Reddy Battula
        4. HDFS-10810.patch
          4 kB
          Brahma Reddy Battula

          Issue Links

            Activity

              People

              • Assignee:
                brahmareddy Brahma Reddy Battula
                Reporter:
                brahmareddy Brahma Reddy Battula
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: