Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10810

Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha2
    • namenode
    • None
    • Reviewed

    Description

      1)Batch IBR is enabled with number of committed blocks allowed=1
      2) Written one block and closed the file without waiting for IBR
      3)Setreplication called immediately on the file.

      So till the finalized IBR Received, block will not be added to neededReconstruction since following check will be false as block is not marked as complete.

      if (isNeededReconstruction(block, repl.liveReplicas())) {
              neededReconstruction.update(block, repl.liveReplicas(),
                  repl.readOnlyReplicas(), repl.decommissionedAndDecommissioning(),
                  curExpectedReplicas, curReplicasDelta, expectedReplicasDelta);
            }.

      Hence block will not marked as under-replicated.

      Attachments

        1. HDFS-10810.patch
          4 kB
          Brahma Reddy Battula
        2. HDFS-10810-002.patch
          4 kB
          Brahma Reddy Battula
        3. HDFS-10810-003.patch
          5 kB
          Brahma Reddy Battula
        4. HDFS-10810-branch-2.patch
          5 kB
          Brahma Reddy Battula

        Issue Links

          Activity

            People

              brahmareddy Brahma Reddy Battula
              brahmareddy Brahma Reddy Battula
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: