Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1623 High Availability Framework for HDFS NN
  3. HDFS-2973

HA: re-enable NO_ACK optimization for block deletion

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: HA branch (HDFS-1623)
    • Fix Version/s: HA branch (HDFS-1623)
    • Component/s: ha, namenode
    • Labels:
      None

      Description

      Currently in trunk, when a file is removed, the deletion request is sent to the DNs with a special NO_ACK flag to indicate that they don't need to ACK the deletion. The NN itself takes care of removing the blocks from the block map, so the deletion report would be redundant.
      In the HA branch, we disabled this to fix a failure in TestSafeMode – when the active NN issues a block deletion, and the standby hasn't read the edits yet, this test case expects that it would see the block deletions.
      I don't see any actual compelling reasons for this. I think we can restore the optimization and modify the test to pass.

        Attachments

        1. hdfs-2973.txt
          4 kB
          Todd Lipcon

          Issue Links

            Activity

              People

              • Assignee:
                tlipcon Todd Lipcon
                Reporter:
                tlipcon Todd Lipcon
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: