Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1623 High Availability Framework for HDFS NN
  3. HDFS-2973

HA: re-enable NO_ACK optimization for block deletion

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • HA branch (HDFS-1623)
    • HA branch (HDFS-1623)
    • ha, namenode
    • None

    Description

      Currently in trunk, when a file is removed, the deletion request is sent to the DNs with a special NO_ACK flag to indicate that they don't need to ACK the deletion. The NN itself takes care of removing the blocks from the block map, so the deletion report would be redundant.
      In the HA branch, we disabled this to fix a failure in TestSafeMode – when the active NN issues a block deletion, and the standby hasn't read the edits yet, this test case expects that it would see the block deletions.
      I don't see any actual compelling reasons for this. I think we can restore the optimization and modify the test to pass.

      Attachments

        1. hdfs-2973.txt
          4 kB
          Todd Lipcon

        Issue Links

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: