Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-381

Datanode should report deletion of blocks to Namenode explicitly

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None

    Description

      Currently datanode notifies namenode newly added blocks and the blocks that are corrupt. There is no explicit message from the datanode to the namenode to indicate the deletion of blocks. Block reports from the datanode is the only way for the namenode to learn about the deletion of blocks at a datanode. With the addition of explicit request to indicate to block deletion, block report interval (which is currently 1 hour) can be increased to a longer duration. This reduces load on both namenode and datanodes.

      Attachments

        1. HDFS-381.patch
          4 kB
          Raghu Angadi
        2. blockdel-2.patch
          4 kB
          Suresh Srinivas
        3. blockdel-1.patch
          3 kB
          Suresh Srinivas
        4. blockdel.patch
          24 kB
          Suresh Srinivas
        5. blockdel.patch
          24 kB
          Suresh Srinivas

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sureshms Suresh Srinivas
            sureshms Suresh Srinivas
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment