Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-82

recentInvalidateSets in FSNamesystem is not required

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • None
    • None
    • None
    • None

    Description

      See HADOOP-2576 for more background.

      When a file is deleted, blocks are first placed in recentInvalidateSets and then later computeDatanodeWork moves it to 'invalidateSet' for each datanode.

      I could not see why a block is placed in this intermediate set. I think it is confusing as well.. for example, -metasave prints blocks from only one list. Unless we read very carefully its not easy to figure out that there are two lists. My proposal is to keep only one of them.

      Attachments

        Issue Links

          is superceded by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-2729 Update BlockManager's comments regarding the invalid block set

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              Unassigned Unassigned
              rangadi Raghu Angadi
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: