Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7211

Block invalidation work should be ordered

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.5.1
    • None
    • namenode
    • None

    Description

      InvalidateBlocks#node2blocks uses an unordered LightWeightHashSet to store blocks (to be invalidated) on the same DN. This causes poor ordering when a single DN has a large number of blocks to invalidate. Blocks should be invalidated following the order of invalidation commands – at least roughly.

      Attachments

        Issue Links

          is required by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-7225 Remove stale block invalidation work when DN re-registers with different UUID

          • Major - Major loss of function.
          • Closed

          Activity

            People

              zhz Zhe Zhang
              zhz Zhe Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: