Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11310

Reduce the performance impact of the balancer (trunk port)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • 3.0.0-alpha1
    • None
    • hdfs, namenode
    • None

    Description

      HDFS-7967 introduced a highly performant balancer getBlocks() query that scales to large/dense clusters. The simple design implementation depends on the triplets data structure. HDFS-9260 removed the triplets which fundamentally changes the implementation. Either that patch must be reverted or the getBlocks() patch needs reimplementation.

      Attachments

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HDFS-7967 Reduce the performance impact of the balancer

          • Critical - Crashes, loss of data, severe memory leak.
          • Patch Available

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-9260 Improve the performance and GC friendliness of NameNode startup and full block reports

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              daryn Daryn Sharp
              Votes:
              0 Vote for this issue
              Watchers:
              17 Start watching this issue

              Dates

                Created:
                Updated: