Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9761

Rebalancer sleeps too long between iterations

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: balancer & mover
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Whilst reading the code to try and determine why I'm seeing bad performance I think I've spotted an inadvertent move of a sleep() to inside a for loop.

      This means that instead of sleeping once per iteration the balance is sleeping once per namenode per iteration. If I've done my maths correctly the sleep time default is 18seconds so this is a nice little speedup for HA clusters.

      Commit d31a41c35927f02f2fb40d19380b5df4bb2b6d57 moved the sleep in org/apache/hadoop/hdfs/server/balancer/Balancer.java:run()

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                liuml07 Mingliang Liu
                Reporter:
                abridgett Adrian Bridgett
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: