Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8825 Enhancements to Balancer
  3. HDFS-8890

Allow admin to specify which blockpools the balancer should run on

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: balancer & mover
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Adds a new blockpools flag to the balancer. This allows admins to specify which blockpools the balancer will run on.
      Usage:
      -blockpools <comma-separated list of blockpool ids>
      The balancer will only run on blockpools included in this list.
      Show
      Adds a new blockpools flag to the balancer. This allows admins to specify which blockpools the balancer will run on. Usage: -blockpools <comma-separated list of blockpool ids> The balancer will only run on blockpools included in this list.

      Description

      Currently the balancer runs on all blockpools. Allow an admin to run the balancer on a set of blockpools. This will enable the balancer to skip blockpools that should not be balanced. For example, a tmp blockpool that has a large amount of churn.

      An example of the command line interface would be an additional flag that specifies the blockpools by id:

      -blockpools BP-6299761-10.55.116.188-1415904647555,BP-47348528-10.51.120.139-1415904199257

      1. HDFS-8890-trunk-v1.patch
        21 kB
        Chris Trezzo
      2. HDFS-8890-trunk-v2.patch
        24 kB
        Chris Trezzo
      3. HDFS-8890-trunk-v3.patch
        24 kB
        Chris Trezzo
      4. HDFS-8890-trunk-v4.patch
        26 kB
        Chris Trezzo

        Issue Links

          Activity

          Hide
          szetszwo Tsz Wo Nicholas Sze added a comment -

          We probably already have this feature since we can specify paths when running Balancer.

          Show
          szetszwo Tsz Wo Nicholas Sze added a comment - We probably already have this feature since we can specify paths when running Balancer.
          Hide
          szetszwo Tsz Wo Nicholas Sze added a comment -

          Oops, my previous comment is incorrect. Mixing something up.

          Show
          szetszwo Tsz Wo Nicholas Sze added a comment - Oops, my previous comment is incorrect. Mixing something up.
          Hide
          ctrezzo Chris Trezzo added a comment -

          Ming Ma Attached is v1 patch for trunk.

          Balancer tests pass successfully. I will submit patch to get an HadoopQA run.

          Show
          ctrezzo Chris Trezzo added a comment - Ming Ma Attached is v1 patch for trunk. Balancer tests pass successfully. I will submit patch to get an HadoopQA run.
          Hide
          ctrezzo Chris Trezzo added a comment -

          Unfortunate timing with respect to commits. Resolving conflicts with patch and will post v2.

          Show
          ctrezzo Chris Trezzo added a comment - Unfortunate timing with respect to commits. Resolving conflicts with patch and will post v2.
          Hide
          ctrezzo Chris Trezzo added a comment -

          V2 attached.

          Show
          ctrezzo Chris Trezzo added a comment - V2 attached.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          -1 pre-patch 16m 12s Findbugs (version ) appears to be broken on trunk.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 2 new or modified test files.
          +1 javac 8m 10s There were no new javac warning messages.
          +1 javadoc 10m 11s There were no new javadoc warning messages.
          +1 release audit 0m 26s The applied patch does not increase the total number of release audit warnings.
          +1 checkstyle 0m 33s There were no new checkstyle issues.
          -1 whitespace 0m 1s The patch has 3 line(s) that end in whitespace. Use git apply --whitespace=fix.
          +1 install 1m 39s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 2m 39s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 20s Pre-build of native portion
          -1 hdfs tests 173m 56s Tests failed in hadoop-hdfs.
              217m 45s  



          Reason Tests
          Failed unit tests hadoop.hdfs.TestWriteBlockGetsBlockLengthHint
          Timed out tests org.apache.hadoop.hdfs.server.balancer.TestBalancer



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12751316/HDFS-8890-trunk-v2.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / 3aac475
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12046/artifact/patchprocess/whitespace.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12046/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12046/testReport/
          Java 1.7.0_55
          uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12046/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 16m 12s Findbugs (version ) appears to be broken on trunk. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 2 new or modified test files. +1 javac 8m 10s There were no new javac warning messages. +1 javadoc 10m 11s There were no new javadoc warning messages. +1 release audit 0m 26s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 0m 33s There were no new checkstyle issues. -1 whitespace 0m 1s The patch has 3 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 39s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 2m 39s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 20s Pre-build of native portion -1 hdfs tests 173m 56s Tests failed in hadoop-hdfs.     217m 45s   Reason Tests Failed unit tests hadoop.hdfs.TestWriteBlockGetsBlockLengthHint Timed out tests org.apache.hadoop.hdfs.server.balancer.TestBalancer Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12751316/HDFS-8890-trunk-v2.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 3aac475 whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12046/artifact/patchprocess/whitespace.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12046/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12046/testReport/ Java 1.7.0_55 uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12046/console This message was automatically generated.
          Hide
          ctrezzo Chris Trezzo added a comment -

          Ming Ma V3 attached.

          1. Fixed whitespace.
          2. Ran TestBalancer locally and it passed fine.
          Show
          ctrezzo Chris Trezzo added a comment - Ming Ma V3 attached. Fixed whitespace. Ran TestBalancer locally and it passed fine.
          Hide
          mingma Ming Ma added a comment -

          +1 pending jenkins run. Thanks Chris Trezzo!

          Chris and I discussed if the command should uses nameservice id instead of block pool id. Although nameservice id is more descriptive, balancer is used by admins only and block pool id has been used in command "hdfs dfsadmin -deleteBlockPool".

          Show
          mingma Ming Ma added a comment - +1 pending jenkins run. Thanks Chris Trezzo ! Chris and I discussed if the command should uses nameservice id instead of block pool id. Although nameservice id is more descriptive, balancer is used by admins only and block pool id has been used in command "hdfs dfsadmin -deleteBlockPool".
          Hide
          szetszwo Tsz Wo Nicholas Sze added a comment -

          We should also update hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md . See if you want to do it here or in HDFS-8923. Thanks for working on this.

          Show
          szetszwo Tsz Wo Nicholas Sze added a comment - We should also update hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md . See if you want to do it here or in HDFS-8923 . Thanks for working on this.
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 17m 56s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 2 new or modified test files.
          +1 javac 7m 54s There were no new javac warning messages.
          +1 javadoc 10m 9s There were no new javadoc warning messages.
          +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
          -1 checkstyle 1m 22s The applied patch generated 2 new checkstyle issues (total was 46, now 48).
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 27s mvn install still works.
          +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
          +1 findbugs 2m 28s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 11s Pre-build of native portion
          -1 hdfs tests 162m 9s Tests failed in hadoop-hdfs.
              207m 36s  



          Reason Tests
          Failed unit tests hadoop.hdfs.web.TestWebHDFSOAuth2



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12753625/HDFS-8890-trunk-v3.patch
          Optional Tests javadoc javac unit findbugs checkstyle
          git revision trunk / 4620767
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/12238/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12238/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12238/testReport/
          Java 1.7.0_55
          uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12238/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 17m 56s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 2 new or modified test files. +1 javac 7m 54s There were no new javac warning messages. +1 javadoc 10m 9s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 1m 22s The applied patch generated 2 new checkstyle issues (total was 46, now 48). +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 27s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 2m 28s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 11s Pre-build of native portion -1 hdfs tests 162m 9s Tests failed in hadoop-hdfs.     207m 36s   Reason Tests Failed unit tests hadoop.hdfs.web.TestWebHDFSOAuth2 Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12753625/HDFS-8890-trunk-v3.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 4620767 checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/12238/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12238/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12238/testReport/ Java 1.7.0_55 uname Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12238/console This message was automatically generated.
          Hide
          mingma Ming Ma added a comment -

          Thanks Tsz Wo Nicholas Sze for catching HDFSCommands.md.

          Show
          mingma Ming Ma added a comment - Thanks Tsz Wo Nicholas Sze for catching HDFSCommands.md.
          Hide
          ctrezzo Chris Trezzo added a comment -

          Thanks Tsz Wo Nicholas Sze and Ming Ma.

          Attached is V4 that fixes the markdown.

          Show
          ctrezzo Chris Trezzo added a comment - Thanks Tsz Wo Nicholas Sze and Ming Ma . Attached is V4 that fixes the markdown.
          Hide
          ctrezzo Chris Trezzo added a comment -

          Also note that the two checkstyle warnings remain consistent with the current code. If we want to fix these, we can file a follow on JIRA to fix the Balancer#Parameters class as a whole.

          Show
          ctrezzo Chris Trezzo added a comment - Also note that the two checkstyle warnings remain consistent with the current code. If we want to fix these, we can file a follow on JIRA to fix the Balancer#Parameters class as a whole.
          Hide
          ctrezzo Chris Trezzo added a comment -

          For more details:

          1. First warning is complaining about the blockpools instance variable in Balancer#Parameters not being private and not having accessor methods. All of the other variables in the class are like this.
          2. The second one is complaining about the Balancer#Parameters constructor having too many parameters. Currently all of the instance variables are final. We could rewrite that Balancer#Parameters class to use a builder pattern with non-final member variables.

          I can file a jira to address both of these.

          Show
          ctrezzo Chris Trezzo added a comment - For more details: First warning is complaining about the blockpools instance variable in Balancer#Parameters not being private and not having accessor methods. All of the other variables in the class are like this. The second one is complaining about the Balancer#Parameters constructor having too many parameters. Currently all of the instance variables are final. We could rewrite that Balancer#Parameters class to use a builder pattern with non-final member variables. I can file a jira to address both of these.
          Hide
          ctrezzo Chris Trezzo added a comment -

          Jira filed: HDFS-9008

          Show
          ctrezzo Chris Trezzo added a comment - Jira filed: HDFS-9008
          Hide
          hadoopqa Hadoop QA added a comment -



          -1 overall



          Vote Subsystem Runtime Comment
          0 pre-patch 21m 7s Pre-patch trunk compilation is healthy.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 tests included 0m 0s The patch appears to include 2 new or modified test files.
          +1 javac 7m 53s There were no new javac warning messages.
          +1 javadoc 10m 10s There were no new javadoc warning messages.
          +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings.
          +1 site 3m 0s Site still builds.
          -1 checkstyle 1m 21s The applied patch generated 2 new checkstyle issues (total was 45, now 47).
          +1 whitespace 0m 1s The patch has no lines that end in whitespace.
          +1 install 1m 26s mvn install still works.
          +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
          +1 findbugs 2m 26s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
          +1 native 3m 9s Pre-build of native portion
          -1 hdfs tests 162m 23s Tests failed in hadoop-hdfs.
              213m 54s  



          Reason Tests
          Failed unit tests hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
            hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold



          Subsystem Report/Notes
          Patch URL http://issues.apache.org/jira/secure/attachment/12753824/HDFS-8890-trunk-v4.patch
          Optional Tests javadoc javac unit findbugs checkstyle site
          git revision trunk / 7d6687f
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/12254/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt
          hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12254/artifact/patchprocess/testrun_hadoop-hdfs.txt
          Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12254/testReport/
          Java 1.7.0_55
          uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12254/console

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 21m 7s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 2 new or modified test files. +1 javac 7m 53s There were no new javac warning messages. +1 javadoc 10m 10s There were no new javadoc warning messages. +1 release audit 0m 22s The applied patch does not increase the total number of release audit warnings. +1 site 3m 0s Site still builds. -1 checkstyle 1m 21s The applied patch generated 2 new checkstyle issues (total was 45, now 47). +1 whitespace 0m 1s The patch has no lines that end in whitespace. +1 install 1m 26s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 2m 26s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 9s Pre-build of native portion -1 hdfs tests 162m 23s Tests failed in hadoop-hdfs.     213m 54s   Reason Tests Failed unit tests hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   hadoop.hdfs.server.datanode.TestDnRespectsBlockReportSplitThreshold Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12753824/HDFS-8890-trunk-v4.patch Optional Tests javadoc javac unit findbugs checkstyle site git revision trunk / 7d6687f checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/12254/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12254/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12254/testReport/ Java 1.7.0_55 uname Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12254/console This message was automatically generated.
          Hide
          mingma Ming Ma added a comment -

          +1 on the latest patch. I have committed it to trunk and branch-2. Thanks Chris Trezzo for the contribution and Tsz Wo Nicholas Sze for the review.

          Show
          mingma Ming Ma added a comment - +1 on the latest patch. I have committed it to trunk and branch-2. Thanks Chris Trezzo for the contribution and Tsz Wo Nicholas Sze for the review.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #8391 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8391/)
          HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8391 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8391/ ) HDFS-8890 . Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #344 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/344/)
          HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #344 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/344/ ) HDFS-8890 . Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk #2286 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2286/)
          HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57)

          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2286 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2286/ ) HDFS-8890 . Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #1073 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1073/)
          HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #1073 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1073/ ) HDFS-8890 . Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #327 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/327/)
          HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57)

          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #327 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/327/ ) HDFS-8890 . Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57) hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #338 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/338/)
          HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57)

          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #338 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/338/ ) HDFS-8890 . Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-Hdfs-trunk #2266 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2266/)
          HDFS-8890. Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57)

          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java
          • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2266 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2266/ ) HDFS-8890 . Allow admin to specify which blockpools the balancer should run on. (Chris Trezzo via mingma) (mingma: rev d31a41c35927f02f2fb40d19380b5df4bb2b6d57) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Balancer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancer.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/balancer/TestBalancerWithMultipleNameNodes.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
          Hide
          liuml07 Mingliang Liu added a comment -

          Hi Ming Ma and Chris Trezzo, can you comment on HDFS-9761? Thanks.

          Show
          liuml07 Mingliang Liu added a comment - Hi Ming Ma and Chris Trezzo , can you comment on HDFS-9761 ? Thanks.

            People

            • Assignee:
              ctrezzo Chris Trezzo
              Reporter:
              ctrezzo Chris Trezzo
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development