[HDFS-9100] HDFS Balancer does not respect dfs.client.use.datanode.hostname - ASF JIRA

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 2.8.0, 3.0.0-alpha1
Component/s: balancer & mover
Labels:
None

Hadoop Flags:

Reviewed

Description

In Balancer Dispatch.java:

   private void dispatch() {
      LOG.info("Start moving " + this);

      Socket sock = new Socket();
      DataOutputStream out = null;
      DataInputStream in = null;
      try {
        sock.connect(
            NetUtils.createSocketAddr(target.getDatanodeInfo().getXferAddr()),
            HdfsConstants.READ_TIMEOUT);

getXferAddr() is called without taking into consideration of dfs.client.use.datanode.hostname setting, this would possibly fail balancer run issued from outside a cluster.

Thanks Casey Brotherton for reporting the issue.

Options
- Sort By Name
- Sort By Date
- Ascending
- Descending

Attachments

HDFS-9100.000.patch

23/Sep/15 12:14

2 kB

Casey Brotherton
HDFS-9100.001.patch

24/Sep/15 02:56

2 kB

Casey Brotherton
HDFS-9100.002.patch

29/Sep/15 02:45

2 kB

Casey Brotherton
HDFS-9100.003.patch

29/Sep/15 14:34

2 kB

Casey Brotherton

Activity

Ascending order - Click to sort in descending order

Hide

Permalink

Yongjun Zhang added a comment - 18/Sep/15 05:38

Assigning to Casey Brotherton since he is working on it. Thanks Casey.

Show

Yongjun Zhang added a comment - 18/Sep/15 05:38 Assigning to Casey Brotherton since he is working on it. Thanks Casey.

Hide

Permalink

Casey Brotherton added a comment - 23/Sep/15 12:14

Still testing in my lab. A unit test with multiple networks is difficult.
Will change to patch-available once I finished testing

Show

Casey Brotherton added a comment - 23/Sep/15 12:14 Still testing in my lab. A unit test with multiple networks is difficult. Will change to patch-available once I finished testing

Hide

Permalink

Casey Brotherton added a comment - 23/Sep/15 13:10

Created a multi-node cluster with multi-homed networks.

Created one of the nodes with only one ip address, on the subnet
that was not the primary network of the other hosts in the cluster.

Verified that without appropriate configuration, the lone node
could not send data to datanodes.

Confirmed that changing dfs.client.use.datanode.hostname allowed the
lone node to put and read from the datanodes.

Placed data within the HDFS cluster in an unbalanced way. ( dfs.replication=1 on one datanode,
with minimal data spread across two datanodes with dfs.replication=2)

Running the balancer from the lone node causes these errors:
15/09/23 06:07:04 WARN balancer.Dispatcher: Failed to move blk_1073742600_1776 with size=4128368 from 10.17.74.156:50010:DISK to 10.17.74.158:50010:DISK through 10.17.74.156:50010: Network is unreachable

After the changes, the balancer worked. The logging still showed the IP address.
15/09/23 06:05:38 INFO balancer.Dispatcher: Successfully moved blk_1073742139_1315 with size=4128368 from 10.17.74.156:50010:DISK to 10.17.74.158:50010:DISK through 10.17.74.156:50010

This did not test a large environment, where blocks were moved by proxy, although I don't believe that would cause any problems.

Show

Casey Brotherton added a comment - 23/Sep/15 13:10 Created a multi-node cluster with multi-homed networks. Created one of the nodes with only one ip address, on the subnet that was not the primary network of the other hosts in the cluster. Verified that without appropriate configuration, the lone node could not send data to datanodes. Confirmed that changing dfs.client.use.datanode.hostname allowed the lone node to put and read from the datanodes. Placed data within the HDFS cluster in an unbalanced way. ( dfs.replication=1 on one datanode, with minimal data spread across two datanodes with dfs.replication=2) Running the balancer from the lone node causes these errors: 15/09/23 06:07:04 WARN balancer.Dispatcher: Failed to move blk_1073742600_1776 with size=4128368 from 10.17.74.156:50010:DISK to 10.17.74.158:50010:DISK through 10.17.74.156:50010: Network is unreachable After the changes, the balancer worked. The logging still showed the IP address. 15/09/23 06:05:38 INFO balancer.Dispatcher: Successfully moved blk_1073742139_1315 with size=4128368 from 10.17.74.156:50010:DISK to 10.17.74.158:50010:DISK through 10.17.74.156:50010 This did not test a large environment, where blocks were moved by proxy, although I don't believe that would cause any problems.

Hide

Permalink

Hadoop QA added a comment - 23/Sep/15 17:28

-1 overall

Vote	Subsystem	Runtime	Comment
0	pre-patch	17m 55s	Pre-patch trunk compilation is healthy.
+1	@author	0m 0s	The patch does not contain any @author tags.
-1	tests included	0m 0s	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
-1	javac	7m 58s	The applied patch generated 2 additional warning messages.
+1	javadoc	10m 12s	There were no new javadoc warning messages.
+1	release audit	0m 25s	The applied patch does not increase the total number of release audit warnings.
-1	checkstyle	1m 25s	The applied patch generated 1 new checkstyle issues (total was 46, now 47).
-1	whitespace	0m 0s	The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix.
+1	install	1m 31s	mvn install still works.
+1	eclipse:eclipse	0m 35s	The patch built with eclipse:eclipse.
+1	findbugs	2m 32s	The patch does not introduce any new Findbugs (version 3.0.0) warnings.
+1	native	3m 20s	Pre-build of native portion
-1	hdfs tests	193m 30s	Tests failed in hadoop-hdfs.
		239m 27s

Reason	Tests
Failed unit tests	hadoop.hdfs.server.namenode.TestFileTruncate

Subsystem	Report/Notes
Patch URL	http://issues.apache.org/jira/secure/attachment/12761884/HDFS-9100.000.patch
Optional Tests	javadoc javac unit findbugs checkstyle
git revision	trunk / a2c76e5
javac	https://builds.apache.org/job/PreCommit-HDFS-Build/12622/artifact/patchprocess/diffJavacWarnings.txt
checkstyle	https://builds.apache.org/job/PreCommit-HDFS-Build/12622/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt
whitespace	https://builds.apache.org/job/PreCommit-HDFS-Build/12622/artifact/patchprocess/whitespace.txt
hadoop-hdfs test log	https://builds.apache.org/job/PreCommit-HDFS-Build/12622/artifact/patchprocess/testrun_hadoop-hdfs.txt
Test Results	https://builds.apache.org/job/PreCommit-HDFS-Build/12622/testReport/
Java	1.7.0_55
uname	Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
Console output	https://builds.apache.org/job/PreCommit-HDFS-Build/12622/console

This message was automatically generated.

Show

Hadoop QA added a comment - 23/Sep/15 17:28 -1 overall Vote Subsystem Runtime Comment 0 pre-patch 17m 55s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. -1 javac 7m 58s The applied patch generated 2 additional warning messages. +1 javadoc 10m 12s There were no new javadoc warning messages. +1 release audit 0m 25s The applied patch does not increase the total number of release audit warnings. -1 checkstyle 1m 25s The applied patch generated 1 new checkstyle issues (total was 46, now 47). -1 whitespace 0m 0s The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix. +1 install 1m 31s mvn install still works. +1 eclipse:eclipse 0m 35s The patch built with eclipse:eclipse. +1 findbugs 2m 32s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 20s Pre-build of native portion -1 hdfs tests 193m 30s Tests failed in hadoop-hdfs. 239m 27s Reason Tests Failed unit tests hadoop.hdfs.server.namenode.TestFileTruncate Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12761884/HDFS-9100.000.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / a2c76e5 javac https://builds.apache.org/job/PreCommit-HDFS-Build/12622/artifact/patchprocess/diffJavacWarnings.txt checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/12622/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/12622/artifact/patchprocess/whitespace.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12622/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12622/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12622/console This message was automatically generated.

Hide

Permalink

Casey Brotherton added a comment - 24/Sep/15 02:56

Fixed the whitespace, and line length, and deprecation change

Show

Casey Brotherton added a comment - 24/Sep/15 02:56 Fixed the whitespace, and line length, and deprecation change

Hide

Permalink

Hadoop QA added a comment - 24/Sep/15 05:51

-1 overall

Vote	Subsystem	Runtime	Comment
0	pre-patch	18m 17s	Pre-patch trunk compilation is healthy.
+1	@author	0m 0s	The patch does not contain any @author tags.
-1	tests included	0m 0s	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
+1	javac	8m 0s	There were no new javac warning messages.
+1	javadoc	10m 3s	There were no new javadoc warning messages.
+1	release audit	0m 23s	The applied patch does not increase the total number of release audit warnings.
+1	checkstyle	1m 24s	There were no new checkstyle issues.
+1	whitespace	0m 0s	The patch has no lines that end in whitespace.
+1	install	1m 27s	mvn install still works.
+1	eclipse:eclipse	0m 32s	The patch built with eclipse:eclipse.
+1	findbugs	2m 35s	The patch does not introduce any new Findbugs (version 3.0.0) warnings.
+1	native	3m 14s	Pre-build of native portion
-1	hdfs tests	126m 36s	Tests failed in hadoop-hdfs.
		172m 34s

Reason	Tests
Failed unit tests	hadoop.hdfs.server.namenode.TestSecondaryWebUi
	hadoop.hdfs.TestHFlush
Timed out tests	org.apache.hadoop.hdfs.server.namenode.TestSnapshotPathINodes

Subsystem	Report/Notes
Patch URL	http://issues.apache.org/jira/secure/attachment/12762042/HDFS-9100.001.patch
Optional Tests	javadoc javac unit findbugs checkstyle
git revision	trunk / 06d1c90
hadoop-hdfs test log	https://builds.apache.org/job/PreCommit-HDFS-Build/12651/artifact/patchprocess/testrun_hadoop-hdfs.txt
Test Results	https://builds.apache.org/job/PreCommit-HDFS-Build/12651/testReport/
Java	1.7.0_55
uname	Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
Console output	https://builds.apache.org/job/PreCommit-HDFS-Build/12651/console

This message was automatically generated.

Show

Hadoop QA added a comment - 24/Sep/15 05:51 -1 overall Vote Subsystem Runtime Comment 0 pre-patch 18m 17s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 8m 0s There were no new javac warning messages. +1 javadoc 10m 3s There were no new javadoc warning messages. +1 release audit 0m 23s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 1m 24s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 27s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 2m 35s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 14s Pre-build of native portion -1 hdfs tests 126m 36s Tests failed in hadoop-hdfs. 172m 34s Reason Tests Failed unit tests hadoop.hdfs.server.namenode.TestSecondaryWebUi hadoop.hdfs.TestHFlush Timed out tests org.apache.hadoop.hdfs.server.namenode.TestSnapshotPathINodes Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12762042/HDFS-9100.001.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 06d1c90 hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12651/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12651/testReport/ Java 1.7.0_55 uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12651/console This message was automatically generated.

Hide

Permalink

Casey Brotherton added a comment - 25/Sep/15 15:10

Hello
hdfs tests were related to hflush, and secondary namenode webui. Both of which I didn't change.

Should I re-publish the patch to see if those tests resolve?

Thanks,
Casey

Show

Casey Brotherton added a comment - 25/Sep/15 15:10 Hello hdfs tests were related to hflush, and secondary namenode webui. Both of which I didn't change. Should I re-publish the patch to see if those tests resolve? Thanks, Casey

Hide

Permalink

Yongjun Zhang added a comment - 25/Sep/15 18:15

Hi Casey Brotherton,

Thanks for the patch and the cluster testing. The patch looks good to me, two very minor cosmetic comments:

1. Change order of the following two lines:

import org.apache.hadoop.hdfs.client.HdfsClientConfigKeys;
import org.apache.hadoop.hdfs.DistributedFileSystem;

2. When a line is wrapped, the indention of the newline need to be 4 spaces per
the coding guideline, like:

            NetUtils.createSocketAddr(target.getDatanodeInfo().
                getXferAddr(Dispatcher.this.connectToDnViaHostname)),
                HdfsConstants.READ_TIMEOUT);

Thanks.

Show

Yongjun Zhang added a comment - 25/Sep/15 18:15 Hi Casey Brotherton , Thanks for the patch and the cluster testing. The patch looks good to me, two very minor cosmetic comments: 1. Change order of the following two lines: import org.apache.hadoop.hdfs.client.HdfsClientConfigKeys; import org.apache.hadoop.hdfs.DistributedFileSystem; 2. When a line is wrapped, the indention of the newline need to be 4 spaces per the coding guideline, like: NetUtils.createSocketAddr(target.getDatanodeInfo(). getXferAddr(Dispatcher. this .connectToDnViaHostname)), HdfsConstants.READ_TIMEOUT); Thanks.

Hide

Permalink

Casey Brotherton added a comment - 29/Sep/15 02:45

Thank you for the review, Yongjun Zhang

I have made the changes and uploaded a new patch file.

Show

Casey Brotherton added a comment - 29/Sep/15 02:45 Thank you for the review, Yongjun Zhang I have made the changes and uploaded a new patch file.

Hide

Permalink

Hadoop QA added a comment - 29/Sep/15 02:58

-1 overall

Vote	Subsystem	Runtime	Comment
-1	patch	0m 0s	The patch command could not apply the patch during dryrun.

Subsystem	Report/Notes
Patch URL	http://issues.apache.org/jira/secure/attachment/12764163/HDFS-9100.002.patch
Optional Tests	javadoc javac unit findbugs checkstyle
git revision	trunk / 151fca5
Console output	https://builds.apache.org/job/PreCommit-HDFS-Build/12727/console

This message was automatically generated.

Show

Hadoop QA added a comment - 29/Sep/15 02:58 -1 overall Vote Subsystem Runtime Comment -1 patch 0m 0s The patch command could not apply the patch during dryrun. Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12764163/HDFS-9100.002.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 151fca5 Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12727/console This message was automatically generated.

Hide

Permalink

Casey Brotherton added a comment - 29/Sep/15 04:11

I am sorry, the failure appears to be due to changes with ~~HDFS-8053~~.

Will reapply the patch, and run tests tonight.

Show

Casey Brotherton added a comment - 29/Sep/15 04:11 I am sorry, the failure appears to be due to changes with HDFS-8053 . Will reapply the patch, and run tests tonight.

Hide

Permalink

Yongjun Zhang added a comment - 29/Sep/15 15:10

Thanks Casey Brotherton. +1 on rev3 pending jenkins test.

Show

Yongjun Zhang added a comment - 29/Sep/15 15:10 Thanks Casey Brotherton . +1 on rev3 pending jenkins test.

Hide

Permalink

Hadoop QA added a comment - 29/Sep/15 18:46

-1 overall

Vote	Subsystem	Runtime	Comment
-1	pre-patch	18m 13s	Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings.
+1	@author	0m 0s	The patch does not contain any @author tags.
-1	tests included	0m 0s	The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
+1	javac	8m 5s	There were no new javac warning messages.
+1	javadoc	10m 12s	There were no new javadoc warning messages.
+1	release audit	0m 24s	The applied patch does not increase the total number of release audit warnings.
+1	checkstyle	1m 24s	There were no new checkstyle issues.
+1	whitespace	0m 0s	The patch has no lines that end in whitespace.
+1	install	1m 27s	mvn install still works.
+1	eclipse:eclipse	0m 34s	The patch built with eclipse:eclipse.
+1	findbugs	2m 28s	The patch does not introduce any new Findbugs (version 3.0.0) warnings.
+1	native	3m 18s	Pre-build of native portion
-1	hdfs tests	168m 1s	Tests failed in hadoop-hdfs.
		214m 10s

Reason	Tests
Failed unit tests	hadoop.hdfs.server.datanode.TestDirectoryScanner

Subsystem	Report/Notes
Patch URL	http://issues.apache.org/jira/secure/attachment/12764250/HDFS-9100.003.patch
Optional Tests	javadoc javac unit findbugs checkstyle
git revision	trunk / 715dbdd
Pre-patch Findbugs warnings	https://builds.apache.org/job/PreCommit-HDFS-Build/12741/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
hadoop-hdfs test log	https://builds.apache.org/job/PreCommit-HDFS-Build/12741/artifact/patchprocess/testrun_hadoop-hdfs.txt
Test Results	https://builds.apache.org/job/PreCommit-HDFS-Build/12741/testReport/
Java	1.7.0_55
uname	Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
Console output	https://builds.apache.org/job/PreCommit-HDFS-Build/12741/console

This message was automatically generated.

Show

Hadoop QA added a comment - 29/Sep/15 18:46 -1 overall Vote Subsystem Runtime Comment -1 pre-patch 18m 13s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 8m 5s There were no new javac warning messages. +1 javadoc 10m 12s There were no new javadoc warning messages. +1 release audit 0m 24s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 1m 24s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 27s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 2m 28s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 18s Pre-build of native portion -1 hdfs tests 168m 1s Tests failed in hadoop-hdfs. 214m 10s Reason Tests Failed unit tests hadoop.hdfs.server.datanode.TestDirectoryScanner Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12764250/HDFS-9100.003.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 715dbdd Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/12741/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12741/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12741/testReport/ Java 1.7.0_55 uname Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12741/console This message was automatically generated.

Hide

Permalink

Casey Brotherton added a comment - 29/Sep/15 19:02

Patch is limited to Dispatcher.java

pre-patch concerns shows something with:
org.apache.hadoop.hdfs.server.datanode.DirectoryScanner

Test log failure was with:
org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner

Not sure what the issue is.

Show

Casey Brotherton added a comment - 29/Sep/15 19:02 Patch is limited to Dispatcher.java pre-patch concerns shows something with: org.apache.hadoop.hdfs.server.datanode.DirectoryScanner Test log failure was with: org.apache.hadoop.hdfs.server.datanode.TestDirectoryScanner Not sure what the issue is.

Hide

Permalink

Yongjun Zhang added a comment - 02/Oct/15 18:49

Sorry for the delay, will commit momentarily.

Show

Yongjun Zhang added a comment - 02/Oct/15 18:49 Sorry for the delay, will commit momentarily.

Hide

Permalink

Hudson added a comment - 02/Oct/15 19:15

FAILURE: Integrated in Hadoop-trunk-Commit #8558 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8558/)
~~HDFS-9100~~. HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b)

hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java

Show

Hudson added a comment - 02/Oct/15 19:15 FAILURE: Integrated in Hadoop-trunk-Commit #8558 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8558/ ) HDFS-9100 . HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java

Hide

Permalink

Yongjun Zhang added a comment - 02/Oct/15 19:15

I committed to trunk and branch-2. Thanks Casey for the contribution!

Show

Yongjun Zhang added a comment - 02/Oct/15 19:15 I committed to trunk and branch-2. Thanks Casey for the contribution!

Hide

Permalink

Hudson added a comment - 02/Oct/15 20:13

FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #446 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/446/)
~~HDFS-9100~~. HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b)

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

Show

Hudson added a comment - 02/Oct/15 20:13 FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #446 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/446/ ) HDFS-9100 . HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

Hide

Permalink

Hudson added a comment - 02/Oct/15 20:19

FAILURE: Integrated in Hadoop-Mapreduce-trunk #2416 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2416/)
~~HDFS-9100~~. HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b)

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

Show

Hudson added a comment - 02/Oct/15 20:19 FAILURE: Integrated in Hadoop-Mapreduce-trunk #2416 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2416/ ) HDFS-9100 . HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

Hide

Permalink

Hudson added a comment - 02/Oct/15 21:36

FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #481 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/481/)
~~HDFS-9100~~. HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b)

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

Show

Hudson added a comment - 02/Oct/15 21:36 FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #481 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/481/ ) HDFS-9100 . HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b) hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

Hide

Permalink

Hudson added a comment - 02/Oct/15 21:48

SUCCESS: Integrated in Hadoop-Yarn-trunk #1211 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1211/)
~~HDFS-9100~~. HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b)

hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java

Show

Hudson added a comment - 02/Oct/15 21:48 SUCCESS: Integrated in Hadoop-Yarn-trunk #1211 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1211/ ) HDFS-9100 . HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java

Hide

Permalink

Hudson added a comment - 02/Oct/15 22:32

FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #473 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/473/)
~~HDFS-9100~~. HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b)

hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java

Show

Hudson added a comment - 02/Oct/15 22:32 FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #473 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/473/ ) HDFS-9100 . HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java

Hide

Permalink

Hudson added a comment - 02/Oct/15 23:16

FAILURE: Integrated in Hadoop-Hdfs-trunk #2386 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2386/)
~~HDFS-9100~~. HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b)

hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java

Show

Hudson added a comment - 02/Oct/15 23:16 FAILURE: Integrated in Hadoop-Hdfs-trunk #2386 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2386/ ) HDFS-9100 . HDFS Balancer does not respect (yzhang: rev 1037ee580f87e6bf13155834c36f26794381678b) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/balancer/Dispatcher.java

People

Assignee:

Casey Brotherton

Reporter:

Yongjun Zhang

Votes:

0 Vote for this issue

Watchers:

6 Start watching this issue

Dates

Created:

17/Sep/15 23:04

Updated:

30/Aug/16 01:27

Resolved:

02/Oct/15 19:15

Development

Agile

View on Board