Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9427

HDFS should not default to ephemeral ports

    Details

    • Target Version/s:
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Hide
      The patch updates the HDFS default HTTP/RPC ports to non-ephemeral ports. The changes are listed below:
      Namenode ports: 50470 --> 9871, 50070 --> 9870, 8020 --> 9820
      Secondary NN ports: 50091 --> 9869, 50090 --> 9868
      Datanode ports: 50020 --> 9867, 50010 --> 9866, 50475 --> 9865, 50075 --> 9864
      Show
      The patch updates the HDFS default HTTP/RPC ports to non-ephemeral ports. The changes are listed below: Namenode ports: 50470 --> 9871, 50070 --> 9870, 8020 --> 9820 Secondary NN ports: 50091 --> 9869, 50090 --> 9868 Datanode ports: 50020 --> 9867, 50010 --> 9866, 50475 --> 9865, 50075 --> 9864

      Description

      HDFS defaults to ephemeral ports for the some HTTP/RPC endpoints. This can cause bind exceptions on service startup if the port is in use.

      1. HDFS-9427.000.patch
        6 kB
        Xiaobing Zhou
      2. HDFS-9427.001.patch
        59 kB
        Xiaobing Zhou
      3. HDFS-9427.002.patch
        58 kB
        Xiaobing Zhou
      4. HDFS-9427.003.patch
        57 kB
        Xiaobing Zhou
      5. HDFS-9427.004.patch
        51 kB
        Xiaobing Zhou
      6. HDFS-9427.005.patch
        122 kB
        Xiaobing Zhou

        Issue Links

          Activity

          Hide
          arpitagarwal Arpit Agarwal added a comment -

          List of settings that default to ephemeral ports:

            public static final String  DFS_NAMENODE_SECONDARY_HTTP_ADDRESS_DEFAULT = "0.0.0.0:50090";
            public static final String  DFS_NAMENODE_SECONDARY_HTTPS_ADDRESS_DEFAULT = "0.0.0.0:50091";
            public static final int     DFS_DATANODE_DEFAULT_PORT = 50010;
            public static final int     DFS_DATANODE_HTTP_DEFAULT_PORT = 50075;
            public static final int     DFS_DATANODE_HTTPS_DEFAULT_PORT = 50475;
            public static final int     DFS_DATANODE_IPC_DEFAULT_PORT = 50020;
          

          Changing these values for 2.x will be incompatible since we'd break deployments on upgrade that rely on defaults. Thanks to Josh Elser for reporting this.

          Show
          arpitagarwal Arpit Agarwal added a comment - List of settings that default to ephemeral ports: public static final String DFS_NAMENODE_SECONDARY_HTTP_ADDRESS_DEFAULT = "0.0.0.0:50090" ; public static final String DFS_NAMENODE_SECONDARY_HTTPS_ADDRESS_DEFAULT = "0.0.0.0:50091" ; public static final int DFS_DATANODE_DEFAULT_PORT = 50010; public static final int DFS_DATANODE_HTTP_DEFAULT_PORT = 50075; public static final int DFS_DATANODE_HTTPS_DEFAULT_PORT = 50475; public static final int DFS_DATANODE_IPC_DEFAULT_PORT = 50020; Changing these values for 2.x will be incompatible since we'd break deployments on upgrade that rely on defaults. Thanks to Josh Elser for reporting this.
          Hide
          aw Allen Wittenauer added a comment - - edited

          This issue has been a pet peeve of mine for years. But every time this topic comes up, someone complains that this makes testing on a single node hard. I really, really, really hope we're over that hump and we can not only remove the default of being ephemeral but also set the ports to be a contiguous range.

          Show
          aw Allen Wittenauer added a comment - - edited This issue has been a pet peeve of mine for years. But every time this topic comes up, someone complains that this makes testing on a single node hard. I really, really, really hope we're over that hump and we can not only remove the default of being ephemeral but also set the ports to be a contiguous range.
          Hide
          atm Aaron T. Myers added a comment -

          +1, let's make this happen. Seems long overdue to me.

          Show
          atm Aaron T. Myers added a comment - +1, let's make this happen. Seems long overdue to me.
          Hide
          vinayrpet Vinayakumar B added a comment -

          Following are also falls in same range

            int     DFS_NAMENODE_HTTP_PORT_DEFAULT = 50070;
            String  DFS_NAMENODE_HTTP_ADDRESS_KEY = "dfs.namenode.http-address";
            int     DFS_NAMENODE_HTTPS_PORT_DEFAULT = 50470;
            String  DFS_NAMENODE_HTTPS_ADDRESS_KEY = "dfs.namenode.https-address";
          

          How about changing into something like below? Just replace 50 with 9

          Namenode ports
          ----------------
          50070 --> 9070
          50470 --> 9470
          
          Datanode ports
          ---------------
          50010 --> 9010
          50020 --> 9020
          50075 --> 9075
          50475 --> 9475
          
          Secondary NN ports
          ---------------
          50090 --> 9090
          50091 --> 9091
          
          Show
          vinayrpet Vinayakumar B added a comment - Following are also falls in same range int DFS_NAMENODE_HTTP_PORT_DEFAULT = 50070; String DFS_NAMENODE_HTTP_ADDRESS_KEY = "dfs.namenode.http-address" ; int DFS_NAMENODE_HTTPS_PORT_DEFAULT = 50470; String DFS_NAMENODE_HTTPS_ADDRESS_KEY = "dfs.namenode.https-address" ; How about changing into something like below? Just replace 50 with 9 Namenode ports ---------------- 50070 --> 9070 50470 --> 9470 Datanode ports --------------- 50010 --> 9010 50020 --> 9020 50075 --> 9075 50475 --> 9475 Secondary NN ports --------------- 50090 --> 9090 50091 --> 9091
          Hide
          iwasakims Masatake Iwasaki added a comment -

          HBASE-10123 could be useful as reference.

          Show
          iwasakims Masatake Iwasaki added a comment - HBASE-10123 could be useful as reference.
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          Thanks Masatake Iwasaki for the pointer. The numbers started with 9000 suggested by Vinayakumar B are safe on various OS according to Jonathan Hsieh HBASE-10123 comment.

          Show
          xiaobingo Xiaobing Zhou added a comment - Thanks Masatake Iwasaki for the pointer. The numbers started with 9000 suggested by Vinayakumar B are safe on various OS according to Jonathan Hsieh HBASE-10123 comment .
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          There are two more

          final String  DFS_NAMENODE_BACKUP_ADDRESS_DEFAULT = "localhost:50100";
          final String  DFS_NAMENODE_BACKUP_HTTP_ADDRESS_DEFAULT = "0.0.0.0:50105";
          
          Show
          xiaobingo Xiaobing Zhou added a comment - There are two more final String DFS_NAMENODE_BACKUP_ADDRESS_DEFAULT = "localhost:50100" ; final String DFS_NAMENODE_BACKUP_HTTP_ADDRESS_DEFAULT = "0.0.0.0:50105" ;
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          Posted initial patch for review, thanks. Will make chances to keep comments/docs consistent in upcoming patches.

          Show
          xiaobingo Xiaobing Zhou added a comment - Posted initial patch for review, thanks. Will make chances to keep comments/docs consistent in upcoming patches.
          Hide
          jmhsieh Jonathan Hsieh added a comment -

          Here's another to consider: the hadoop-kms port. It was brought up on HBASE-10123 that it uses 16000 as default (and clashes with hbase currently)

          this line indicates that 16000 is the default – likely a search for that ENV variable will find where it is set by default in the code or confs.
          https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-kms/src/main/conf/kms-env.sh#L25

          Show
          jmhsieh Jonathan Hsieh added a comment - Here's another to consider: the hadoop-kms port. It was brought up on HBASE-10123 that it uses 16000 as default (and clashes with hbase currently) this line indicates that 16000 is the default – likely a search for that ENV variable will find where it is set by default in the code or confs. https://github.com/apache/hadoop/blob/trunk/hadoop-common-project/hadoop-kms/src/main/conf/kms-env.sh#L25
          Hide
          aw Allen Wittenauer added a comment -

          How about changing into something like below? Just replace 50 with 9

          No. Let's actually move the ports to be contiguous instead of all over the place. It's extremely sloppy and highlights the community's inability to plan to have these giant gaps all over the place.

          Show
          aw Allen Wittenauer added a comment - How about changing into something like below? Just replace 50 with 9 No. Let's actually move the ports to be contiguous instead of all over the place. It's extremely sloppy and highlights the community's inability to plan to have these giant gaps all over the place.
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          001 changed comments/docs/sources that were inconsistent.

          Show
          xiaobingo Xiaobing Zhou added a comment - 001 changed comments/docs/sources that were inconsistent.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 10s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
          0 mvndep 0m 9s Maven dependency ordering for branch
          +1 mvninstall 6m 36s trunk passed
          +1 compile 1m 18s trunk passed with JDK v1.8.0_72
          +1 compile 1m 19s trunk passed with JDK v1.7.0_95
          +1 checkstyle 0m 32s trunk passed
          +1 mvnsite 1m 25s trunk passed
          +1 mvneclipse 0m 25s trunk passed
          +1 findbugs 3m 32s trunk passed
          +1 javadoc 1m 25s trunk passed with JDK v1.8.0_72
          +1 javadoc 2m 13s trunk passed with JDK v1.7.0_95
          0 mvndep 0m 8s Maven dependency ordering for patch
          -1 mvninstall 0m 32s hadoop-hdfs-client in the patch failed.
          -1 mvninstall 0m 47s hadoop-hdfs in the patch failed.
          +1 compile 1m 12s the patch passed with JDK v1.8.0_72
          +1 javac 1m 12s the patch passed
          +1 compile 1m 19s the patch passed with JDK v1.7.0_95
          +1 javac 1m 19s the patch passed
          -1 checkstyle 0m 30s hadoop-hdfs-project: patch generated 4 new + 414 unchanged - 4 fixed = 418 total (was 418)
          +1 mvnsite 1m 23s the patch passed
          +1 mvneclipse 0m 21s the patch passed
          +1 whitespace 0m 0s Patch has no whitespace issues.
          +1 findbugs 4m 0s the patch passed
          +1 javadoc 1m 24s the patch passed with JDK v1.8.0_72
          +1 javadoc 2m 7s the patch passed with JDK v1.7.0_95
          +1 unit 0m 48s hadoop-hdfs-client in the patch passed with JDK v1.8.0_72.
          -1 unit 52m 53s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
          +1 unit 0m 56s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95.
          -1 unit 56m 15s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          +1 asflicense 0m 25s Patch does not generate ASF License warnings.
          146m 20s



          Reason Tests
          JDK v1.8.0_72 Failed junit tests hadoop.hdfs.server.blockmanagement.TestPendingDataNodeMessages
          JDK v1.7.0_95 Failed junit tests hadoop.hdfs.server.blockmanagement.TestPendingDataNodeMessages
            hadoop.hdfs.server.blockmanagement.TestBlockManager
            hadoop.hdfs.server.datanode.TestFsDatasetCache



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12789765/HDFS-9427.000.patch
          JIRA Issue HDFS-9427
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
          uname Linux 70911de037be 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / dbbfc58
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs-client.txt
          mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14604/testReport/
          modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14604/console
          Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 10s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. 0 mvndep 0m 9s Maven dependency ordering for branch +1 mvninstall 6m 36s trunk passed +1 compile 1m 18s trunk passed with JDK v1.8.0_72 +1 compile 1m 19s trunk passed with JDK v1.7.0_95 +1 checkstyle 0m 32s trunk passed +1 mvnsite 1m 25s trunk passed +1 mvneclipse 0m 25s trunk passed +1 findbugs 3m 32s trunk passed +1 javadoc 1m 25s trunk passed with JDK v1.8.0_72 +1 javadoc 2m 13s trunk passed with JDK v1.7.0_95 0 mvndep 0m 8s Maven dependency ordering for patch -1 mvninstall 0m 32s hadoop-hdfs-client in the patch failed. -1 mvninstall 0m 47s hadoop-hdfs in the patch failed. +1 compile 1m 12s the patch passed with JDK v1.8.0_72 +1 javac 1m 12s the patch passed +1 compile 1m 19s the patch passed with JDK v1.7.0_95 +1 javac 1m 19s the patch passed -1 checkstyle 0m 30s hadoop-hdfs-project: patch generated 4 new + 414 unchanged - 4 fixed = 418 total (was 418) +1 mvnsite 1m 23s the patch passed +1 mvneclipse 0m 21s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 4m 0s the patch passed +1 javadoc 1m 24s the patch passed with JDK v1.8.0_72 +1 javadoc 2m 7s the patch passed with JDK v1.7.0_95 +1 unit 0m 48s hadoop-hdfs-client in the patch passed with JDK v1.8.0_72. -1 unit 52m 53s hadoop-hdfs in the patch failed with JDK v1.8.0_72. +1 unit 0m 56s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95. -1 unit 56m 15s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 asflicense 0m 25s Patch does not generate ASF License warnings. 146m 20s Reason Tests JDK v1.8.0_72 Failed junit tests hadoop.hdfs.server.blockmanagement.TestPendingDataNodeMessages JDK v1.7.0_95 Failed junit tests hadoop.hdfs.server.blockmanagement.TestPendingDataNodeMessages   hadoop.hdfs.server.blockmanagement.TestBlockManager   hadoop.hdfs.server.datanode.TestFsDatasetCache Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12789765/HDFS-9427.000.patch JIRA Issue HDFS-9427 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 70911de037be 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / dbbfc58 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs-client.txt mvninstall https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-mvninstall-hadoop-hdfs-project_hadoop-hdfs.txt checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14604/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14604/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14604/console Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 13s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 6 new or modified test files.
          0 mvndep 0m 29s Maven dependency ordering for branch
          +1 mvninstall 7m 28s trunk passed
          +1 compile 6m 19s trunk passed with JDK v1.8.0_72
          +1 compile 6m 48s trunk passed with JDK v1.7.0_95
          +1 checkstyle 1m 13s trunk passed
          +1 mvnsite 4m 24s trunk passed
          +1 mvneclipse 1m 42s trunk passed
          +1 findbugs 8m 16s trunk passed
          +1 javadoc 3m 26s trunk passed with JDK v1.8.0_72
          +1 javadoc 4m 33s trunk passed with JDK v1.7.0_95
          0 mvndep 0m 15s Maven dependency ordering for patch
          +1 mvninstall 3m 29s the patch passed
          +1 compile 5m 46s the patch passed with JDK v1.8.0_72
          +1 javac 5m 46s the patch passed
          +1 compile 6m 44s the patch passed with JDK v1.7.0_95
          +1 javac 6m 44s the patch passed
          -1 checkstyle 1m 10s root: patch generated 5 new + 576 unchanged - 5 fixed = 581 total (was 581)
          +1 mvnsite 4m 26s the patch passed
          +1 mvneclipse 1m 45s the patch passed
          -1 whitespace 0m 0s The patch has 1 line(s) with tabs.
          +1 xml 0m 2s The patch has no ill-formed XML file.
          +1 findbugs 9m 51s the patch passed
          +1 javadoc 3m 31s the patch passed with JDK v1.8.0_72
          +1 javadoc 4m 36s the patch passed with JDK v1.7.0_95
          +1 unit 7m 31s hadoop-common in the patch passed with JDK v1.8.0_72.
          +1 unit 0m 50s hadoop-hdfs-client in the patch passed with JDK v1.8.0_72.
          -1 unit 53m 25s hadoop-hdfs in the patch failed with JDK v1.8.0_72.
          +1 unit 0m 55s hadoop-yarn-registry in the patch passed with JDK v1.8.0_72.
          +1 unit 1m 54s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_72.
          +1 unit 5m 35s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_72.
          +1 unit 6m 40s hadoop-distcp in the patch passed with JDK v1.8.0_72.
          +1 unit 0m 52s hadoop-sls in the patch passed with JDK v1.8.0_72.
          +1 unit 7m 39s hadoop-common in the patch passed with JDK v1.7.0_95.
          +1 unit 0m 59s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95.
          -1 unit 53m 19s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          +1 unit 0m 56s hadoop-yarn-registry in the patch passed with JDK v1.7.0_95.
          +1 unit 2m 17s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95.
          +1 unit 5m 47s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95.
          +1 unit 6m 10s hadoop-distcp in the patch passed with JDK v1.7.0_95.
          +1 unit 0m 55s hadoop-sls in the patch passed with JDK v1.7.0_95.
          -1 asflicense 0m 24s Patch generated 14 ASF License warnings.
          245m 2s



          Reason Tests
          JDK v1.8.0_72 Failed junit tests hadoop.hdfs.shortcircuit.TestShortCircuitCache
          JDK v1.7.0_95 Failed junit tests hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12789826/HDFS-9427.001.patch
          JIRA Issue HDFS-9427
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux a28de2d1d56f 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / dbbfc58
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/diff-checkstyle-root.txt
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/whitespace-tabs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14607/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-tools/hadoop-distcp hadoop-tools/hadoop-sls U: .
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14607/console
          Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 13s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 6 new or modified test files. 0 mvndep 0m 29s Maven dependency ordering for branch +1 mvninstall 7m 28s trunk passed +1 compile 6m 19s trunk passed with JDK v1.8.0_72 +1 compile 6m 48s trunk passed with JDK v1.7.0_95 +1 checkstyle 1m 13s trunk passed +1 mvnsite 4m 24s trunk passed +1 mvneclipse 1m 42s trunk passed +1 findbugs 8m 16s trunk passed +1 javadoc 3m 26s trunk passed with JDK v1.8.0_72 +1 javadoc 4m 33s trunk passed with JDK v1.7.0_95 0 mvndep 0m 15s Maven dependency ordering for patch +1 mvninstall 3m 29s the patch passed +1 compile 5m 46s the patch passed with JDK v1.8.0_72 +1 javac 5m 46s the patch passed +1 compile 6m 44s the patch passed with JDK v1.7.0_95 +1 javac 6m 44s the patch passed -1 checkstyle 1m 10s root: patch generated 5 new + 576 unchanged - 5 fixed = 581 total (was 581) +1 mvnsite 4m 26s the patch passed +1 mvneclipse 1m 45s the patch passed -1 whitespace 0m 0s The patch has 1 line(s) with tabs. +1 xml 0m 2s The patch has no ill-formed XML file. +1 findbugs 9m 51s the patch passed +1 javadoc 3m 31s the patch passed with JDK v1.8.0_72 +1 javadoc 4m 36s the patch passed with JDK v1.7.0_95 +1 unit 7m 31s hadoop-common in the patch passed with JDK v1.8.0_72. +1 unit 0m 50s hadoop-hdfs-client in the patch passed with JDK v1.8.0_72. -1 unit 53m 25s hadoop-hdfs in the patch failed with JDK v1.8.0_72. +1 unit 0m 55s hadoop-yarn-registry in the patch passed with JDK v1.8.0_72. +1 unit 1m 54s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_72. +1 unit 5m 35s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_72. +1 unit 6m 40s hadoop-distcp in the patch passed with JDK v1.8.0_72. +1 unit 0m 52s hadoop-sls in the patch passed with JDK v1.8.0_72. +1 unit 7m 39s hadoop-common in the patch passed with JDK v1.7.0_95. +1 unit 0m 59s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95. -1 unit 53m 19s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 unit 0m 56s hadoop-yarn-registry in the patch passed with JDK v1.7.0_95. +1 unit 2m 17s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95. +1 unit 5m 47s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95. +1 unit 6m 10s hadoop-distcp in the patch passed with JDK v1.7.0_95. +1 unit 0m 55s hadoop-sls in the patch passed with JDK v1.7.0_95. -1 asflicense 0m 24s Patch generated 14 ASF License warnings. 245m 2s Reason Tests JDK v1.8.0_72 Failed junit tests hadoop.hdfs.shortcircuit.TestShortCircuitCache JDK v1.7.0_95 Failed junit tests hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12789826/HDFS-9427.001.patch JIRA Issue HDFS-9427 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux a28de2d1d56f 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / dbbfc58 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_72 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/diff-checkstyle-root.txt whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/whitespace-tabs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_72.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14607/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14607/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-tools/hadoop-distcp hadoop-tools/hadoop-sls U: . Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14607/console Powered by Apache Yetus 0.2.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          Thanks Allen Wittenauer, do you think if it's good to start the contiguous range from 9000 like I did in the patches posted?

          Show
          xiaobingo Xiaobing Zhou added a comment - Thanks Allen Wittenauer , do you think if it's good to start the contiguous range from 9000 like I did in the patches posted?
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          V002 changed ports into contiguous range as:

          Namenode ports
          ----------------
          50070 --> 9070
          50470 --> 9071
          
          Secondary NN ports
          ---------------
          50090 --> 9072
          50091 --> 9073
          
          backup NN ports
          ---------------
          50100 --> 9074
          50105 --> 9075
          
          Datanode ports
          ---------------
          50010 --> 9076
          50020 --> 9077
          50075 --> 9078
          50475 --> 9079
          
          Show
          xiaobingo Xiaobing Zhou added a comment - V002 changed ports into contiguous range as: Namenode ports ---------------- 50070 --> 9070 50470 --> 9071 Secondary NN ports --------------- 50090 --> 9072 50091 --> 9073 backup NN ports --------------- 50100 --> 9074 50105 --> 9075 Datanode ports --------------- 50010 --> 9076 50020 --> 9077 50075 --> 9078 50475 --> 9079
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 11m 39s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 6 new or modified test files.
          0 mvndep 0m 14s Maven dependency ordering for branch
          +1 mvninstall 6m 49s trunk passed
          +1 compile 6m 15s trunk passed with JDK v1.8.0_74
          +1 compile 6m 37s trunk passed with JDK v1.7.0_95
          +1 checkstyle 1m 11s trunk passed
          +1 mvnsite 4m 4s trunk passed
          +1 mvneclipse 1m 35s trunk passed
          +1 findbugs 7m 43s trunk passed
          +1 javadoc 3m 21s trunk passed with JDK v1.8.0_74
          +1 javadoc 4m 23s trunk passed with JDK v1.7.0_95
          0 mvndep 0m 14s Maven dependency ordering for patch
          +1 mvninstall 3m 13s the patch passed
          +1 compile 5m 42s the patch passed with JDK v1.8.0_74
          +1 javac 5m 42s the patch passed
          +1 compile 6m 30s the patch passed with JDK v1.7.0_95
          +1 javac 6m 30s the patch passed
          +1 checkstyle 1m 11s root: patch generated 0 new + 575 unchanged - 6 fixed = 575 total (was 581)
          +1 mvnsite 4m 3s the patch passed
          +1 mvneclipse 1m 35s the patch passed
          -1 whitespace 0m 0s The patch has 1 line(s) with tabs.
          +1 xml 0m 1s The patch has no ill-formed XML file.
          +1 findbugs 9m 25s the patch passed
          +1 javadoc 3m 16s the patch passed with JDK v1.8.0_74
          +1 javadoc 4m 19s the patch passed with JDK v1.7.0_95
          +1 unit 6m 49s hadoop-common in the patch passed with JDK v1.8.0_74.
          +1 unit 0m 53s hadoop-hdfs-client in the patch passed with JDK v1.8.0_74.
          +1 unit 54m 53s hadoop-hdfs in the patch passed with JDK v1.8.0_74.
          +1 unit 0m 52s hadoop-yarn-registry in the patch passed with JDK v1.8.0_74.
          +1 unit 1m 55s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_74.
          +1 unit 5m 32s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_74.
          +1 unit 0m 52s hadoop-sls in the patch passed with JDK v1.8.0_74.
          +1 unit 7m 2s hadoop-common in the patch passed with JDK v1.7.0_95.
          +1 unit 0m 58s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95.
          -1 unit 51m 31s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          +1 unit 1m 2s hadoop-yarn-registry in the patch passed with JDK v1.7.0_95.
          +1 unit 2m 18s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95.
          +1 unit 5m 58s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95.
          +1 unit 0m 57s hadoop-sls in the patch passed with JDK v1.7.0_95.
          -1 asflicense 0m 25s Patch generated 14 ASF License warnings.
          237m 33s



          Reason Tests
          JDK v1.7.0_95 Failed junit tests hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12791265/HDFS-9427.002.patch
          JIRA Issue HDFS-9427
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux cbcf9261241f 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 0a9f00a
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14710/artifact/patchprocess/whitespace-tabs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14710/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14710/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14710/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14710/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-tools/hadoop-sls U: .
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14710/console
          Powered by Apache Yetus 0.3.0-SNAPSHOT http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 11m 39s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 6 new or modified test files. 0 mvndep 0m 14s Maven dependency ordering for branch +1 mvninstall 6m 49s trunk passed +1 compile 6m 15s trunk passed with JDK v1.8.0_74 +1 compile 6m 37s trunk passed with JDK v1.7.0_95 +1 checkstyle 1m 11s trunk passed +1 mvnsite 4m 4s trunk passed +1 mvneclipse 1m 35s trunk passed +1 findbugs 7m 43s trunk passed +1 javadoc 3m 21s trunk passed with JDK v1.8.0_74 +1 javadoc 4m 23s trunk passed with JDK v1.7.0_95 0 mvndep 0m 14s Maven dependency ordering for patch +1 mvninstall 3m 13s the patch passed +1 compile 5m 42s the patch passed with JDK v1.8.0_74 +1 javac 5m 42s the patch passed +1 compile 6m 30s the patch passed with JDK v1.7.0_95 +1 javac 6m 30s the patch passed +1 checkstyle 1m 11s root: patch generated 0 new + 575 unchanged - 6 fixed = 575 total (was 581) +1 mvnsite 4m 3s the patch passed +1 mvneclipse 1m 35s the patch passed -1 whitespace 0m 0s The patch has 1 line(s) with tabs. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 9m 25s the patch passed +1 javadoc 3m 16s the patch passed with JDK v1.8.0_74 +1 javadoc 4m 19s the patch passed with JDK v1.7.0_95 +1 unit 6m 49s hadoop-common in the patch passed with JDK v1.8.0_74. +1 unit 0m 53s hadoop-hdfs-client in the patch passed with JDK v1.8.0_74. +1 unit 54m 53s hadoop-hdfs in the patch passed with JDK v1.8.0_74. +1 unit 0m 52s hadoop-yarn-registry in the patch passed with JDK v1.8.0_74. +1 unit 1m 55s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_74. +1 unit 5m 32s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_74. +1 unit 0m 52s hadoop-sls in the patch passed with JDK v1.8.0_74. +1 unit 7m 2s hadoop-common in the patch passed with JDK v1.7.0_95. +1 unit 0m 58s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95. -1 unit 51m 31s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 unit 1m 2s hadoop-yarn-registry in the patch passed with JDK v1.7.0_95. +1 unit 2m 18s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95. +1 unit 5m 58s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95. +1 unit 0m 57s hadoop-sls in the patch passed with JDK v1.7.0_95. -1 asflicense 0m 25s Patch generated 14 ASF License warnings. 237m 33s Reason Tests JDK v1.7.0_95 Failed junit tests hadoop.hdfs.web.TestWebHdfsWithRestCsrfPreventionFilter Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12791265/HDFS-9427.002.patch JIRA Issue HDFS-9427 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux cbcf9261241f 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 0a9f00a Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14710/artifact/patchprocess/whitespace-tabs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14710/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14710/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14710/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14710/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-tools/hadoop-sls U: . Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14710/console Powered by Apache Yetus 0.3.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
          Hide
          arpitagarwal Arpit Agarwal added a comment -

          The v002 patch lgtm. I'll postpone committing at least 3-4 days in case there are additional comments.

          9070-9079 are unassigned so this looks like a good range to use.

          I know nothing about KMS so not sure if it is safe to change the port number as Jonathan Hsieh proposed. I'll file a separate Jira for that and we can address the ephemeral ports here.

          Show
          arpitagarwal Arpit Agarwal added a comment - The v002 patch lgtm. I'll postpone committing at least 3-4 days in case there are additional comments. 9070-9079 are unassigned so this looks like a good range to use. I know nothing about KMS so not sure if it is safe to change the port number as Jonathan Hsieh proposed. I'll file a separate Jira for that and we can address the ephemeral ports here.
          Hide
          cmccabe Colin P. McCabe added a comment -

          Great idea, but can we please not use port 9075? This port is the default HTrace RPC port.

          Show
          cmccabe Colin P. McCabe added a comment - Great idea, but can we please not use port 9075? This port is the default HTrace RPC port.
          Hide
          xiaochen Xiao Chen added a comment -

          I know nothing about KMS so not sure if it is safe to change the port number as Jonathan Hsieh proposed. I'll file a separate Jira for that and we can address the ephemeral ports here.

          Looks like there's already HADOOP-12811 created for this. I can follow up on there and fix the kms default port as well.
          I don't think there's extra problems on changing the port on KMS, except for compatibility.

          Show
          xiaochen Xiao Chen added a comment - I know nothing about KMS so not sure if it is safe to change the port number as Jonathan Hsieh proposed. I'll file a separate Jira for that and we can address the ephemeral ports here. Looks like there's already HADOOP-12811 created for this. I can follow up on there and fix the kms default port as well. I don't think there's extra problems on changing the port on KMS, except for compatibility.
          Hide
          arpitagarwal Arpit Agarwal added a comment -

          Thanks for the pointer Xiao Chen.

          Xiaobing Zhou, do you want to update the patch to free up port 9075?

          Show
          arpitagarwal Arpit Agarwal added a comment - Thanks for the pointer Xiao Chen . Xiaobing Zhou , do you want to update the patch to free up port 9075?
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          Thanks everyone for the feedback.

          I posted V003 with the mapping:

          Namenode ports 
          ---------------- 
          50070 --> 9803
          50470 --> 9804 
          Secondary NN ports 
          --------------- 
          50090 --> 9805
          50091 --> 9806 
          backup NN ports 
          --------------- 
          50100 --> 9807
          50105 --> 9808 
          Datanode ports 
          --------------- 
          50010 --> 9809
          50020 --> 9810
          50075 --> 9811
          50475 --> 9812	
          

          9803-9874 is a wider range unassigned, any upcoming ports can be fit into this range.

          Show
          xiaobingo Xiaobing Zhou added a comment - Thanks everyone for the feedback. I posted V003 with the mapping: Namenode ports ---------------- 50070 --> 9803 50470 --> 9804 Secondary NN ports --------------- 50090 --> 9805 50091 --> 9806 backup NN ports --------------- 50100 --> 9807 50105 --> 9808 Datanode ports --------------- 50010 --> 9809 50020 --> 9810 50075 --> 9811 50475 --> 9812 9803-9874 is a wider range unassigned, any upcoming ports can be fit into this range.
          Hide
          cmccabe Colin P. McCabe added a comment -

          Thanks, Xiaobing Zhou. Looks great.

          Show
          cmccabe Colin P. McCabe added a comment - Thanks, Xiaobing Zhou . Looks great.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 16s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 6 new or modified test files.
          0 mvndep 0m 15s Maven dependency ordering for branch
          +1 mvninstall 6m 56s trunk passed
          +1 compile 6m 17s trunk passed with JDK v1.8.0_74
          +1 compile 6m 50s trunk passed with JDK v1.7.0_95
          +1 checkstyle 1m 13s trunk passed
          +1 mvnsite 3m 58s trunk passed
          +1 mvneclipse 1m 34s trunk passed
          +1 findbugs 8m 1s trunk passed
          +1 javadoc 3m 28s trunk passed with JDK v1.8.0_74
          +1 javadoc 4m 46s trunk passed with JDK v1.7.0_95
          0 mvndep 0m 22s Maven dependency ordering for patch
          +1 mvninstall 3m 18s the patch passed
          +1 compile 6m 16s the patch passed with JDK v1.8.0_74
          +1 javac 6m 16s the patch passed
          +1 compile 7m 2s the patch passed with JDK v1.7.0_95
          +1 javac 7m 2s the patch passed
          +1 checkstyle 1m 15s root: patch generated 0 new + 575 unchanged - 6 fixed = 575 total (was 581)
          +1 mvnsite 4m 3s the patch passed
          +1 mvneclipse 1m 42s the patch passed
          -1 whitespace 0m 0s The patch has 1 line(s) with tabs.
          +1 xml 0m 2s The patch has no ill-formed XML file.
          +1 findbugs 10m 26s the patch passed
          +1 javadoc 3m 46s the patch passed with JDK v1.8.0_74
          +1 javadoc 5m 0s the patch passed with JDK v1.7.0_95
          +1 unit 8m 0s hadoop-common in the patch passed with JDK v1.8.0_74.
          +1 unit 0m 56s hadoop-hdfs-client in the patch passed with JDK v1.8.0_74.
          -1 unit 78m 50s hadoop-hdfs in the patch failed with JDK v1.8.0_74.
          +1 unit 3m 15s hadoop-yarn-registry in the patch passed with JDK v1.8.0_74.
          -1 unit 2m 15s hadoop-mapreduce-client-core in the patch failed with JDK v1.8.0_74.
          +1 unit 5m 50s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_74.
          +1 unit 0m 57s hadoop-sls in the patch passed with JDK v1.8.0_74.
          +1 unit 7m 51s hadoop-common in the patch passed with JDK v1.7.0_95.
          +1 unit 1m 5s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95.
          -1 unit 74m 3s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          +1 unit 2m 2s hadoop-yarn-registry in the patch passed with JDK v1.7.0_95.
          +1 unit 2m 21s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95.
          +1 unit 6m 0s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95.
          +1 unit 0m 57s hadoop-sls in the patch passed with JDK v1.7.0_95.
          -1 asflicense 0m 30s Patch generated 14 ASF License warnings.
          284m 9s



          Reason Tests
          JDK v1.8.0_74 Failed junit tests hadoop.hdfs.server.datanode.TestDataNodeMetrics
            hadoop.hdfs.TestRollingUpgrade
            hadoop.mapreduce.tools.TestCLI
          JDK v1.7.0_95 Failed junit tests hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:0ca8df7
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12792356/HDFS-9427.003.patch
          JIRA Issue HDFS-9427
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux 6e9753fce326 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 2e040d3
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/whitespace-tabs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.8.0_74.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14765/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-tools/hadoop-sls U: .
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14765/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 16s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 6 new or modified test files. 0 mvndep 0m 15s Maven dependency ordering for branch +1 mvninstall 6m 56s trunk passed +1 compile 6m 17s trunk passed with JDK v1.8.0_74 +1 compile 6m 50s trunk passed with JDK v1.7.0_95 +1 checkstyle 1m 13s trunk passed +1 mvnsite 3m 58s trunk passed +1 mvneclipse 1m 34s trunk passed +1 findbugs 8m 1s trunk passed +1 javadoc 3m 28s trunk passed with JDK v1.8.0_74 +1 javadoc 4m 46s trunk passed with JDK v1.7.0_95 0 mvndep 0m 22s Maven dependency ordering for patch +1 mvninstall 3m 18s the patch passed +1 compile 6m 16s the patch passed with JDK v1.8.0_74 +1 javac 6m 16s the patch passed +1 compile 7m 2s the patch passed with JDK v1.7.0_95 +1 javac 7m 2s the patch passed +1 checkstyle 1m 15s root: patch generated 0 new + 575 unchanged - 6 fixed = 575 total (was 581) +1 mvnsite 4m 3s the patch passed +1 mvneclipse 1m 42s the patch passed -1 whitespace 0m 0s The patch has 1 line(s) with tabs. +1 xml 0m 2s The patch has no ill-formed XML file. +1 findbugs 10m 26s the patch passed +1 javadoc 3m 46s the patch passed with JDK v1.8.0_74 +1 javadoc 5m 0s the patch passed with JDK v1.7.0_95 +1 unit 8m 0s hadoop-common in the patch passed with JDK v1.8.0_74. +1 unit 0m 56s hadoop-hdfs-client in the patch passed with JDK v1.8.0_74. -1 unit 78m 50s hadoop-hdfs in the patch failed with JDK v1.8.0_74. +1 unit 3m 15s hadoop-yarn-registry in the patch passed with JDK v1.8.0_74. -1 unit 2m 15s hadoop-mapreduce-client-core in the patch failed with JDK v1.8.0_74. +1 unit 5m 50s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_74. +1 unit 0m 57s hadoop-sls in the patch passed with JDK v1.8.0_74. +1 unit 7m 51s hadoop-common in the patch passed with JDK v1.7.0_95. +1 unit 1m 5s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95. -1 unit 74m 3s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 unit 2m 2s hadoop-yarn-registry in the patch passed with JDK v1.7.0_95. +1 unit 2m 21s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95. +1 unit 6m 0s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95. +1 unit 0m 57s hadoop-sls in the patch passed with JDK v1.7.0_95. -1 asflicense 0m 30s Patch generated 14 ASF License warnings. 284m 9s Reason Tests JDK v1.8.0_74 Failed junit tests hadoop.hdfs.server.datanode.TestDataNodeMetrics   hadoop.hdfs.TestRollingUpgrade   hadoop.mapreduce.tools.TestCLI JDK v1.7.0_95 Failed junit tests hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12792356/HDFS-9427.003.patch JIRA Issue HDFS-9427 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 6e9753fce326 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 2e040d3 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/whitespace-tabs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.8.0_74.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14765/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14765/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-tools/hadoop-sls U: . Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14765/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          arpitagarwal Arpit Agarwal added a comment -

          So at the risk of bike-shedding this - I think the 907x port range is easier to remember.

          Xiaobing Zhou - I'd just eliminate the backup node changes form your v2 patch which frees up port 9075 (BN is as good as unsupported).

          Show
          arpitagarwal Arpit Agarwal added a comment - So at the risk of bike-shedding this - I think the 907x port range is easier to remember. Xiaobing Zhou - I'd just eliminate the backup node changes form your v2 patch which frees up port 9075 (BN is as good as unsupported).
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          Arpit Agarwal here is the new mappings to keep 9870 as being easily remembered. Thanks all for review.

          Namenode ports 
          ---------------- 
          50470 --> 9871
          50070 --> 9870
          
          Secondary NN ports 
          --------------- 
          50091 --> 9869
          50090 --> 9868
          
          Datanode ports 
          --------------- 
          50020 --> 9867
          50010 --> 9866
          50475 --> 9865
          50075 --> 9864
          

          I also removed changes of backup NN ports.

          Show
          xiaobingo Xiaobing Zhou added a comment - Arpit Agarwal here is the new mappings to keep 9870 as being easily remembered. Thanks all for review. Namenode ports ---------------- 50470 --> 9871 50070 --> 9870 Secondary NN ports --------------- 50091 --> 9869 50090 --> 9868 Datanode ports --------------- 50020 --> 9867 50010 --> 9866 50475 --> 9865 50075 --> 9864 I also removed changes of backup NN ports.
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 17s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 6 new or modified test files.
          0 mvndep 0m 22s Maven dependency ordering for branch
          +1 mvninstall 7m 12s trunk passed
          +1 compile 5m 56s trunk passed with JDK v1.8.0_74
          +1 compile 6m 44s trunk passed with JDK v1.7.0_95
          +1 checkstyle 1m 11s trunk passed
          +1 mvnsite 4m 5s trunk passed
          +1 mvneclipse 1m 39s trunk passed
          +1 findbugs 7m 44s trunk passed
          +1 javadoc 3m 23s trunk passed with JDK v1.8.0_74
          +1 javadoc 4m 27s trunk passed with JDK v1.7.0_95
          0 mvndep 0m 15s Maven dependency ordering for patch
          +1 mvninstall 3m 18s the patch passed
          +1 compile 6m 21s the patch passed with JDK v1.8.0_74
          +1 javac 6m 21s the patch passed
          +1 compile 6m 52s the patch passed with JDK v1.7.0_95
          +1 javac 6m 52s the patch passed
          +1 checkstyle 1m 11s root: patch generated 0 new + 576 unchanged - 4 fixed = 576 total (was 580)
          +1 mvnsite 3m 56s the patch passed
          +1 mvneclipse 1m 35s the patch passed
          -1 whitespace 0m 0s The patch has 1 line(s) with tabs.
          +1 xml 0m 1s The patch has no ill-formed XML file.
          +1 findbugs 9m 20s the patch passed
          +1 javadoc 3m 35s the patch passed with JDK v1.8.0_74
          +1 javadoc 4m 41s the patch passed with JDK v1.7.0_95
          -1 unit 6m 43s hadoop-common in the patch failed with JDK v1.8.0_74.
          +1 unit 0m 51s hadoop-hdfs-client in the patch passed with JDK v1.8.0_74.
          -1 unit 68m 1s hadoop-hdfs in the patch failed with JDK v1.8.0_74.
          +1 unit 1m 53s hadoop-yarn-registry in the patch passed with JDK v1.8.0_74.
          +1 unit 2m 0s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_74.
          +1 unit 5m 36s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_74.
          +1 unit 0m 54s hadoop-sls in the patch passed with JDK v1.8.0_74.
          -1 unit 7m 6s hadoop-common in the patch failed with JDK v1.7.0_95.
          +1 unit 1m 0s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95.
          -1 unit 70m 30s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          +1 unit 2m 12s hadoop-yarn-registry in the patch passed with JDK v1.7.0_95.
          +1 unit 2m 25s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95.
          +1 unit 6m 9s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95.
          +1 unit 1m 0s hadoop-sls in the patch passed with JDK v1.7.0_95.
          -1 asflicense 0m 27s Patch generated 16 ASF License warnings.
          263m 16s



          Reason Tests
          JDK v1.8.0_74 Failed junit tests hadoop.hdfs.TestHFlush
          JDK v1.8.0_74 Timed out junit tests org.apache.hadoop.util.TestNativeLibraryChecker
          JDK v1.7.0_95 Failed junit tests hadoop.hdfs.TestHFlush
            hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot
          JDK v1.7.0_95 Timed out junit tests org.apache.hadoop.util.TestNativeLibraryChecker



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:fbe3e86
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12795044/HDFS-9427.004.patch
          JIRA Issue HDFS-9427
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux a7fd3b58068f 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / 8f85e5d
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/whitespace-tabs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_74.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_95.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_95.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14912/testReport/
          asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-asflicense-problems.txt
          modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-tools/hadoop-sls U: .
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14912/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 17s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 6 new or modified test files. 0 mvndep 0m 22s Maven dependency ordering for branch +1 mvninstall 7m 12s trunk passed +1 compile 5m 56s trunk passed with JDK v1.8.0_74 +1 compile 6m 44s trunk passed with JDK v1.7.0_95 +1 checkstyle 1m 11s trunk passed +1 mvnsite 4m 5s trunk passed +1 mvneclipse 1m 39s trunk passed +1 findbugs 7m 44s trunk passed +1 javadoc 3m 23s trunk passed with JDK v1.8.0_74 +1 javadoc 4m 27s trunk passed with JDK v1.7.0_95 0 mvndep 0m 15s Maven dependency ordering for patch +1 mvninstall 3m 18s the patch passed +1 compile 6m 21s the patch passed with JDK v1.8.0_74 +1 javac 6m 21s the patch passed +1 compile 6m 52s the patch passed with JDK v1.7.0_95 +1 javac 6m 52s the patch passed +1 checkstyle 1m 11s root: patch generated 0 new + 576 unchanged - 4 fixed = 576 total (was 580) +1 mvnsite 3m 56s the patch passed +1 mvneclipse 1m 35s the patch passed -1 whitespace 0m 0s The patch has 1 line(s) with tabs. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 9m 20s the patch passed +1 javadoc 3m 35s the patch passed with JDK v1.8.0_74 +1 javadoc 4m 41s the patch passed with JDK v1.7.0_95 -1 unit 6m 43s hadoop-common in the patch failed with JDK v1.8.0_74. +1 unit 0m 51s hadoop-hdfs-client in the patch passed with JDK v1.8.0_74. -1 unit 68m 1s hadoop-hdfs in the patch failed with JDK v1.8.0_74. +1 unit 1m 53s hadoop-yarn-registry in the patch passed with JDK v1.8.0_74. +1 unit 2m 0s hadoop-mapreduce-client-core in the patch passed with JDK v1.8.0_74. +1 unit 5m 36s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_74. +1 unit 0m 54s hadoop-sls in the patch passed with JDK v1.8.0_74. -1 unit 7m 6s hadoop-common in the patch failed with JDK v1.7.0_95. +1 unit 1m 0s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95. -1 unit 70m 30s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 unit 2m 12s hadoop-yarn-registry in the patch passed with JDK v1.7.0_95. +1 unit 2m 25s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95. +1 unit 6m 9s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95. +1 unit 1m 0s hadoop-sls in the patch passed with JDK v1.7.0_95. -1 asflicense 0m 27s Patch generated 16 ASF License warnings. 263m 16s Reason Tests JDK v1.8.0_74 Failed junit tests hadoop.hdfs.TestHFlush JDK v1.8.0_74 Timed out junit tests org.apache.hadoop.util.TestNativeLibraryChecker JDK v1.7.0_95 Failed junit tests hadoop.hdfs.TestHFlush   hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot JDK v1.7.0_95 Timed out junit tests org.apache.hadoop.util.TestNativeLibraryChecker Subsystem Report/Notes Docker Image:yetus/hadoop:fbe3e86 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12795044/HDFS-9427.004.patch JIRA Issue HDFS-9427 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux a7fd3b58068f 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 8f85e5d Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/whitespace-tabs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_74.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_95.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-common-project_hadoop-common-jdk1.7.0_95.txt https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/14912/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/14912/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-tools/hadoop-sls U: . Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14912/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          arpitagarwal Arpit Agarwal added a comment -

          I haven't looked at the patch in detail yet but I am +1 on the assignments (thanks for the nice summary).

          I will hold off committing until late next week at least to give the Jira watchers a chance to comment.

          Show
          arpitagarwal Arpit Agarwal added a comment - I haven't looked at the patch in detail yet but I am +1 on the assignments (thanks for the nice summary). I will hold off committing until late next week at least to give the Jira watchers a chance to comment.
          Hide
          xiaochen Xiao Chen added a comment -

          Thanks Xiaobing Zhou for working on this.

          Have we considered about moving NN's RPC port to the same range? Now NN HTTP/HTTPS are on 9870/9871, while RPC on 8020. DN has HTTP/HTTPS on 9864/9865 while IPC on 9867. I think this jira is a good chance to bring the NN RPC to the same range. Please let me know your thoughts.

          Nit: I see one reference of 50070 in CommandsManual.md in an example, could you please update that?

          Show
          xiaochen Xiao Chen added a comment - Thanks Xiaobing Zhou for working on this. Have we considered about moving NN's RPC port to the same range? Now NN HTTP/HTTPS are on 9870/9871, while RPC on 8020. DN has HTTP/HTTPS on 9864/9865 while IPC on 9867. I think this jira is a good chance to bring the NN RPC to the same range. Please let me know your thoughts. Nit: I see one reference of 50070 in CommandsManual.md in an example, could you please update that?
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          I posted patch v005 your comments, thanks Xiao Chen for review. Here's mapping in the following.

          I intentionally have 9820 being not strictly contiguous with other NN ports in a sense people easily remember 9820 as they are more familiar with 8020 thanks to Arpit Agarwal pointed me based on such a spirit.

          I didn't see any 50070 reference in CommandsManual.md, which's already fixed in the patches.

          Namenode ports
          ----------------
          50470 --> 9871
          50070 --> 9870
          8020 --> 9820

          Secondary NN ports
          ---------------
          50091 --> 9869
          50090 --> 9868

          Datanode ports
          ---------------
          50020 --> 9867
          50010 --> 9866
          50475 --> 9865
          50075 --> 9864

          Show
          xiaobingo Xiaobing Zhou added a comment - I posted patch v005 your comments, thanks Xiao Chen for review. Here's mapping in the following. I intentionally have 9820 being not strictly contiguous with other NN ports in a sense people easily remember 9820 as they are more familiar with 8020 thanks to Arpit Agarwal pointed me based on such a spirit. I didn't see any 50070 reference in CommandsManual.md, which's already fixed in the patches. Namenode ports ---------------- 50470 --> 9871 50070 --> 9870 8020 --> 9820 Secondary NN ports --------------- 50091 --> 9869 50090 --> 9868 Datanode ports --------------- 50020 --> 9867 50010 --> 9866 50475 --> 9865 50075 --> 9864
          Hide
          xiaochen Xiao Chen added a comment -

          Thanks Xiaobing Zhou for the new rev, LGTM. +1 (non-binding).

          Show
          xiaochen Xiao Chen added a comment - Thanks Xiaobing Zhou for the new rev, LGTM. +1 (non-binding).
          Hide
          hadoopqa Hadoop QA added a comment -
          -1 overall



          Vote Subsystem Runtime Comment
          0 reexec 0m 19s Docker mode activated.
          +1 @author 0m 0s The patch does not contain any @author tags.
          +1 test4tests 0m 0s The patch appears to include 18 new or modified test files.
          0 mvndep 0m 49s Maven dependency ordering for branch
          +1 mvninstall 11m 6s trunk passed
          +1 compile 8m 59s trunk passed with JDK v1.8.0_74
          +1 compile 8m 0s trunk passed with JDK v1.7.0_95
          +1 checkstyle 1m 26s trunk passed
          +1 mvnsite 6m 21s trunk passed
          +1 mvneclipse 3m 40s trunk passed
          +1 findbugs 12m 45s trunk passed
          +1 javadoc 5m 5s trunk passed with JDK v1.8.0_74
          +1 javadoc 5m 51s trunk passed with JDK v1.7.0_95
          0 mvndep 0m 17s Maven dependency ordering for patch
          +1 mvninstall 4m 53s the patch passed
          +1 compile 9m 37s the patch passed with JDK v1.8.0_74
          +1 javac 9m 37s the patch passed
          +1 compile 8m 18s the patch passed with JDK v1.7.0_95
          +1 javac 8m 18s the patch passed
          +1 checkstyle 1m 15s root: patch generated 0 new + 693 unchanged - 4 fixed = 693 total (was 697)
          +1 mvnsite 5m 37s the patch passed
          +1 mvneclipse 2m 17s the patch passed
          -1 whitespace 0m 0s The patch has 1 line(s) with tabs.
          +1 xml 0m 1s The patch has no ill-formed XML file.
          +1 findbugs 12m 46s the patch passed
          +1 javadoc 5m 10s the patch passed with JDK v1.8.0_74
          +1 javadoc 5m 28s the patch passed with JDK v1.7.0_95
          +1 unit 10m 26s hadoop-common in the patch passed with JDK v1.8.0_74.
          +1 unit 1m 10s hadoop-hdfs-client in the patch passed with JDK v1.8.0_74.
          -1 unit 97m 34s hadoop-hdfs in the patch failed with JDK v1.8.0_74.
          +1 unit 9m 47s hadoop-yarn-server-nodemanager in the patch passed with JDK v1.8.0_74.
          +1 unit 2m 11s hadoop-yarn-registry in the patch passed with JDK v1.8.0_74.
          -1 unit 2m 21s hadoop-mapreduce-client-core in the patch failed with JDK v1.8.0_74.
          +1 unit 6m 5s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_74.
          +1 unit 8m 31s hadoop-distcp in the patch passed with JDK v1.8.0_74.
          +1 unit 0m 17s hadoop-openstack in the patch passed with JDK v1.8.0_74.
          +1 unit 1m 3s hadoop-sls in the patch passed with JDK v1.8.0_74.
          +1 unit 11m 23s hadoop-common in the patch passed with JDK v1.7.0_95.
          +1 unit 1m 14s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95.
          -1 unit 109m 42s hadoop-hdfs in the patch failed with JDK v1.7.0_95.
          +1 unit 11m 23s hadoop-yarn-server-nodemanager in the patch passed with JDK v1.7.0_95.
          +1 unit 2m 36s hadoop-yarn-registry in the patch passed with JDK v1.7.0_95.
          +1 unit 2m 34s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95.
          +1 unit 6m 4s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95.
          +1 unit 8m 38s hadoop-distcp in the patch passed with JDK v1.7.0_95.
          +1 unit 0m 16s hadoop-openstack in the patch passed with JDK v1.7.0_95.
          +1 unit 1m 7s hadoop-sls in the patch passed with JDK v1.7.0_95.
          +1 asflicense 0m 43s Patch does not generate ASF License warnings.
          418m 15s



          Reason Tests
          JDK v1.8.0_74 Failed junit tests hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
            hadoop.hdfs.server.namenode.ha.TestEditLogTailer
            hadoop.hdfs.security.TestDelegationTokenForProxyUser
            hadoop.hdfs.server.datanode.TestDataNodeLifeline
            hadoop.hdfs.server.namenode.TestFsck
            hadoop.hdfs.TestFileAppend
            hadoop.TestRefreshCallQueue
            hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits
            hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
            hadoop.hdfs.server.datanode.TestDirectoryScanner
            hadoop.mapreduce.tools.TestCLI
          JDK v1.7.0_95 Failed junit tests hadoop.hdfs.web.TestWebHdfsTimeouts
            hadoop.TestRefreshCallQueue
            hadoop.hdfs.server.namenode.TestEditLog
            hadoop.hdfs.server.namenode.ha.TestHAAppend
            hadoop.hdfs.server.datanode.TestDirectoryScanner



          Subsystem Report/Notes
          Docker Image:yetus/hadoop:fbe3e86
          JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12796413/HDFS-9427.005.patch
          JIRA Issue HDFS-9427
          Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml
          uname Linux 23f84e0a2857 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
          Build tool maven
          Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
          git revision trunk / aac4d65
          Default Java 1.7.0_95
          Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95
          findbugs v3.0.0
          whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/whitespace-tabs.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.8.0_74.txt
          unit https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt
          JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15029/testReport/
          modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-tools/hadoop-distcp hadoop-tools/hadoop-openstack hadoop-tools/hadoop-sls U: .
          Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15029/console
          Powered by Apache Yetus 0.2.0 http://yetus.apache.org

          This message was automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 19s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 18 new or modified test files. 0 mvndep 0m 49s Maven dependency ordering for branch +1 mvninstall 11m 6s trunk passed +1 compile 8m 59s trunk passed with JDK v1.8.0_74 +1 compile 8m 0s trunk passed with JDK v1.7.0_95 +1 checkstyle 1m 26s trunk passed +1 mvnsite 6m 21s trunk passed +1 mvneclipse 3m 40s trunk passed +1 findbugs 12m 45s trunk passed +1 javadoc 5m 5s trunk passed with JDK v1.8.0_74 +1 javadoc 5m 51s trunk passed with JDK v1.7.0_95 0 mvndep 0m 17s Maven dependency ordering for patch +1 mvninstall 4m 53s the patch passed +1 compile 9m 37s the patch passed with JDK v1.8.0_74 +1 javac 9m 37s the patch passed +1 compile 8m 18s the patch passed with JDK v1.7.0_95 +1 javac 8m 18s the patch passed +1 checkstyle 1m 15s root: patch generated 0 new + 693 unchanged - 4 fixed = 693 total (was 697) +1 mvnsite 5m 37s the patch passed +1 mvneclipse 2m 17s the patch passed -1 whitespace 0m 0s The patch has 1 line(s) with tabs. +1 xml 0m 1s The patch has no ill-formed XML file. +1 findbugs 12m 46s the patch passed +1 javadoc 5m 10s the patch passed with JDK v1.8.0_74 +1 javadoc 5m 28s the patch passed with JDK v1.7.0_95 +1 unit 10m 26s hadoop-common in the patch passed with JDK v1.8.0_74. +1 unit 1m 10s hadoop-hdfs-client in the patch passed with JDK v1.8.0_74. -1 unit 97m 34s hadoop-hdfs in the patch failed with JDK v1.8.0_74. +1 unit 9m 47s hadoop-yarn-server-nodemanager in the patch passed with JDK v1.8.0_74. +1 unit 2m 11s hadoop-yarn-registry in the patch passed with JDK v1.8.0_74. -1 unit 2m 21s hadoop-mapreduce-client-core in the patch failed with JDK v1.8.0_74. +1 unit 6m 5s hadoop-mapreduce-client-hs in the patch passed with JDK v1.8.0_74. +1 unit 8m 31s hadoop-distcp in the patch passed with JDK v1.8.0_74. +1 unit 0m 17s hadoop-openstack in the patch passed with JDK v1.8.0_74. +1 unit 1m 3s hadoop-sls in the patch passed with JDK v1.8.0_74. +1 unit 11m 23s hadoop-common in the patch passed with JDK v1.7.0_95. +1 unit 1m 14s hadoop-hdfs-client in the patch passed with JDK v1.7.0_95. -1 unit 109m 42s hadoop-hdfs in the patch failed with JDK v1.7.0_95. +1 unit 11m 23s hadoop-yarn-server-nodemanager in the patch passed with JDK v1.7.0_95. +1 unit 2m 36s hadoop-yarn-registry in the patch passed with JDK v1.7.0_95. +1 unit 2m 34s hadoop-mapreduce-client-core in the patch passed with JDK v1.7.0_95. +1 unit 6m 4s hadoop-mapreduce-client-hs in the patch passed with JDK v1.7.0_95. +1 unit 8m 38s hadoop-distcp in the patch passed with JDK v1.7.0_95. +1 unit 0m 16s hadoop-openstack in the patch passed with JDK v1.7.0_95. +1 unit 1m 7s hadoop-sls in the patch passed with JDK v1.7.0_95. +1 asflicense 0m 43s Patch does not generate ASF License warnings. 418m 15s Reason Tests JDK v1.8.0_74 Failed junit tests hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency   hadoop.hdfs.server.namenode.ha.TestEditLogTailer   hadoop.hdfs.security.TestDelegationTokenForProxyUser   hadoop.hdfs.server.datanode.TestDataNodeLifeline   hadoop.hdfs.server.namenode.TestFsck   hadoop.hdfs.TestFileAppend   hadoop.TestRefreshCallQueue   hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes   hadoop.hdfs.server.datanode.TestDirectoryScanner   hadoop.mapreduce.tools.TestCLI JDK v1.7.0_95 Failed junit tests hadoop.hdfs.web.TestWebHdfsTimeouts   hadoop.TestRefreshCallQueue   hadoop.hdfs.server.namenode.TestEditLog   hadoop.hdfs.server.namenode.ha.TestHAAppend   hadoop.hdfs.server.datanode.TestDirectoryScanner Subsystem Report/Notes Docker Image:yetus/hadoop:fbe3e86 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12796413/HDFS-9427.005.patch JIRA Issue HDFS-9427 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle xml uname Linux 23f84e0a2857 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / aac4d65 Default Java 1.7.0_95 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_74 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_95 findbugs v3.0.0 whitespace https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/whitespace-tabs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.8.0_74.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core-jdk1.8.0_74.txt https://builds.apache.org/job/PreCommit-HDFS-Build/15029/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_95.txt JDK v1.7.0_95 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/15029/testReport/ modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-tools/hadoop-distcp hadoop-tools/hadoop-openstack hadoop-tools/hadoop-sls U: . Console output https://builds.apache.org/job/PreCommit-HDFS-Build/15029/console Powered by Apache Yetus 0.2.0 http://yetus.apache.org This message was automatically generated.
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          I verified the test failures are not related to the patch. Thank you everyone for review.

          Show
          xiaobingo Xiaobing Zhou added a comment - I verified the test failures are not related to the patch. Thank you everyone for review.
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          Could anyone help to commit this? Thanks.

          Show
          xiaobingo Xiaobing Zhou added a comment - Could anyone help to commit this? Thanks.
          Hide
          xiaochen Xiao Chen added a comment -

          Thanks Xiaobing for pushing this forward. We need a committer +1 as well.

          Show
          xiaochen Xiao Chen added a comment - Thanks Xiaobing for pushing this forward. We need a committer +1 as well.
          Hide
          jingzhao Jing Zhao added a comment -

          +1. I will commit the patch shortly.

          Show
          jingzhao Jing Zhao added a comment - +1. I will commit the patch shortly.
          Hide
          jingzhao Jing Zhao added a comment -

          I've committed this to trunk. Thanks Xiaobing Zhou for the contribution! Thanks all for the discussion and review.

          Show
          jingzhao Jing Zhao added a comment - I've committed this to trunk. Thanks Xiaobing Zhou for the contribution! Thanks all for the discussion and review.
          Hide
          xiaobingo Xiaobing Zhou added a comment -

          Thank you Jing Zhao for +1ing and committing it. Thank you all for review.

          Show
          xiaobingo Xiaobing Zhou added a comment - Thank you Jing Zhao for +1ing and committing it. Thank you all for review.
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Hadoop-trunk-Commit #9659 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9659/)
          HDFS-9427. HDFS should not default to ephemeral ports. Contributed by (jing9: rev 63e5412f1aef5e17e15da69d646181c629fc8682)

          • hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm
          • hadoop-tools/hadoop-openstack/src/site/markdown/index.md
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSHighAvailabilityWithNFS.md
          • hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry/src/main/java/org/apache/hadoop/registry/client/types/AddressTypes.java
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/api/protocolrecords/impl/pb/TestPBRecordImpl.java
          • hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestFileInputFormat.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestDelegateToFileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsUserGuide.md
          • hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestOptionsParser.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeys.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/resources/job_1329348432655_0001_conf.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsDesign.md
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/GenericOptionsParser.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestPendingDataNodeMessages.java
          • hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java
          • hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestAllowFormat.java
          • hadoop-common-project/hadoop-common/src/site/markdown/filesystem/filesystem.md
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestFileInputFormat.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestReplaceDatanodeOnFailure.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSUtil.java
          • hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ha/TestSshFenceByTcpPort.java
          • hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestRequestHedgingProxyProvider.java
          • hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockPoolManager.java
          • hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
          • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSHighAvailabilityWithQJM.md
          • hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry/src/test/java/org/apache/hadoop/registry/RegistryTestHelper.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/JMXGet.java
          • hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml
          • hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/resources/job_0.23.9-FAILED.jhist
          • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientFailover.java
          • hadoop-hdfs-project/hadoop-hdfs/src/test/resources/hdfs-site.malformed.xml
          • hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
          • hadoop-tools/hadoop-sls/src/main/data/2jobs2min-rumen-jh.json
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #9659 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9659/ ) HDFS-9427 . HDFS should not default to ephemeral ports. Contributed by (jing9: rev 63e5412f1aef5e17e15da69d646181c629fc8682) hadoop-common-project/hadoop-common/src/site/markdown/SingleCluster.md.vm hadoop-tools/hadoop-openstack/src/site/markdown/index.md hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSHighAvailabilityWithNFS.md hadoop-common-project/hadoop-common/src/site/markdown/ClusterSetup.md hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry/src/main/java/org/apache/hadoop/registry/client/types/AddressTypes.java hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/api/protocolrecords/impl/pb/TestPBRecordImpl.java hadoop-tools/hadoop-distcp/src/site/markdown/DistCp.md.vm hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapred/TestFileInputFormat.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestDelegateToFileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsUserGuide.md hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/TestOptionsParser.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/CommonConfigurationKeys.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestQuota.java hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/resources/job_1329348432655_0001_conf.xml hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsDesign.md hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/GenericOptionsParser.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestPendingDataNodeMessages.java hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/HdfsClientConfigKeys.java hadoop-common-project/hadoop-common/src/site/markdown/SecureMode.md hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/ViewFs.md hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestAllowFormat.java hadoop-common-project/hadoop-common/src/site/markdown/filesystem/filesystem.md hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/test/java/org/apache/hadoop/mapreduce/lib/input/TestFileInputFormat.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestReplaceDatanodeOnFailure.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSUtil.java hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ha/TestSshFenceByTcpPort.java hadoop-common-project/hadoop-common/src/site/markdown/Tracing.md hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestRequestHedgingProxyProvider.java hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/TestBlockPoolManager.java hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSHighAvailabilityWithQJM.md hadoop-yarn-project/hadoop-yarn/hadoop-yarn-registry/src/test/java/org/apache/hadoop/registry/RegistryTestHelper.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/JMXGet.java hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/test/resources/job_0.23.9-FAILED.jhist hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientFailover.java hadoop-hdfs-project/hadoop-hdfs/src/test/resources/hdfs-site.malformed.xml hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java hadoop-tools/hadoop-sls/src/main/data/2jobs2min-rumen-jh.json

            People

            • Assignee:
              xiaobingo Xiaobing Zhou
              Reporter:
              arpitagarwal Arpit Agarwal
            • Votes:
              1 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development