Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9213

Minicluster with Kerberos generates some stacks when checking the ports

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: security
    • Labels:
      None
    • Target Version/s:

      Description

      When using the minicluster with kerberos the various checks in SecureDataNodeStarter fail because the ports are not fixed.

      Stacks like this one:

      java.lang.RuntimeException: Unable to bind on specified streaming port in secure context. Needed 0, got 49670
      at org.apache.hadoop.hdfs.server.datanode.SecureDataNodeStarter.getSecureResources(SecureDataNodeStarter.java:108)

      There is already a setting to desactivate this type of check for testing, it could be used here as well....

      1. hdfs-9213.v1.patch
        3 kB
        Nicolas Liochon
      2. hdfs-9213.v1.patch
        3 kB
        Nicolas Liochon

        Activity

        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 19s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
              trunk Compile Tests
        +1 mvninstall 15m 59s trunk passed
        +1 compile 0m 59s trunk passed
        +1 checkstyle 0m 42s trunk passed
        +1 mvnsite 1m 7s trunk passed
        -1 findbugs 1m 55s hadoop-hdfs-project/hadoop-hdfs in trunk has 10 extant Findbugs warnings.
        +1 javadoc 0m 47s trunk passed
              Patch Compile Tests
        +1 mvninstall 1m 0s the patch passed
        +1 compile 0m 58s the patch passed
        +1 javac 0m 58s the patch passed
        -0 checkstyle 0m 38s hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 7 unchanged - 0 fixed = 10 total (was 7)
        +1 mvnsite 1m 5s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 2m 0s the patch passed
        +1 javadoc 0m 46s the patch passed
              Other Tests
        -1 unit 102m 9s hadoop-hdfs in the patch failed.
        +1 asflicense 0m 16s The patch does not generate ASF License warnings.
        132m 20s



        Reason Tests
        Failed junit tests hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting
          hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
          hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150
          hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:14b5c93
        JIRA Issue HDFS-9213
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12766796/hdfs-9213.v1.patch
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux 24833789ce4b 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26 18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / a4aa1cb
        Default Java 1.8.0_131
        findbugs v3.1.0-RC1
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/20512/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html
        checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/20512/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/20512/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/20512/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/20512/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 19s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.       trunk Compile Tests +1 mvninstall 15m 59s trunk passed +1 compile 0m 59s trunk passed +1 checkstyle 0m 42s trunk passed +1 mvnsite 1m 7s trunk passed -1 findbugs 1m 55s hadoop-hdfs-project/hadoop-hdfs in trunk has 10 extant Findbugs warnings. +1 javadoc 0m 47s trunk passed       Patch Compile Tests +1 mvninstall 1m 0s the patch passed +1 compile 0m 58s the patch passed +1 javac 0m 58s the patch passed -0 checkstyle 0m 38s hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 7 unchanged - 0 fixed = 10 total (was 7) +1 mvnsite 1m 5s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 2m 0s the patch passed +1 javadoc 0m 46s the patch passed       Other Tests -1 unit 102m 9s hadoop-hdfs in the patch failed. +1 asflicense 0m 16s The patch does not generate ASF License warnings. 132m 20s Reason Tests Failed junit tests hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting   hadoop.hdfs.server.namenode.ha.TestPipelinesFailover   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue HDFS-9213 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12766796/hdfs-9213.v1.patch Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux 24833789ce4b 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26 18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / a4aa1cb Default Java 1.8.0_131 findbugs v3.1.0-RC1 findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/20512/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/20512/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/20512/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/20512/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/20512/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        mingleizhang mingleizhang added a comment -

        Yiqun Lin Could you please take a look on this PR ? Thanks.

        Show
        mingleizhang mingleizhang added a comment - Yiqun Lin Could you please take a look on this PR ? Thanks.
        Hide
        mingleizhang mingleizhang added a comment -

        We should keep forward working on this jira. In flink project, we can not run some tests until this issue fixed.

        Show
        mingleizhang mingleizhang added a comment - We should keep forward working on this jira. In flink project, we can not run some tests until this issue fixed.
        Hide
        mxm Maximilian Michels added a comment -

        It would be great to run tests with a secure cluster Datanode without root. Isn't this relatively easy to fix for the next release version? What is blocking the fix?

        Show
        mxm Maximilian Michels added a comment - It would be great to run tests with a secure cluster Datanode without root. Isn't this relatively easy to fix for the next release version? What is blocking the fix?
        Hide
        vijikarthi Vijay Srinivasaraghavan added a comment -

        I was able to move forward by setting following configurations. There is aslo couple of flags that you need to enable in MiniDFSCluster to support below configurations.

        Hadoop Configurations:
        conf.set("dfs.datanode.address", "localhost:1002");
        conf.set("dfs.datanode.hostname", "localhost");
        conf.set("dfs.datanode.http.address", "localhost:1003");

        DFSMiniCluster:
        MiniDFSCluster.Builder builder = new MiniDFSCluster.Builder(conf);
        builder.checkDataNodeAddrConfig(true);
        builder.checkDataNodeHostConfig(true);

        You also need to enable permissions to allow the java process to bind to these privileged ports. For Ubuntu setup, I was using below command to enable it.

        setcap 'cap_net_bind_service=+ep' /path/to/java

        It looks like, with this setup we may not need additional patch?

        Show
        vijikarthi Vijay Srinivasaraghavan added a comment - I was able to move forward by setting following configurations. There is aslo couple of flags that you need to enable in MiniDFSCluster to support below configurations. Hadoop Configurations: conf.set("dfs.datanode.address", "localhost:1002"); conf.set("dfs.datanode.hostname", "localhost"); conf.set("dfs.datanode.http.address", "localhost:1003"); DFSMiniCluster: MiniDFSCluster.Builder builder = new MiniDFSCluster.Builder(conf); builder.checkDataNodeAddrConfig(true); builder.checkDataNodeHostConfig(true); You also need to enable permissions to allow the java process to bind to these privileged ports. For Ubuntu setup, I was using below command to enable it. setcap 'cap_net_bind_service=+ep' /path/to/java It looks like, with this setup we may not need additional patch?
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 23s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 mvninstall 8m 9s trunk passed
        +1 compile 0m 50s trunk passed
        +1 checkstyle 0m 27s trunk passed
        +1 mvnsite 0m 55s trunk passed
        +1 mvneclipse 0m 12s trunk passed
        +1 findbugs 1m 43s trunk passed
        +1 javadoc 0m 57s trunk passed
        +1 mvninstall 0m 52s the patch passed
        +1 compile 0m 45s the patch passed
        +1 javac 0m 45s the patch passed
        -0 checkstyle 0m 23s hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 7 unchanged - 0 fixed = 10 total (was 7)
        +1 mvnsite 0m 50s the patch passed
        +1 mvneclipse 0m 10s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
        +1 findbugs 1m 53s the patch passed
        +1 javadoc 0m 58s the patch passed
        -1 unit 74m 51s hadoop-hdfs in the patch failed.
        +1 asflicense 0m 19s The patch does not generate ASF License warnings.
        96m 5s



        Reason Tests
        Failed junit tests hadoop.hdfs.server.datanode.TestLargeBlockReport



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:9560f25
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12766796/hdfs-9213.v1.patch
        JIRA Issue HDFS-9213
        Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle
        uname Linux b91949ee43da 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 0fd3980
        Default Java 1.8.0_91
        findbugs v3.0.0
        checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/16015/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/16015/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/16015/testReport/
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/16015/console
        Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 23s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. -1 test4tests 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 mvninstall 8m 9s trunk passed +1 compile 0m 50s trunk passed +1 checkstyle 0m 27s trunk passed +1 mvnsite 0m 55s trunk passed +1 mvneclipse 0m 12s trunk passed +1 findbugs 1m 43s trunk passed +1 javadoc 0m 57s trunk passed +1 mvninstall 0m 52s the patch passed +1 compile 0m 45s the patch passed +1 javac 0m 45s the patch passed -0 checkstyle 0m 23s hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 7 unchanged - 0 fixed = 10 total (was 7) +1 mvnsite 0m 50s the patch passed +1 mvneclipse 0m 10s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 findbugs 1m 53s the patch passed +1 javadoc 0m 58s the patch passed -1 unit 74m 51s hadoop-hdfs in the patch failed. +1 asflicense 0m 19s The patch does not generate ASF License warnings. 96m 5s Reason Tests Failed junit tests hadoop.hdfs.server.datanode.TestLargeBlockReport Subsystem Report/Notes Docker Image:yetus/hadoop:9560f25 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12766796/hdfs-9213.v1.patch JIRA Issue HDFS-9213 Optional Tests asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle uname Linux b91949ee43da 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 0fd3980 Default Java 1.8.0_91 findbugs v3.0.0 checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/16015/artifact/patchprocess/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/16015/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/16015/testReport/ modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/16015/console Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        vijikarthi Vijay Srinivasaraghavan added a comment -

        I am seeing same error while trying to secure MiniDFSCluster using MiniKDC setup. DataNode is not starting and failing with the error message

        java.lang.RuntimeException: Unable to bind on specified streaming port in secure context. Needed 0, got 39319
        at org.apache.hadoop.hdfs.server.datanode.SecureDataNodeStarter.getSecureResources(SecureDataNodeStarter.java:107)
        at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1213)

        I am setting below configurations to enable the secure cluster deployment. Are you also seeing similar issue while starting miniDFSCluster with security enabled?

        conf.set(DFS_NAMENODE_USER_NAME_KEY, testPrincipal);
        conf.set(DFS_NAMENODE_KEYTAB_FILE_KEY, testKeytab);
        conf.set(DFS_DATANODE_USER_NAME_KEY, testPrincipal);
        conf.set(DFS_DATANODE_KEYTAB_FILE_KEY, testKeytab);
        conf.set(DFS_WEB_AUTHENTICATION_KERBEROS_PRINCIPAL_KEY, testPrincipal);
        conf.setBoolean(DFS_BLOCK_ACCESS_TOKEN_ENABLE_KEY, true);
        conf.set("dfs.data.transfer.protection", dataTransferProtection);
        conf.set(DFS_HTTP_POLICY_KEY, HttpConfig.Policy.HTTP_ONLY.name());
        conf.set(DFS_ENCRYPT_DATA_TRANSFER_KEY,"false");

        Show
        vijikarthi Vijay Srinivasaraghavan added a comment - I am seeing same error while trying to secure MiniDFSCluster using MiniKDC setup. DataNode is not starting and failing with the error message java.lang.RuntimeException: Unable to bind on specified streaming port in secure context. Needed 0, got 39319 at org.apache.hadoop.hdfs.server.datanode.SecureDataNodeStarter.getSecureResources(SecureDataNodeStarter.java:107) at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:1213) I am setting below configurations to enable the secure cluster deployment. Are you also seeing similar issue while starting miniDFSCluster with security enabled? conf.set(DFS_NAMENODE_USER_NAME_KEY, testPrincipal); conf.set(DFS_NAMENODE_KEYTAB_FILE_KEY, testKeytab); conf.set(DFS_DATANODE_USER_NAME_KEY, testPrincipal); conf.set(DFS_DATANODE_KEYTAB_FILE_KEY, testKeytab); conf.set(DFS_WEB_AUTHENTICATION_KERBEROS_PRINCIPAL_KEY, testPrincipal); conf.setBoolean(DFS_BLOCK_ACCESS_TOKEN_ENABLE_KEY, true); conf.set("dfs.data.transfer.protection", dataTransferProtection); conf.set(DFS_HTTP_POLICY_KEY, HttpConfig.Policy.HTTP_ONLY.name()); conf.set(DFS_ENCRYPT_DATA_TRANSFER_KEY,"false");
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        -1 pre-patch 18m 14s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 javac 8m 0s There were no new javac warning messages.
        +1 javadoc 10m 31s There were no new javadoc warning messages.
        -1 release audit 0m 17s The applied patch generated 1 release audit warnings.
        -1 checkstyle 1m 25s The applied patch generated 3 new checkstyle issues (total was 7, now 10).
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 27s mvn install still works.
        +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse.
        +1 findbugs 2m 30s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        +1 native 3m 14s Pre-build of native portion
        -1 hdfs tests 49m 12s Tests failed in hadoop-hdfs.
            95m 30s  



        Reason Tests
        Failed unit tests hadoop.hdfs.server.datanode.TestBPOfferService
          hadoop.fs.TestGlobPaths



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12766796/hdfs-9213.v1.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / 08f5de1
        Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/13003/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html
        Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/13003/artifact/patchprocess/patchReleaseAuditProblems.txt
        checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/13003/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/13003/artifact/patchprocess/testrun_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13003/testReport/
        Java 1.7.0_55
        uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13003/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 pre-patch 18m 14s Pre-patch trunk has 1 extant Findbugs (version 3.0.0) warnings. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 8m 0s There were no new javac warning messages. +1 javadoc 10m 31s There were no new javadoc warning messages. -1 release audit 0m 17s The applied patch generated 1 release audit warnings. -1 checkstyle 1m 25s The applied patch generated 3 new checkstyle issues (total was 7, now 10). +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 27s mvn install still works. +1 eclipse:eclipse 0m 34s The patch built with eclipse:eclipse. +1 findbugs 2m 30s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 14s Pre-build of native portion -1 hdfs tests 49m 12s Tests failed in hadoop-hdfs.     95m 30s   Reason Tests Failed unit tests hadoop.hdfs.server.datanode.TestBPOfferService   hadoop.fs.TestGlobPaths Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12766796/hdfs-9213.v1.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 08f5de1 Pre-patch Findbugs warnings https://builds.apache.org/job/PreCommit-HDFS-Build/13003/artifact/patchprocess/trunkFindbugsWarningshadoop-hdfs.html Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/13003/artifact/patchprocess/patchReleaseAuditProblems.txt checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/13003/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/13003/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13003/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13003/console This message was automatically generated.
        Hide
        nkeywal Nicolas Liochon added a comment -

        retriggering a hadoopqa run...

        Show
        nkeywal Nicolas Liochon added a comment - retriggering a hadoopqa run...
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 20m 59s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
        +1 javac 9m 4s There were no new javac warning messages.
        +1 javadoc 11m 46s There were no new javadoc warning messages.
        -1 release audit 0m 21s The applied patch generated 1 release audit warnings.
        -1 checkstyle 1m 39s The applied patch generated 3 new checkstyle issues (total was 7, now 10).
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 47s mvn install still works.
        +1 eclipse:eclipse 0m 37s The patch built with eclipse:eclipse.
        +1 findbugs 2m 51s The patch does not introduce any new Findbugs (version 3.0.0) warnings.
        +1 native 3m 34s Pre-build of native portion
        -1 hdfs tests 238m 17s Tests failed in hadoop-hdfs.
            290m 58s  



        Reason Tests
        Failed unit tests hadoop.hdfs.TestReplaceDatanodeOnFailure
          hadoop.hdfs.server.namenode.TestFileTruncate
          hadoop.hdfs.TestDFSClientRetries
        Timed out tests org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12765623/hdfs-9213.v1.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / 1107bd3
        Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12868/artifact/patchprocess/patchReleaseAuditProblems.txt
        checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/12868/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12868/artifact/patchprocess/testrun_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12868/testReport/
        Java 1.7.0_55
        uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12868/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 20m 59s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. -1 tests included 0m 0s The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac 9m 4s There were no new javac warning messages. +1 javadoc 11m 46s There were no new javadoc warning messages. -1 release audit 0m 21s The applied patch generated 1 release audit warnings. -1 checkstyle 1m 39s The applied patch generated 3 new checkstyle issues (total was 7, now 10). +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 47s mvn install still works. +1 eclipse:eclipse 0m 37s The patch built with eclipse:eclipse. +1 findbugs 2m 51s The patch does not introduce any new Findbugs (version 3.0.0) warnings. +1 native 3m 34s Pre-build of native portion -1 hdfs tests 238m 17s Tests failed in hadoop-hdfs.     290m 58s   Reason Tests Failed unit tests hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.server.namenode.TestFileTruncate   hadoop.hdfs.TestDFSClientRetries Timed out tests org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12765623/hdfs-9213.v1.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / 1107bd3 Release Audit https://builds.apache.org/job/PreCommit-HDFS-Build/12868/artifact/patchprocess/patchReleaseAuditProblems.txt checkstyle https://builds.apache.org/job/PreCommit-HDFS-Build/12868/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/12868/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/12868/testReport/ Java 1.7.0_55 uname Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/12868/console This message was automatically generated.

          People

          • Assignee:
            nkeywal Nicolas Liochon
            Reporter:
            nkeywal Nicolas Liochon
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:

              Development