Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9331

Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: 2.7.1
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: test
    • Labels:
      None
    • Target Version/s:

      Description

      TestNameNodeMXBean#testNameNodeMXBeanInfo expects a none-zero nonDFS size. The nonDFS size is defined as:

      The space that is not used by HDFS. For instance, once you format a new disk to ext4, certain space is used for "lost-and-found" directory and ext4 metadata.

      It will be possible to fully allocate all spaces in a filesystem for DFS use. In which case the nonDFS size will be zero. We can relax the check in the test to account for this case.

        Activity

        Hide
        twu Tony Wu added a comment -

        In v1 patch:

        • Relax the check in TestNameNodeMXBean#testNameNodeMXBeanInfo to allow nonDFS size to be 0.
        Show
        twu Tony Wu added a comment - In v1 patch: Relax the check in TestNameNodeMXBean#testNameNodeMXBeanInfo to allow nonDFS size to be 0.
        Hide
        hadoopqa Hadoop QA added a comment -
        -1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 7s docker + precommit patch detected.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 test4tests 0m 0s The patch appears to include 1 new or modified test files.
        +1 mvninstall 3m 19s trunk passed
        +1 compile 0m 36s trunk passed with JDK v1.8.0_60
        +1 compile 0m 34s trunk passed with JDK v1.7.0_79
        +1 checkstyle 0m 17s trunk passed
        +1 mvneclipse 0m 14s trunk passed
        -1 findbugs 2m 1s hadoop-hdfs-project/hadoop-hdfs in trunk cannot run convertXmlToText from findbugs
        +1 javadoc 1m 15s trunk passed with JDK v1.8.0_60
        +1 javadoc 1m 56s trunk passed with JDK v1.7.0_79
        +1 mvninstall 0m 44s the patch passed
        +1 compile 0m 33s the patch passed with JDK v1.8.0_60
        +1 javac 0m 33s the patch passed
        +1 compile 0m 33s the patch passed with JDK v1.7.0_79
        +1 javac 0m 33s the patch passed
        +1 checkstyle 0m 18s the patch passed
        +1 mvneclipse 0m 14s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 findbugs 2m 11s the patch passed
        +1 javadoc 1m 10s the patch passed with JDK v1.8.0_60
        +1 javadoc 1m 58s the patch passed with JDK v1.7.0_79
        -1 unit 56m 32s hadoop-hdfs in the patch failed with JDK v1.8.0_60.
        -1 unit 56m 23s hadoop-hdfs in the patch failed with JDK v1.7.0_79.
        -1 asflicense 0m 22s Patch generated 58 ASF License warnings.
        134m 0s



        Reason Tests
        JDK v1.7.0_79 Failed junit tests hadoop.hdfs.server.blockmanagement.TestNodeCount
          hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes
          hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency
          hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter
          hadoop.hdfs.TestLeaseRecovery2
          hadoop.hdfs.server.datanode.TestBlockScanner
          hadoop.hdfs.TestReplaceDatanodeOnFailure
          hadoop.hdfs.server.blockmanagement.TestNodeCount
          hadoop.hdfs.server.namenode.TestDecommissioningStatus
          hadoop.hdfs.server.namenode.snapshot.TestSnapshot
          hadoop.hdfs.TestDataTransferKeepalive



        Subsystem Report/Notes
        Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-28
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12769417/HDFS-9331.001.patch
        JIRA Issue HDFS-9331
        Optional Tests asflicense javac javadoc mvninstall unit findbugs checkstyle compile
        uname Linux e6466e47c152 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-67f42f1/precommit/personality/hadoop.sh
        git revision trunk / 65f53f2
        Default Java 1.7.0_79
        Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79
        findbugs v3.0.0
        findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.html
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt
        unit https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt
        JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13263/testReport/
        asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/patch-asflicense-problems.txt
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Max memory used 228MB
        Powered by Apache Yetus http://yetus.apache.org
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13263/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 reexec 0m 7s docker + precommit patch detected. +1 @author 0m 0s The patch does not contain any @author tags. +1 test4tests 0m 0s The patch appears to include 1 new or modified test files. +1 mvninstall 3m 19s trunk passed +1 compile 0m 36s trunk passed with JDK v1.8.0_60 +1 compile 0m 34s trunk passed with JDK v1.7.0_79 +1 checkstyle 0m 17s trunk passed +1 mvneclipse 0m 14s trunk passed -1 findbugs 2m 1s hadoop-hdfs-project/hadoop-hdfs in trunk cannot run convertXmlToText from findbugs +1 javadoc 1m 15s trunk passed with JDK v1.8.0_60 +1 javadoc 1m 56s trunk passed with JDK v1.7.0_79 +1 mvninstall 0m 44s the patch passed +1 compile 0m 33s the patch passed with JDK v1.8.0_60 +1 javac 0m 33s the patch passed +1 compile 0m 33s the patch passed with JDK v1.7.0_79 +1 javac 0m 33s the patch passed +1 checkstyle 0m 18s the patch passed +1 mvneclipse 0m 14s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 findbugs 2m 11s the patch passed +1 javadoc 1m 10s the patch passed with JDK v1.8.0_60 +1 javadoc 1m 58s the patch passed with JDK v1.7.0_79 -1 unit 56m 32s hadoop-hdfs in the patch failed with JDK v1.8.0_60. -1 unit 56m 23s hadoop-hdfs in the patch failed with JDK v1.7.0_79. -1 asflicense 0m 22s Patch generated 58 ASF License warnings. 134m 0s Reason Tests JDK v1.7.0_79 Failed junit tests hadoop.hdfs.server.blockmanagement.TestNodeCount   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes   hadoop.hdfs.server.namenode.TestNameNodeMetadataConsistency   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyWriter   hadoop.hdfs.TestLeaseRecovery2   hadoop.hdfs.server.datanode.TestBlockScanner   hadoop.hdfs.TestReplaceDatanodeOnFailure   hadoop.hdfs.server.blockmanagement.TestNodeCount   hadoop.hdfs.server.namenode.TestDecommissioningStatus   hadoop.hdfs.server.namenode.snapshot.TestSnapshot   hadoop.hdfs.TestDataTransferKeepalive Subsystem Report/Notes Docker Client=1.7.1 Server=1.7.1 Image:test-patch-base-hadoop-date2015-10-28 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12769417/HDFS-9331.001.patch JIRA Issue HDFS-9331 Optional Tests asflicense javac javadoc mvninstall unit findbugs checkstyle compile uname Linux e6466e47c152 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/patchprocess/apache-yetus-67f42f1/precommit/personality/hadoop.sh git revision trunk / 65f53f2 Default Java 1.7.0_79 Multi-JDK versions /usr/lib/jvm/java-8-oracle:1.8.0_60 /usr/lib/jvm/java-7-openjdk-amd64:1.7.0_79 findbugs v3.0.0 findbugs https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs.html unit https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt unit https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt unit test logs https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.8.0_60.txt https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs-jdk1.7.0_79.txt JDK v1.7.0_79 Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/13263/testReport/ asflicense https://builds.apache.org/job/PreCommit-HDFS-Build/13263/artifact/patchprocess/patch-asflicense-problems.txt modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Max memory used 228MB Powered by Apache Yetus http://yetus.apache.org Console output https://builds.apache.org/job/PreCommit-HDFS-Build/13263/console This message was automatically generated.
        Hide
        twu Tony Wu added a comment -

        The test failures are unrelated as the patch only changed TestNameNodeMXBean#testNameNodeMXBeanInfo, which passes.

        Show
        twu Tony Wu added a comment - The test failures are unrelated as the patch only changed TestNameNodeMXBean#testNameNodeMXBeanInfo , which passes.
        Hide
        eddyxu Lei (Eddy) Xu added a comment -

        +1. Thanks Tony Wu.

        Show
        eddyxu Lei (Eddy) Xu added a comment - +1. Thanks Tony Wu .
        Hide
        eddyxu Lei (Eddy) Xu added a comment -

        Committed

        Show
        eddyxu Lei (Eddy) Xu added a comment - Committed
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #8757 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8757/)
        HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #8757 (See https://builds.apache.org/job/Hadoop-trunk-Commit/8757/ ) HDFS-9331 . Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #639 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/639/)
        HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #639 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/639/ ) HDFS-9331 . Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk #2569 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2569/)
        HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2569 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2569/ ) HDFS-9331 . Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk #1362 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1362/)
        HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #1362 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/1362/ ) HDFS-9331 . Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #628 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/628/)
        HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #628 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/628/ ) HDFS-9331 . Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #572 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/572/)
        HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #572 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/572/ ) HDFS-9331 . Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Hdfs-trunk #2510 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2510/)
        HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk #2510 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2510/ ) HDFS-9331 . Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account (lei: rev e2a5441b062fd0758138079d24a2740fc5e5e350) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMXBean.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

          People

          • Assignee:
            twu Tony Wu
            Reporter:
            twu Tony Wu
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development