Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8097

TestFileTruncate is failing intermittently

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      java.lang.AssertionError: Bad disk space usage expected:<45> but was:<12>
      	at org.junit.Assert.fail(Assert.java:88)
      	at org.junit.Assert.failNotEquals(Assert.java:743)
      	at org.junit.Assert.assertEquals(Assert.java:118)
      	at org.junit.Assert.assertEquals(Assert.java:555)
      	at org.apache.hadoop.hdfs.server.namenode.TestFileTruncate.testTruncate4Symlink(TestFileTruncate.java:1158)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:601)
      	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
      	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
      	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
      	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
      	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
      	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
      	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
      	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
      	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
      	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
      	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
      	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
      	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
      	at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
      	at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
      	at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
      	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
      	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
      	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
      	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197)
      
      1. HDFS-8097-003.patch
        6 kB
        Rakesh R
      2. HDFS-8097-002.patch
        6 kB
        Rakesh R
      3. HDFS-8097-001.patch
        6 kB
        Rakesh R

        Activity

        Hide
        rakeshr Rakesh R added a comment -

        I could see many test cases are using the "/test" parent path. If any of these test case failed/missed to cleanup this "/test" parent path then would affect the cs.getSpaceConsumed() value.

         ContentSummary cs = fs.getContentSummary(parent);
            assertEquals("Bad disk space usage",
                cs.getSpaceConsumed(), newLength * REPLICATION);
        

        I think cleanup before every tests would help to resolve this case. I've updated a patch to do the cleanups. Please review. Thanks!

        Show
        rakeshr Rakesh R added a comment - I could see many test cases are using the "/test" parent path. If any of these test case failed/missed to cleanup this "/test" parent path then would affect the cs.getSpaceConsumed() value. ContentSummary cs = fs.getContentSummary(parent); assertEquals( "Bad disk space usage" , cs.getSpaceConsumed(), newLength * REPLICATION); I think cleanup before every tests would help to resolve this case. I've updated a patch to do the cleanups. Please review. Thanks!
        Hide
        rakeshr Rakesh R added a comment -

        Attached another patch to get the jenkins report.

        Show
        rakeshr Rakesh R added a comment - Attached another patch to get the jenkins report.
        Hide
        hadoopqa Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        0 pre-patch 5m 25s Pre-patch trunk compilation is healthy.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 tests included 0m 0s The patch appears to include 1 new or modified test files.
        +1 javac 7m 50s There were no new javac warning messages.
        +1 release audit 0m 20s The applied patch does not increase the total number of release audit warnings.
        +1 checkstyle 2m 18s There were no new checkstyle issues.
        +1 whitespace 0m 0s The patch has no lines that end in whitespace.
        +1 install 1m 34s mvn install still works.
        +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse.
        +1 findbugs 3m 11s The patch does not introduce any new Findbugs (version 2.0.3) warnings.
        +1 native 1m 23s Pre-build of native portion
        -1 hdfs tests 166m 48s Tests failed in hadoop-hdfs.
            189m 25s  



        Reason Tests
        Failed unit tests hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12730382/HDFS-8097-003.patch
        Optional Tests javac unit findbugs checkstyle
        git revision trunk / 318081c
        hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/10808/artifact/patchprocess/testrun_hadoop-hdfs.txt
        Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/10808/testReport/
        Java 1.7.0_55
        uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/10808/console

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment 0 pre-patch 5m 25s Pre-patch trunk compilation is healthy. +1 @author 0m 0s The patch does not contain any @author tags. +1 tests included 0m 0s The patch appears to include 1 new or modified test files. +1 javac 7m 50s There were no new javac warning messages. +1 release audit 0m 20s The applied patch does not increase the total number of release audit warnings. +1 checkstyle 2m 18s There were no new checkstyle issues. +1 whitespace 0m 0s The patch has no lines that end in whitespace. +1 install 1m 34s mvn install still works. +1 eclipse:eclipse 0m 32s The patch built with eclipse:eclipse. +1 findbugs 3m 11s The patch does not introduce any new Findbugs (version 2.0.3) warnings. +1 native 1m 23s Pre-build of native portion -1 hdfs tests 166m 48s Tests failed in hadoop-hdfs.     189m 25s   Reason Tests Failed unit tests hadoop.hdfs.server.namenode.ha.TestEditLogsDuringFailover Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12730382/HDFS-8097-003.patch Optional Tests javac unit findbugs checkstyle git revision trunk / 318081c hadoop-hdfs test log https://builds.apache.org/job/PreCommit-HDFS-Build/10808/artifact/patchprocess/testrun_hadoop-hdfs.txt Test Results https://builds.apache.org/job/PreCommit-HDFS-Build/10808/testReport/ Java 1.7.0_55 uname Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Console output https://builds.apache.org/job/PreCommit-HDFS-Build/10808/console This message was automatically generated.
        Hide
        arpitagarwal Arpit Agarwal added a comment - - edited

        Committed for 2.8.0. Thanks for the contribution Rakesh R.

        edit: Forgot to say, +1 and the test failure looks unrelated.

        Show
        arpitagarwal Arpit Agarwal added a comment - - edited Committed for 2.8.0. Thanks for the contribution Rakesh R . edit: Forgot to say, +1 and the test failure looks unrelated.
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #7780 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7780/)
        HDFS-8097. TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #7780 (See https://builds.apache.org/job/Hadoop-trunk-Commit/7780/ ) HDFS-8097 . TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #191 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/191/)
        HDFS-8097. TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #191 (See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/191/ ) HDFS-8097 . TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk #922 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/922/)
        HDFS-8097. TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #922 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/922/ ) HDFS-8097 . TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #2120 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2120/)
        HDFS-8097. TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef)

        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #2120 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2120/ ) HDFS-8097 . TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef) hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #180 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/180/)
        HDFS-8097. TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #180 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/180/ ) HDFS-8097 . TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #190 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/190/)
        HDFS-8097. TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #190 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/190/ ) HDFS-8097 . TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Hide
        hudson Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2138 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2138/)
        HDFS-8097. TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef)

        • hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java
        • hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        Show
        hudson Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2138 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2138/ ) HDFS-8097 . TestFileTruncate is failing intermittently. (Contributed by Rakesh R) (arp: rev 59995cec4ad9efcef7d4641375ca3eb40e2429ef) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFileTruncate.java hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

          People

          • Assignee:
            rakeshr Rakesh R
            Reporter:
            rakeshr Rakesh R
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development