HBase
  1. HBase
  2. HBASE-10764

TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure takes too long

    Details

    • Type: Test Test
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.98.1, 0.99.0
    • Component/s: test
    • Labels:
      None

      Description

      While running
      TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure found its taking longer time. Checked in the builds also. Its taking too long time to complete.

      testBulkLoadPhaseFailure	9 min 14 sec	Passed
      

        Activity

        rajeshbabu created issue -
        Hide
        rajeshbabu added a comment - - edited

        Here is the patch for trunk. In the test reduced retry count to 2 to come out quickly on bulkload failure.
        Its taking few seconds only.

        Show
        rajeshbabu added a comment - - edited Here is the patch for trunk. In the test reduced retry count to 2 to come out quickly on bulkload failure. Its taking few seconds only.
        rajeshbabu made changes -
        Field Original Value New Value
        Attachment HBASE-10764.patch [ 12634916 ]
        rajeshbabu made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        rajeshbabu added a comment -
        fail("doBulkLoad should have thrown an exception");}
        

        Here code format missed with brace.I will change this on commit.

        Show
        rajeshbabu added a comment - fail( "doBulkLoad should have thrown an exception" );} Here code format missed with brace.I will change this on commit.
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12634916/HBASE-10764.patch
        against trunk revision .
        ATTACHMENT ID: 12634916

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 3 new or modified tests.

        +1 hadoop1.0. The patch compiles against the hadoop 1.0 profile.

        +1 hadoop1.1. The patch compiles against the hadoop 1.1 profile.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 lineLengths. The patch does not introduce lines longer than 100

        +1 site. The mvn site goal succeeds with this patch.

        +1 core tests. The patch passed unit tests in .

        Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12634916/HBASE-10764.patch against trunk revision . ATTACHMENT ID: 12634916 +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 3 new or modified tests. +1 hadoop1.0 . The patch compiles against the hadoop 1.0 profile. +1 hadoop1.1 . The patch compiles against the hadoop 1.1 profile. +1 javadoc . The javadoc tool did not generate any warning messages. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 lineLengths . The patch does not introduce lines longer than 100 +1 site . The mvn site goal succeeds with this patch. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/9014//console This message is automatically generated.
        Hide
        Ted Yu added a comment -
        Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery
        Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.279 sec
        

        +1 from me.

        Show
        Ted Yu added a comment - Running org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.279 sec +1 from me.
        Andrew Purtell made changes -
        Summary TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure taking too long time(around 10 min.) TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure takes too long
        Hide
        Andrew Purtell added a comment -

        I am testing HBASE-10763 and HBASE-10764 together. If no zombies or issues after 20 runs locally I will commit both to trunk and 0.98 as needed unless objection.

        Show
        Andrew Purtell added a comment - I am testing HBASE-10763 and HBASE-10764 together. If no zombies or issues after 20 runs locally I will commit both to trunk and 0.98 as needed unless objection.
        Hide
        Andrew Purtell added a comment -

        Committed to trunk and 0.98.

        stack - want this in 0.96?

        Show
        Andrew Purtell added a comment - Committed to trunk and 0.98. stack - want this in 0.96?
        Andrew Purtell made changes -
        Fix Version/s 0.98.1 [ 12325664 ]
        Fix Version/s 0.98.2 [ 12326505 ]
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in HBase-0.98 #237 (See https://builds.apache.org/job/HBase-0.98/237/)
        HBASE-10764 TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure takes too long (rajeshbabu) (apurtell: rev 1577950)

        • /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
        Show
        Hudson added a comment - SUCCESS: Integrated in HBase-0.98 #237 (See https://builds.apache.org/job/HBase-0.98/237/ ) HBASE-10764 TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure takes too long (rajeshbabu) (apurtell: rev 1577950) /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
        Hide
        Hudson added a comment -

        FAILURE: Integrated in HBase-TRUNK #5017 (See https://builds.apache.org/job/HBase-TRUNK/5017/)
        HBASE-10764 TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure takes too long (rajeshbabu) (apurtell: rev 1577949)

        • /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
        Show
        Hudson added a comment - FAILURE: Integrated in HBase-TRUNK #5017 (See https://builds.apache.org/job/HBase-TRUNK/5017/ ) HBASE-10764 TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure takes too long (rajeshbabu) (apurtell: rev 1577949) /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in HBase-0.98-on-Hadoop-1.1 #222 (See https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/222/)
        HBASE-10764 TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure takes too long (rajeshbabu) (apurtell: rev 1577950)

        • /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
        Show
        Hudson added a comment - SUCCESS: Integrated in HBase-0.98-on-Hadoop-1.1 #222 (See https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/222/ ) HBASE-10764 TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure takes too long (rajeshbabu) (apurtell: rev 1577950) /hbase/branches/0.98/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
        Hide
        Andrew Purtell added a comment -

        Resolving so CHANGES.txt for 0.98.1 is correct.

        Show
        Andrew Purtell added a comment - Resolving so CHANGES.txt for 0.98.1 is correct.
        Andrew Purtell made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 0.96.2 [ 12325658 ]
        Resolution Fixed [ 1 ]
        Hide
        Hudson added a comment -

        FAILURE: Integrated in HBase-TRUNK-on-Hadoop-1.1 #120 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-1.1/120/)
        HBASE-10764 TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure takes too long (rajeshbabu) (apurtell: rev 1577949)

        • /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
        Show
        Hudson added a comment - FAILURE: Integrated in HBase-TRUNK-on-Hadoop-1.1 #120 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-1.1/120/ ) HBASE-10764 TestLoadIncrementalHFilesSplitRecovery#testBulkLoadPhaseFailure takes too long (rajeshbabu) (apurtell: rev 1577949) /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
        Hide
        Enis Soztutar added a comment -

        Closing this issue after 0.99.0 release.

        Show
        Enis Soztutar added a comment - Closing this issue after 0.99.0 release.
        Enis Soztutar made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        47m 47s 1 rajeshbabu 15/Mar/14 13:49
        Patch Available Patch Available Resolved Resolved
        1d 5h 52m 1 Andrew Purtell 16/Mar/14 19:42
        Resolved Resolved Closed Closed
        342d 3h 48m 1 Enis Soztutar 21/Feb/15 23:31

          People

          • Assignee:
            rajeshbabu
            Reporter:
            rajeshbabu
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development