[SYSTEMDS-261] ParForParallelRemoteResultMergeTest fails due to unexpected number of number of MR jobs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Component/s: ParFor
• Environment: Centos 7.1 ; Jenkins Slave
• Assignee: Matthias Boehm
• Reporter: Alan Chin
• Created: 27/Aug/15 22:10
• Updated: 11/Jan/16 19:04
• Resolved: 11/Jan/16 19:03

Description

Consistently fails with # of MR jobs below what the tests were expecting, usually under 20.

Output as follows:
Running com.ibm.bi.dml.test.integration.functions.parfor.ParForParallelRemoteResultMergeTest
Tests run: 4, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 608.045 sec <<< FAILURE! - in com.ibm.bi.dml.test.integration.functions.parfor.ParForParallelRemoteResultMergeTest
testMultipleResultMergeManySparse(com.ibm.bi.dml.test.integration.functions.parfor.ParForParallelRemoteResultMergeTest) Time elapsed: 279.185 sec <<< FAILURE!
java.lang.AssertionError: Unexpected number of executed MR jobs. expected:<33> but was:<12>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at com.ibm.bi.dml.test.integration.functions.parfor.ParForParallelRemoteResultMergeTest.runParallelRemoteResultMerge(ParForParallelRemoteResultMergeTest.java:132)
at com.ibm.bi.dml.test.integration.functions.parfor.ParForParallelRemoteResultMergeTest.testMultipleResultMergeManySparse(ParForParallelRemoteResultMergeTest.

testMultipleResultMergeManyDense(com.ibm.bi.dml.test.integration.functions.parfor.ParForParallelRemoteResultMergeTest) Time elapsed: 294.201 sec <<< FAILURE!
java.lang.AssertionError: Unexpected number of executed MR jobs. expected:<33> but was:<11>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:555)
at com.ibm.bi.dml.test.integration.functions.parfor.ParForParallelRemoteResultMergeTest.runParallelRemoteResultMerge(ParForParallelRemoteResultMergeTest.java:132)
at com.ibm.bi.dml.test.integration.functions.parfor.ParForParallelRemoteResultMergeTest.testMultipleResultMergeManyDense(ParForParallelRemoteResultMergeTest.java:74)