[FLINK-2392] Instable test in flink-yarn-tests

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.10.0
• Fix Version/s: 1.1.0
• Component/s: Tests
• Labels: test-stability
• Assignee: Robert Metzger
• Reporter: Matthias J. Sax
• Created: 22/Jul/15 12:41
• Updated: 21/Jul/16 13:33
• Resolved: 21/Jul/16 13:33

Description

The test YARNSessionFIFOITCase fails from time to time on an irregular basis. For example see: https://travis-ci.org/apache/flink/jobs/72019690

Tests run: 12, Failures: 1, Errors: 0, Skipped: 2, Time elapsed: 205.163 sec <<< FAILURE! - in org.apache.flink.yarn.YARNSessionFIFOITCase
perJobYarnClusterWithParallelism(org.apache.flink.yarn.YARNSessionFIFOITCase)  Time elapsed: 60.651 sec  <<< FAILURE!
java.lang.AssertionError: During the timeout period of 60 seconds the expected string did not show up
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.apache.flink.yarn.YarnTestBase.runWithArgs(YarnTestBase.java:478)
	at org.apache.flink.yarn.YARNSessionFIFOITCase.perJobYarnClusterWithParallelism(YARNSessionFIFOITCase.java:435)

Results :
Failed tests: 
  YARNSessionFIFOITCase.perJobYarnClusterWithParallelism:435->YarnTestBase.runWithArgs:478 During the timeout period of 60 seconds the expected string did not show up

Another error case is this (see https://travis-ci.org/mjsax/flink/jobs/77313444)

Tests run: 12, Failures: 3, Errors: 0, Skipped: 2, Time elapsed: 182.008 sec <<< FAILURE! - in org.apache.flink.yarn.YARNSessionFIFOITCase
testTaskManagerFailure(org.apache.flink.yarn.YARNSessionFIFOITCase)  Time elapsed: 27.356 sec  <<< FAILURE!
java.lang.AssertionError: Found a file /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_000003/taskmanager.log with a prohibited string: [Exception, Started SelectChannelConnector@0.0.0.0:8081]
	at org.junit.Assert.fail(Assert.java:88)
	at org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:294)
	at org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:94)

testNonexistingQueue(org.apache.flink.yarn.YARNSessionFIFOITCase)  Time elapsed: 17.421 sec  <<< FAILURE!
java.lang.AssertionError: Found a file /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_000003/taskmanager.log with a prohibited string: [Exception, Started SelectChannelConnector@0.0.0.0:8081]
	at org.junit.Assert.fail(Assert.java:88)
	at org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:294)
	at org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:94)

testJavaAPI(org.apache.flink.yarn.YARNSessionFIFOITCase)  Time elapsed: 11.984 sec  <<< FAILURE!
java.lang.AssertionError: Found a file /home/travis/build/mjsax/flink/flink-yarn-tests/target/flink-yarn-tests-fifo/flink-yarn-tests-fifo-logDir-nm-0_0/application_1440595422559_0007/container_1440595422559_0007_01_000003/taskmanager.log with a prohibited string: [Exception, Started SelectChannelConnector@0.0.0.0:8081]
	at org.junit.Assert.fail(Assert.java:88)
	at org.apache.flink.yarn.YarnTestBase.ensureNoProhibitedStringInLogFiles(YarnTestBase.java:294)
	at org.apache.flink.yarn.YARNSessionFIFOITCase.checkForProhibitedLogContents(YARNSessionFIFOITCase.java:94)

Furthermore, this build failed too: https://travis-ci.org/apache/flink/jobs/77313450
(no error, but Travis terminated to due no progress for 300 seconds -> deadlock?)

Issue Links

• is duplicated by: FLINK-2700 YarnSessionFIFOITCase.testJavaApi failure