[YARN-4350] TestDistributedShell fails for V2 scenarios

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: YARN-2928
• Fix Version/s: 2.9.0, 3.0.0-alpha1
• Component/s: timelineserver
• Target Version/s: YARN-2928
• Hadoop Flags: Reviewed
• Assignee: Naganarasimha G R
• Reporter: Sangjin Lee
• Created: 12/Nov/15 01:58
• Updated: 21/Oct/17 06:05
• Resolved: 19/Dec/15 20:47

Description

Currently TestDistributedShell does not pass on the feature-YARN-2928 branch. There seem to be 2 distinct issues.

(1) testDSShellWithoutDomainV2* tests fail sporadically
These test fail more often than not if tested by themselves:

testDSShellWithoutDomainV2DefaultFlow(org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell)  Time elapsed: 30.998 sec  <<< FAILURE!
java.lang.AssertionError: Application created event should be published atleast once expected:<1> but was:<0>
	at org.junit.Assert.fail(Assert.java:88)
	at org.junit.Assert.failNotEquals(Assert.java:743)
	at org.junit.Assert.assertEquals(Assert.java:118)
	at org.junit.Assert.assertEquals(Assert.java:555)
	at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.checkTimelineV2(TestDistributedShell.java:451)
	at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.testDSShell(TestDistributedShell.java:326)
	at org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell.testDSShellWithoutDomainV2DefaultFlow(TestDistributedShell.java:207)

They start happening after YARN-4129. I suspect this might have to do with some timing issue.

(2) the whole test times out
If you run the whole TestDistributedShell test, it times out without fail. This may or may not have to do with the port change introduced by YARN-2859 (just a hunch).

Issue Links

• is related to: YARN-2859 ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster
• is related to: YARN-4372 Cannot enable system-metrics-publisher inside MiniYARNCluster
• relates to: YARN-4385 TestDistributedShell times out