[TEZ-3000] Fix TestContainerReuse

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.1-alpha
• Fix Version/s: 0.9.0, 0.8.5
• Hadoop Flags: Reviewed
• Assignee: Ming Ma
• Reporter: Jeff Zhang
• Created: 15/Dec/15 14:22
• Updated: 14/Mar/17 03:49
• Resolved: 21/Sep/16 23:26

Description

https://builds.apache.org/job/PreCommit-TEZ-Build/1381//testReport/org.apache.tez.dag.app.rm/TestContainerReuse/testReuseWithTaskSpecificLaunchCmdOption/

Error Message

Wanted but not invoked:
taskSchedulerManagerForTest.taskAllocated(
    0,
    Mock for TaskAttempt, hashCode: 829607670,
    <any>,
    Container: [ContainerId: container_1_0001_01_000002, NodeId: host3:0, NodeHttpAddress: host3:0, Resource: <memory:1024, vCores:1>, Priority: 1, Token: null, ]
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:686)

However, there were other interactions with this mock:
taskSchedulerManagerForTest.init(
    Configuration: core-default.xml, core-site.xml, yarn-default.xml, yarn-site.xml
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:537)

taskSchedulerManagerForTest.setConfig(
    Configuration: core-default.xml, core-site.xml, yarn-default.xml, yarn-site.xml
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:537)

taskSchedulerManagerForTest.serviceInit(
    Configuration: core-default.xml, core-site.xml, yarn-default.xml, yarn-site.xml
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:537)

taskSchedulerManagerForTest.start();
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:538)

taskSchedulerManagerForTest.serviceStart();
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:538)

taskSchedulerManagerForTest.instantiateSchedulers(
    "host",
    0,
    "",
    Mock for AppContext, hashCode: 321692161
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:538)

taskSchedulerManagerForTest.getContainerSignatureMatcher();
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:538)

taskSchedulerManagerForTest.getConfig();
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:538)

taskSchedulerManagerForTest.setApplicationRegistrationData(
    0,
    Mock for Resource, hashCode: 1463810428,
    Mock for Map, hashCode: 689203364,
    null
);
-> at org.apache.tez.dag.app.rm.TaskSchedulerContextImpl.setApplicationRegistrationData(TaskSchedulerContextImpl.java:92)

taskSchedulerManagerForTest.getSpyTaskScheduler();
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:540)

taskSchedulerManagerForTest.handleEvent(
    EventType: S_TA_LAUNCH_REQUEST
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:577)

taskSchedulerManagerForTest.handleEvent(
    EventType: S_TA_LAUNCH_REQUEST
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:580)

taskSchedulerManagerForTest.taskAllocated(
    0,
    Mock for TaskAttempt, hashCode: 365305781,
    EventType: S_TA_LAUNCH_REQUEST,
    Container: [ContainerId: container_1_0001_01_000001, NodeId: host1:0, NodeHttpAddress: host1:0, Resource: <memory:1024, vCores:1>, Priority: 1, Token: null, ]
);
-> at org.apache.tez.dag.app.rm.TaskSchedulerContextImpl.taskAllocated(TaskSchedulerContextImpl.java:65)

taskSchedulerManagerForTest.handleEvent(
    EventType: S_TA_ENDED
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:594)

taskSchedulerManagerForTest.containerBeingReleased(
    0,
    container_1_0001_01_000001
);
-> at org.apache.tez.dag.app.rm.TaskSchedulerContextImpl.containerBeingReleased(TaskSchedulerContextImpl.java:75)

taskSchedulerManagerForTest.handleEvent(
    EventType: S_TA_LAUNCH_REQUEST
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:627)

taskSchedulerManagerForTest.handleEvent(
    EventType: S_TA_LAUNCH_REQUEST
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:630)

taskSchedulerManagerForTest.taskAllocated(
    0,
    Mock for TaskAttempt, hashCode: 1149896995,
    EventType: S_TA_LAUNCH_REQUEST,
    Container: [ContainerId: container_1_0001_01_000002, NodeId: host2:0, NodeHttpAddress: host2:0, Resource: <memory:1024, vCores:1>, Priority: 1, Token: null, ]
);
-> at org.apache.tez.dag.app.rm.TaskSchedulerContextImpl.taskAllocated(TaskSchedulerContextImpl.java:65)

taskSchedulerManagerForTest.handleEvent(
    EventType: S_TA_ENDED
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:642)

taskSchedulerManagerForTest.containerBeingReleased(
    0,
    container_1_0001_01_000002
);
-> at org.apache.tez.dag.app.rm.TaskSchedulerContextImpl.containerBeingReleased(TaskSchedulerContextImpl.java:75)

taskSchedulerManagerForTest.handleEvent(
    EventType: S_TA_LAUNCH_REQUEST
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:679)

taskSchedulerManagerForTest.handleEvent(
    EventType: S_TA_LAUNCH_REQUEST
);
-> at org.apache.tez.dag.app.rm.TestContainerReuse.testReuseWithTaskSpecificLaunchCmdOption(TestContainerReuse.java:680)

Issue Links

• is duplicated by: TEZ-2905 TestContainerReuse fails in jenkins
• is duplicated by: TEZ-3132 Flaky test: TestContainerReuse.testReuseConflictLocalResources