[MAPREDUCE-7314] Job will hang if NM is restarted while its running

• Type: Sub-task
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Assignee: Bilwa S T
• Reporter: Bilwa S T
• Created: 15/Dec/20 09:51
• Updated: 20/Jan/21 19:12

Description

This is due to three different reasons

1. PRIORITY_FAST_FAIL_MAP priority containers should be considered for reuse.
2. Whenever CONTAINER_REMOTE_CLEANUP is fired for task attempt, it wont kill current attempt which is assigned to container. That is because task attempt is not updated in ContainerLauncherImpl#Container class. 
3. Container gets assigned to task attempt even when container has stopped running ie Container completed event is processed. This is because we add reuse container map to allocated list. Makeremoterequest gets the same container in allocationResponse whereas RM has sent same container in finished container list. To avoid this we need to make sure allocated list doesnt have any containers which are finished.

Test credits : Rajshree