[MAPREDUCE-3339] Job is getting hanged indefinitely,if the child processes are killed on the NM. KILL_CONTAINER eventtype is continuosly sent to the containers that are not existing

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.23.0
• Fix Version/s: 0.23.1
• Component/s: mrv2
• Target Version/s: 0.23.1
• Hadoop Flags: Reviewed
• Release Note: Fixed MR AM to stop considering node blacklisting after the number of nodes blacklisted crosses a threshold.
• Assignee: Siddharth Seth Assign to me
• Reporter: Ramgopal N
• Created: 03/Nov/11 10:03
• Updated: 03/Oct/13 20:44
• Resolved: 20/Dec/11 23:28

Description

I have only one NM running.
I have submitted a job and all the child processes on the NM got killed continuosly.This made the Job to hang indefinitely.

In the NM logs it is logging WARN message :org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl: Event EventType: KILL_CONTAINER sent to absent container container_1320301910500_0004_01_001359

Issue Links

• is related to: MAPREDUCE-5559 Reconsidering the policy of ignoring the blacklist after reaching the threshold