[MAPREDUCE-489] Force the task tracker to exit when the task is complete, prevents nodes from dying due to resource starvation from impropertly written map/reduce tasks

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Labels: newbie
• Assignee: Unassigned
• Reporter: Jason
• Created: 24/Jan/08 23:17
• Updated: 17/Jul/14 19:57

Description

We have map/reduce jobs that sometimes run additional threads that are not at daemon priority, and these threads prevent the Task from properly exiting. When enough of these accumulate, the node falls over.

The included patch forces the Tasks to exit when completed.

Index: src/java/org/apache/hadoop/mapred/TaskTracker.java
===================================================================
— src/java/org/apache/hadoop/mapred/TaskTracker.java (revision 608611)
+++ src/java/org/apache/hadoop/mapred/TaskTracker.java (working copy)
@@ -1801,6 +1801,8 @@
// This assumes that on return from Task.run()
// there is no more logging done.
LogManager.shutdown();
+
+ System.exit(0);
}
}
}