[MAPREDUCE-4260] Use JobObject to spawn tasks on Windows

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Assignee: Bikas Saha
• Reporter: Bikas Saha
• Created: 15/May/12 23:12
• Updated: 16/Jun/12 00:34
• Resolved: 16/Jun/12 00:34

Description

Currently, the Windows version spawns the task as a normal cmd shell from which other downstream exe's are spawned. However, this is not bullet proof because if an intermediate process exits before its child exits, then the parent child process tree relationship cannot be constructed. Windows has a concept of JobObject that is similar to the setsid behavior used in Linux. The initial spawned task could be launched within its JobObject. Thereafter, process termination, memory management etc could be operated on the JobObject.

Issue Links

• is part of: HADOOP-8079 Proposal for enhancements to Hadoop for Windows Server and Windows Azure development and runtime environments