[MAPREDUCE-4374] Fix child task environment variable config and add support for Windows

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1-win, 2.1.0-beta, 3.0.0-alpha1
• Fix Version/s: 1-win, 2.1.0-beta
• Component/s: mrv2
• Target Version/s: 1-win, 2.1.0-beta
• Hadoop Flags: Reviewed
• Assignee: Chuan Liu
• Reporter: Chuan Liu
• Created: 26/Jun/12 18:53
• Updated: 12/May/16 18:22
• Resolved: 10/Jul/13 23:21

Description

In HADOOP-2838, a new feature was introduced to set environment variables via the Hadoop config 'mapred.child.env' for child tasks. There are some further fixes and improvements around this feature, e.g. HADOOP-5981 were a bug fix; MAPREDUCE-478 broke the config into 'mapred.map.child.env' and 'mapred.reduce.child.env'. However the current implementation is still not complete. It does not match its documentation or original intend as I believe. Also, by using ‘:’ (colon) and ‘;’ (semicolon) in the configuration syntax, we will have problems using them on Windows because ‘:’ appears very often in Windows path as in “C:\”, and environment variables are used very often to hold path names. The Jira is created to fix the problem and provide support on Windows.

Issue Links

• is part of: MAPREDUCE-4401 Enhancements to MapReduce for Windows Server and Windows Azure development and runtime environments
• is part of: HADOOP-8645 Stabilize branch-1-win
• relates to: HADOOP-9790 Job token path is not unquoted properly