Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4374

Fix child task environment variable config and add support for Windows

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1-win, 2.1.0-beta, 3.0.0-alpha1
    • Fix Version/s: 1-win, 2.1.0-beta
    • Component/s: mrv2
    • Labels:
      None

      Description

      In HADOOP-2838, a new feature was introduced to set environment variables via the Hadoop config 'mapred.child.env' for child tasks. There are some further fixes and improvements around this feature, e.g. HADOOP-5981 were a bug fix; MAPREDUCE-478 broke the config into 'mapred.map.child.env' and 'mapred.reduce.child.env'. However the current implementation is still not complete. It does not match its documentation or original intend as I believe. Also, by using ‘:’ (colon) and ‘;’ (semicolon) in the configuration syntax, we will have problems using them on Windows because ‘:’ appears very often in Windows path as in “C:\”, and environment variables are used very often to hold path names. The Jira is created to fix the problem and provide support on Windows.

        Attachments

        1. MAPREDUCE-4374-branch-1-win.patch
          17 kB
          Chuan Liu
        2. MAPREDUCE-4374-branch-1-win-2.patch
          18 kB
          Chuan Liu
        3. MAPREDUCE-4374-trunk.2.patch
          12 kB
          Chuan Liu
        4. MAPREDUCE-4374-trunk.3.patch
          12 kB
          Chuan Liu
        5. MAPREDUCE-4374-trunk.patch
          12 kB
          Chuan Liu

          Issue Links

            Activity

              People

              • Assignee:
                chuanliu Chuan Liu
                Reporter:
                chuanliu Chuan Liu
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: