Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2003

It should be able to specify different jvm settings for map and reduce child process (via mapred.child.map.java.opts and mapred.child.reduce.java.opts options)

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: 0.20.3, 0.21.0, 0.22.0
    • Component/s: tasktracker
    • Labels:
      None

      Description

      Sometimes mapper child process requires different JVM settings than reducer. For example when mapper requires much more memory than reducer.
      Now it's only possible to set options for both using mapred.child.java.opts.

      Proposed solution: mapred.child.java.opts could be overwritten by mapred.child.map.java.opts or mapred.child.reduce.java.opts. Thus, we're adding more flexibility and compatibility with old configurations.

      The same should be done for mapred.child.env.

        Activity

          People

          • Assignee:
            Unassigned
            Reporter:
            Vladimir Klimontovich
          • Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development