Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2003

It should be able to specify different jvm settings for map and reduce child process (via mapred.child.map.java.opts and mapred.child.reduce.java.opts options)

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: 0.20.3, 0.21.0, 0.22.0
    • Component/s: tasktracker
    • Labels:
      None

      Description

      Sometimes mapper child process requires different JVM settings than reducer. For example when mapper requires much more memory than reducer.
      Now it's only possible to set options for both using mapred.child.java.opts.

      Proposed solution: mapred.child.java.opts could be overwritten by mapred.child.map.java.opts or mapred.child.reduce.java.opts. Thus, we're adding more flexibility and compatibility with old configurations.

      The same should be done for mapred.child.env.

        Activity

        Hide
        Krishna Ramachandran added a comment -
        Show
        Krishna Ramachandran added a comment - can you check if MAPREDUCE-1207 will work for you? https://issues.apache.org/jira/browse/MAPREDUCE-1207
        Hide
        Amareshwari Sriramadasu added a comment -

        This is already fixed by MAPREDUCE-478. Please close it as duplicate if you are looking for the same.

        Show
        Amareshwari Sriramadasu added a comment - This is already fixed by MAPREDUCE-478 . Please close it as duplicate if you are looking for the same.
        Hide
        Vladimir Klimontovich added a comment -

        Yep, MAPREDUCE-1207 is exactly the same. Sorry for duplicate bug, closing

        Show
        Vladimir Klimontovich added a comment - Yep, MAPREDUCE-1207 is exactly the same. Sorry for duplicate bug, closing

          People

          • Assignee:
            Unassigned
            Reporter:
            Vladimir Klimontovich
          • Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development