Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-478

separate jvm param for mapper and reducer

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.20.203.0, 0.22.0
    • None
    • None
    • Reviewed
    • Hide
      Allow map and reduce jvm parameters, environment variables and ulimit to be set separately.

      Configuration changes:
            add mapred.map.child.java.opts
            add mapred.reduce.child.java.opts
            add mapred.map.child.env
            add mapred.reduce.child.ulimit
            add mapred.map.child.env
            add mapred.reduce.child.ulimit
            deprecated mapred.child.java.opts
            deprecated mapred.child.env
            deprecated mapred.child.ulimit
      Show
      Allow map and reduce jvm parameters, environment variables and ulimit to be set separately. Configuration changes:       add mapred.map.child.java.opts       add mapred.reduce.child.java.opts       add mapred.map.child.env       add mapred.reduce.child.ulimit       add mapred.map.child.env       add mapred.reduce.child.ulimit       deprecated mapred.child.java.opts       deprecated mapred.child.env       deprecated mapred.child.ulimit

    Description

      Memory footprint of mapper and reducer can differ.
      It would be nice if we can pass different jvm param (mapred.child.java.opts) for mappers and reducers.

      Attachments

        1. HADOOP-5684_0_20090420.patch
          2 kB
          Arun Murthy
        2. MAPREDUCE-478_0_20090804.patch
          48 kB
          Arun Murthy
        3. MAPREDUCE-478_0_20090804_yhadoop20.patch
          57 kB
          Arun Murthy
        4. MAPREDUCE-478_1_20090806.patch
          43 kB
          Arun Murthy
        5. MAPREDUCE-478_1_20090806_yhadoop20.patch
          86 kB
          Arun Murthy
        6. MAPREDUCE-478_2_20090813.patch
          48 kB
          Arun Murthy
        7. MAPREDUCE-478_2_20090813_yhadoop.patch
          56 kB
          Arun Murthy
        8. MAPREDUCE-478_2_20090813.patch
          48 kB
          Arun Murthy
        9. MAPREDUCE-478_3_20090814_yhadoop.patch
          57 kB
          Arun Murthy
        10. MAPREDUCE-478_3_20090814.patch
          48 kB
          Arun Murthy
        11. 478.20S-1.patch
          49 kB
          Ravi Gummadi

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-6192 Shell.getUlimitMemoryCommand is tied to Map-Reduce

          • Major - Major loss of function.
          • Closed

          Activity

            People

              acmurthy Arun Murthy
              knoguchi Koji Noguchi
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: