Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-478

separate jvm param for mapper and reducer

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 0.20.203.0, 0.22.0
    • None
    • None
    • Reviewed
    • Hide
      Allow map and reduce jvm parameters, environment variables and ulimit to be set separately.

      Configuration changes:
            add mapred.map.child.java.opts
            add mapred.reduce.child.java.opts
            add mapred.map.child.env
            add mapred.reduce.child.ulimit
            add mapred.map.child.env
            add mapred.reduce.child.ulimit
            deprecated mapred.child.java.opts
            deprecated mapred.child.env
            deprecated mapred.child.ulimit
      Show
      Allow map and reduce jvm parameters, environment variables and ulimit to be set separately. Configuration changes:       add mapred.map.child.java.opts       add mapred.reduce.child.java.opts       add mapred.map.child.env       add mapred.reduce.child.ulimit       add mapred.map.child.env       add mapred.reduce.child.ulimit       deprecated mapred.child.java.opts       deprecated mapred.child.env       deprecated mapred.child.ulimit

    Description

      Memory footprint of mapper and reducer can differ.
      It would be nice if we can pass different jvm param (mapred.child.java.opts) for mappers and reducers.

      Attachments

        1. 478.20S-1.patch
          49 kB
          Ravi Gummadi
        2. HADOOP-5684_0_20090420.patch
          2 kB
          Arun Murthy
        3. MAPREDUCE-478_0_20090804_yhadoop20.patch
          57 kB
          Arun Murthy
        4. MAPREDUCE-478_0_20090804.patch
          48 kB
          Arun Murthy
        5. MAPREDUCE-478_1_20090806_yhadoop20.patch
          86 kB
          Arun Murthy
        6. MAPREDUCE-478_1_20090806.patch
          43 kB
          Arun Murthy
        7. MAPREDUCE-478_2_20090813_yhadoop.patch
          56 kB
          Arun Murthy
        8. MAPREDUCE-478_2_20090813.patch
          48 kB
          Arun Murthy
        9. MAPREDUCE-478_2_20090813.patch
          48 kB
          Arun Murthy
        10. MAPREDUCE-478_3_20090814_yhadoop.patch
          57 kB
          Arun Murthy
        11. MAPREDUCE-478_3_20090814.patch
          48 kB
          Arun Murthy

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            acmurthy Arun Murthy Assign to me
            knoguchi Koji Noguchi
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment