Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-97

Increase map/reduce child tasks' heapsize from current default of 200M to 512M

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • None
    • None
    • None
    • None

    Description

      I guess we should look to check why we get OOMs with 200M, I'd suspect io.sort.mb hogs a lot of the default 200M. However, HADOOP-1867 should be the right way to solve it.

      For now, I propose we bump up the child-vm default heapsize to 512M; too many people are getting burnt by 200M.

      Attachments

        Activity

          People

            acmurthy Arun Murthy
            acmurthy Arun Murthy
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: