Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1206

Need a better answer for "how many reduces?"

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • None
    • None

    Description

      http://hadoop.apache.org/common/docs/current/mapred_tutorial.html#Reducer

      -snip-
      How Many Reduces?

      The right number of reduces seems to be 0.95 or 1.75 multiplied by (<no. of nodes> * mapred.tasktracker.reduce.tasks.maximum).
      -snip-

      Sure, if you only ever run one job on your grid. There should really be a better answer here, especially explaining what the impact is of a high/low number when chaining multiple map/reduce jobs.

      Attachments

        Activity

          People

            Unassigned Unassigned
            aw Allen Wittenauer
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: