Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2632

Avoid calling the partitioner when the numReduceTasks is 1.

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      A partitioner is now only created if there are multiple reducers.

      Description

      We can avoid the call to the partitioner when the number of reducers is 1.This will avoid the unnecessary computations by the partitioner.

        Attachments

        1. 0001-MAPREDUCE-2632.patch
          7 kB
          Sunil Govindan
        2. MAPREDUCE-2632.patch
          3 kB
          Ravi Teja Ch N V
        3. MAPREDUCE-2632-1.patch
          9 kB
          Ravi Teja Ch N V
        4. mr-2632-2.patch
          6 kB
          Karthik Kambatla
        5. mr-2632-3.patch
          9 kB
          Karthik Kambatla
        6. mr-2632-4.patch
          11 kB
          Karthik Kambatla

          Issue Links

            Activity

              People

              • Assignee:
                sunilg Sunil Govindan
                Reporter:
                raviteja Ravi Teja Ch N V
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: