Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-434

LocalJobRunner limited to single reducer

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None
    • local job tracker

    Description

      when mapred.job.tracker is set to 'local', my setNumReduceTasks call is ignored, and the number of reduce tasks is set at 1.
      This prevents me from locally debugging my partition function, which tries to partition based on the number of reduce tasks.

      Attachments

        1. MAPREDUCE-434.patch
          44 kB
          Aaron Kimball
        2. MAPREDUCE-434.2.patch
          55 kB
          Aaron Kimball
        3. MAPREDUCE-434.3.patch
          55 kB
          Aaron Kimball
        4. MAPREDUCE-434.4.patch
          58 kB
          Aaron Kimball
        5. MAPREDUCE-434.5.patch
          58 kB
          Aaron Kimball
        6. MAPREDUCE-434.6.patch
          58 kB
          Aaron Kimball
        7. MAPREDUCE-434.patch
          59 kB
          Thomas White
        8. MAPREDUCE-434.patch
          60 kB
          Thomas White
        9. MAPREDUCE-434.patch
          60 kB
          Thomas White
        10. MAPREDUCE-434.patch
          65 kB
          Sandy Ryza
        11. MAPREDUCE-434.patch
          65 kB
          Sandy Ryza

        Issue Links

          Activity

            People

              kimballa Aaron Kimball
              yarnon Yoram Arnon
              Votes:
              5 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: