Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-434

LocalJobRunner limited to single reducer

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 2.3.0
    • None
    • None
    • local job tracker

    Description

      when mapred.job.tracker is set to 'local', my setNumReduceTasks call is ignored, and the number of reduce tasks is set at 1.
      This prevents me from locally debugging my partition function, which tries to partition based on the number of reduce tasks.

      Attachments

        1. MAPREDUCE-434.patch
          44 kB
          Aaron Kimball
        2. MAPREDUCE-434.patch
          59 kB
          Thomas White
        3. MAPREDUCE-434.patch
          60 kB
          Thomas White
        4. MAPREDUCE-434.patch
          60 kB
          Thomas White
        5. MAPREDUCE-434.patch
          65 kB
          Sandy Ryza
        6. MAPREDUCE-434.patch
          65 kB
          Sandy Ryza
        7. MAPREDUCE-434.6.patch
          58 kB
          Aaron Kimball
        8. MAPREDUCE-434.5.patch
          58 kB
          Aaron Kimball
        9. MAPREDUCE-434.4.patch
          58 kB
          Aaron Kimball
        10. MAPREDUCE-434.3.patch
          55 kB
          Aaron Kimball
        11. MAPREDUCE-434.2.patch
          55 kB
          Aaron Kimball

        Issue Links

          Activity

            People

              kimballa Aaron Kimball
              yarnon Yoram Arnon
              Votes:
              5 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: