Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3376

Old mapred API combiner uses NULL reporter

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20.205.0, 0.23.0, 2.0.0-alpha
    • 0.23.1
    • mrv1, mrv2
    • None

    Description

      The OldCombinerRunner class inside Task.java uses a NULL Reporter. If the combiner code runs for an extended period of time, even with reporting progress as it should, the map task can timeout and be killed. It appears that the NewCombinerRunner class uses a valid reporter and as such is not impacted by this bug.

      Attachments

        1. MAPREDUCE-3376.patch
          7 kB
          Subroto Sanyal

        Activity

          People

            subrotosanyal Subroto Sanyal
            revans2 Robert Joseph Evans
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: