Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2511

Progress reported by map tasks of a map-only job is incorrect

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 0.23.0
    • None
    • None
    • None

    Description

      For a map task of a map-reduce job, the progress bar is (logically) split into 2 distinct phases
      1. Map Phase
      2. Sort Phase

      The map phase manages 66% of the overall tasks progress while the sort phase governs the rest i.e 33%.

      For a map task of a map-only job, there is no sort phase. Hence the entire map phase should govern 100% of the task's progress. Currently, the progress bar is split divided into 66%-33% irrespective of whether the job has reducers or not (i.e whether there is a sort phase or not).

      Attachments

        Issue Links

          Activity

            People

              amar_kamat Amar Kamat
              amar_kamat Amar Kamat
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: