Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5059

Job overview shows average merge time larger than for any reduce attempt

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      When looking at a job overview page on the history server, the Average Merge Time is often reported with a value that is far larger than the Elapsed Merge Time shown for any reduce task attempt. The job overview page calculates the merge time as the time delta between the sort finishing and the job launching while the attempts page calculates it as the time delta between the sort finishing and the shuffle finishing.

        Attachments

        1. MAPREDUCE-5059-20130410.patch
          49 kB
          Omkar Vinit Joshi
        2. MAPREDUCE-5059-20130325.patch
          48 kB
          Omkar Vinit Joshi

          Activity

            People

            • Assignee:
              ojoshi Omkar Vinit Joshi
              Reporter:
              jlowe Jason Darrell Lowe
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: