Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1845

Elapsed time for failed tasks that never started is wrong

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.9
    • 2.5.0
    • None
    • None

    Description

      The elapsed time for tasks in a failed job that were never
      started can be way off. It looks like we're marking the start time as the
      beginning of the epoch (i.e.: start time = -1) but the finish time is when the
      task was marked as failed when the whole job failed. That causes the
      calculated elapsed time of the task to be a ridiculous number of hours.

      Tasks that fail without any attempts shouldn't have start/finish/elapsed times.

      Attachments

        1. patch-MapReduce-5797.patch
          3 kB
          Rushabh Shah
        2. patch-MapReduce-5797-v2.patch
          4 kB
          Rushabh Shah
        3. patch-MapReduce-5797-v2.patch
          4 kB
          Rushabh Shah
        4. MAPREDUCE-5797-v3.patch
          4 kB
          Rushabh Shah

        Activity

          People

            shahrs87 Rushabh Shah
            shahrs87 Rushabh Shah
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: