Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1845

Elapsed time for failed tasks that never started is wrong

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.9
    • Fix Version/s: 2.5.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:

      Description

      The elapsed time for tasks in a failed job that were never
      started can be way off. It looks like we're marking the start time as the
      beginning of the epoch (i.e.: start time = -1) but the finish time is when the
      task was marked as failed when the whole job failed. That causes the
      calculated elapsed time of the task to be a ridiculous number of hours.

      Tasks that fail without any attempts shouldn't have start/finish/elapsed times.

        Attachments

        1. MAPREDUCE-5797-v3.patch
          4 kB
          Rushabh S Shah
        2. patch-MapReduce-5797.patch
          3 kB
          Rushabh S Shah
        3. patch-MapReduce-5797-v2.patch
          4 kB
          Rushabh S Shah
        4. patch-MapReduce-5797-v2.patch
          4 kB
          Rushabh S Shah

          Activity

            People

            • Assignee:
              shahrs87 Rushabh S Shah
              Reporter:
              shahrs87 Rushabh S Shah
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: