Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5278

Finish time of a TIP is incorrectly logged to the jobhistory upon jobtracker restart

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Upon recovery, the jobtracker replays the attempt information to the JIP. Upon seeing the attempt-end info, the JIP completes the TIP (which sets the finish time to current time) and logs it to the new jobhistory file (the .recover file). After seeing the task(tip) finish line, the recovery manager changes the finish time to correct finish time but the new jobhistory file still contains the wrong value for the finish time seen while completing the TIP.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                amar_kamat Amar Kamat
                Reporter:
                amar_kamat Amar Kamat
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: