Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5278

Finish time of a TIP is incorrectly logged to the jobhistory upon jobtracker restart

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None
    • Reviewed

    Description

      Upon recovery, the jobtracker replays the attempt information to the JIP. Upon seeing the attempt-end info, the JIP completes the TIP (which sets the finish time to current time) and logs it to the new jobhistory file (the .recover file). After seeing the task(tip) finish line, the recovery manager changes the finish time to correct finish time but the new jobhistory file still contains the wrong value for the finish time seen while completing the TIP.

      Attachments

        1. HADOOP-5278-v1.0.patch
          2 kB
          Amar Kamat

        Issue Links

          Activity

            People

              amar_kamat Amar Kamat
              amar_kamat Amar Kamat
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: