Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5278

Finish time of a TIP is incorrectly logged to the jobhistory upon jobtracker restart

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None
    • Reviewed

    Description

      Upon recovery, the jobtracker replays the attempt information to the JIP. Upon seeing the attempt-end info, the JIP completes the TIP (which sets the finish time to current time) and logs it to the new jobhistory file (the .recover file). After seeing the task(tip) finish line, the recovery manager changes the finish time to correct finish time but the new jobhistory file still contains the wrong value for the finish time seen while completing the TIP.

      Attachments

        1. HADOOP-5278-v1.0.patch
          2 kB
          Amar Kamat

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            amar_kamat Amar Kamat
            amar_kamat Amar Kamat
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment