Hadoop Common
  1. Hadoop Common
  2. HADOOP-5278

Finish time of a TIP is incorrectly logged to the jobhistory upon jobtracker restart

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Upon recovery, the jobtracker replays the attempt information to the JIP. Upon seeing the attempt-end info, the JIP completes the TIP (which sets the finish time to current time) and logs it to the new jobhistory file (the .recover file). After seeing the task(tip) finish line, the recovery manager changes the finish time to correct finish time but the new jobhistory file still contains the wrong value for the finish time seen while completing the TIP.

        Issue Links

          Activity

          Amar Kamat created issue -
          Amar Kamat made changes -
          Field Original Value New Value
          Link This issue blocks HADOOP-4191 [ HADOOP-4191 ]
          Amar Kamat made changes -
          Attachment HADOOP-5278-v1.0.patch [ 12400417 ]
          Devaraj Das made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Assignee Amar Kamat [ amar_kamat ]
          Hadoop Flags [Reviewed]
          Fix Version/s 0.21.0 [ 12313563 ]
          Owen O'Malley made changes -
          Component/s mapred [ 12310690 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Amar Kamat
              Reporter:
              Amar Kamat
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development