Hadoop Common
  1. Hadoop Common
  2. HADOOP-588

JobTracker History bug - kill() ed tasks are logged wrongly as finished.

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.7.0
    • Fix Version/s: 0.8.0
    • Component/s: None
    • Labels:
      None

      Description

      JobInProgress.kill() logs jobs as finished in jobtracker history, whereas they should be logged as failed.

      1. Hadoop-588.patch
        2 kB
        Sanjay Dahiya
      2. Hadoop-588-extra.patch
        1.0 kB
        Sanjay Dahiya

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        5m 51s 1 Sanjay Dahiya 10/Oct/06 08:22
        Patch Available Patch Available Resolved Resolved
        6d 14h 52m 1 Doug Cutting 16/Oct/06 23:14
        Resolved Resolved Closed Closed
        17d 23h 25m 1 Doug Cutting 03/Nov/06 22:40
        Owen O'Malley made changes -
        Component/s mapred [ 12310690 ]
        Doug Cutting made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Doug Cutting made changes -
        Resolution Fixed [ 1 ]
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hide
        Doug Cutting added a comment -

        I just committed this. Thanks, Sanjay!

        Show
        Doug Cutting added a comment - I just committed this. Thanks, Sanjay!
        Owen O'Malley made changes -
        Fix Version/s 0.8.0 [ 12312098 ]
        Fix Version/s 0.7.1 [ 12312097 ]
        Hide
        Owen O'Malley added a comment -

        I think that we should push this to 0.8.0 since it is not a stability issue.

        Show
        Owen O'Malley added a comment - I think that we should push this to 0.8.0 since it is not a stability issue.
        Sanjay Dahiya made changes -
        Attachment Hadoop-588-extra.patch [ 12342726 ]
        Hide
        Sanjay Dahiya added a comment -

        Submitting one more patch related to history with this bug ID.
        With this patch analyze history on WI will not attempt to analyze in case job did not succeed.

        note: it doesnt replace the existing patch, its in addition to that.

        Show
        Sanjay Dahiya added a comment - Submitting one more patch related to history with this bug ID. With this patch analyze history on WI will not attempt to analyze in case job did not succeed. note: it doesnt replace the existing patch, its in addition to that.
        Sanjay Dahiya made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Sanjay Dahiya made changes -
        Field Original Value New Value
        Attachment Hadoop-588.patch [ 12342630 ]
        Hide
        Sanjay Dahiya added a comment -

        This patch fixes 2 issues with jobtracker history logging.
        1. JobInProgress.kill() now logs jobs as failed instead of finished.
        2. For failed task attempts, the failure is not propagated to Task page until the taskAttempts fails max(4) no of times. Earlier the failed task attempt's error would be visible on task page even when a subsequent task attempt succeeded, which was confusing.

        Show
        Sanjay Dahiya added a comment - This patch fixes 2 issues with jobtracker history logging. 1. JobInProgress.kill() now logs jobs as failed instead of finished. 2. For failed task attempts, the failure is not propagated to Task page until the taskAttempts fails max(4) no of times. Earlier the failed task attempt's error would be visible on task page even when a subsequent task attempt succeeded, which was confusing.
        Sanjay Dahiya created issue -

          People

          • Assignee:
            Sanjay Dahiya
            Reporter:
            Sanjay Dahiya
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development