Hadoop Common
  1. Hadoop Common
  2. HADOOP-1219

Spurious progress messages should be discarded after a task is done

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      Noticed that the Map task's "last" progress message sometimes goes through even after the fix for HADOOP-1191. In reality, this could happen since we don't check for thread.isInterrupted() at each step in the path of the client RPC call. So the situation described in HADOOP-1191 remains. The effect of this is that the TaskTracker finally kills the task for not sending progress report for the configured number of seconds (if the process happens to be alive then).

      1. 1219.patch
        0.8 kB
        Devaraj Das

        Issue Links

          Activity

          Hide
          Hadoop QA added a comment -
          Show
          Hadoop QA added a comment - Integrated in Hadoop-Nightly #53 (See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/53/ )
          Hide
          Tom White added a comment -

          I've just committed this. Thanks Devaraj!

          Show
          Tom White added a comment - I've just committed this. Thanks Devaraj!
          Hide
          Owen O'Malley added a comment -

          +1

          Show
          Owen O'Malley added a comment - +1
          Show
          Hadoop QA added a comment - +1, because http://issues.apache.org/jira/secure/attachment/12355102/1219.patch applied and successfully tested against trunk revision http://svn.apache.org/repos/asf/lucene/hadoop/trunk/526215 . Results are at http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch
          Hide
          Devaraj Das added a comment -

          The patch does a check at the TaskTracker to make sure the progress report is ignored if the task had earlier reported as 'done'.

          Show
          Devaraj Das added a comment - The patch does a check at the TaskTracker to make sure the progress report is ignored if the task had earlier reported as 'done'.

            People

            • Assignee:
              Devaraj Das
              Reporter:
              Devaraj Das
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development