Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1219

Spurious progress messages should be discarded after a task is done

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      Noticed that the Map task's "last" progress message sometimes goes through even after the fix for HADOOP-1191. In reality, this could happen since we don't check for thread.isInterrupted() at each step in the path of the client RPC call. So the situation described in HADOOP-1191 remains. The effect of this is that the TaskTracker finally kills the task for not sending progress report for the configured number of seconds (if the process happens to be alive then).

      1. 1219.patch
        0.8 kB
        Devaraj Das

        Issue Links

          Activity

          Hide
          devaraj Devaraj Das added a comment -

          The patch does a check at the TaskTracker to make sure the progress report is ignored if the task had earlier reported as 'done'.

          Show
          devaraj Devaraj Das added a comment - The patch does a check at the TaskTracker to make sure the progress report is ignored if the task had earlier reported as 'done'.
          Show
          hadoopqa Hadoop QA added a comment - +1, because http://issues.apache.org/jira/secure/attachment/12355102/1219.patch applied and successfully tested against trunk revision http://svn.apache.org/repos/asf/lucene/hadoop/trunk/526215 . Results are at http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch
          Hide
          owen.omalley Owen O'Malley added a comment -

          +1

          Show
          owen.omalley Owen O'Malley added a comment - +1
          Hide
          tomwhite Tom White added a comment -

          I've just committed this. Thanks Devaraj!

          Show
          tomwhite Tom White added a comment - I've just committed this. Thanks Devaraj!
          Hide
          hadoopqa Hadoop QA added a comment -
          Show
          hadoopqa Hadoop QA added a comment - Integrated in Hadoop-Nightly #53 (See http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/53/ )

            People

            • Assignee:
              devaraj Devaraj Das
              Reporter:
              devaraj Devaraj Das
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development