Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1099

Setup and cleanup tasks could affect job latency if they are caught running on bad nodes

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.20.1
    • Fix Version/s: None
    • Component/s: jobtracker
    • Labels:
      None

      Description

      We found cases on our clusters where a setup task got scheduled on a bad node and took upwards of several minutes to run, adversely affecting job runtimes. Speculation did not help here as speculation is not used for setup tasks. I suspect the same could happen for cleanup tasks as well.

        Issue Links

          Activity

          Hide
          buptzhugy ZhuGuanyin added a comment -

          We have encountered the same problem, so We just remove the setup and cleanup task (inport the patch https://issues.apache.org/jira/browse/MAPREDUCE-463 )

          Show
          buptzhugy ZhuGuanyin added a comment - We have encountered the same problem, so We just remove the setup and cleanup task (inport the patch https://issues.apache.org/jira/browse/MAPREDUCE-463 )
          Hide
          yhemanth Hemanth Yamijala added a comment -

          Note that I am not suggesting we speculate setup and cleanup tasks. In an offline discussion with Amareshwari and Devaraj we realized there are potential difficulties in speculating these attempts. Firstly there's no good way to measure the progress of these attempts against other attempts. I am just opening this issue to open for discussion.

          Show
          yhemanth Hemanth Yamijala added a comment - Note that I am not suggesting we speculate setup and cleanup tasks. In an offline discussion with Amareshwari and Devaraj we realized there are potential difficulties in speculating these attempts. Firstly there's no good way to measure the progress of these attempts against other attempts. I am just opening this issue to open for discussion.

            People

            • Assignee:
              Unassigned
              Reporter:
              yhemanth Hemanth Yamijala
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:

                Development