Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-48

Expired launching tasks affect small jobs' execution time

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Not A Problem
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently when a task is given to a TT, the JT doesn't mark the task as running till the TT responds back to the JT. And within 10 mins(hard-coded), if the task doesn't come back, then only the task gets relaunched. For small jobs, this is a lot of time.

        Activity

        Hide
        Vinod Kumar Vavilapalli added a comment -

        May be we can 'speculatively' launch tasks by tracking the average completion time of tasks' launching. Thoughts?

        Show
        Vinod Kumar Vavilapalli added a comment - May be we can 'speculatively' launch tasks by tracking the average completion time of tasks' launching. Thoughts?
        Hide
        Harsh J added a comment -

        Not a problem anymore with the current versions.

        Show
        Harsh J added a comment - Not a problem anymore with the current versions.

          People

          • Assignee:
            Unassigned
            Reporter:
            Vinod Kumar Vavilapalli
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development