Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-48

Expired launching tasks affect small jobs' execution time

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Not A Problem
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently when a task is given to a TT, the JT doesn't mark the task as running till the TT responds back to the JT. And within 10 mins(hard-coded), if the task doesn't come back, then only the task gets relaunched. For small jobs, this is a lot of time.

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        1029d 21h 41m 1 Harsh J 31/Dec/11 09:20
        Harsh J made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Not A Problem [ 8 ]
        Hide
        Harsh J added a comment -

        Not a problem anymore with the current versions.

        Show
        Harsh J added a comment - Not a problem anymore with the current versions.
        Owen O'Malley made changes -
        Field Original Value New Value
        Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
        Key HADOOP-5424 MAPREDUCE-48
        Component/s mapred [ 12310690 ]
        Hide
        Vinod Kumar Vavilapalli added a comment -

        May be we can 'speculatively' launch tasks by tracking the average completion time of tasks' launching. Thoughts?

        Show
        Vinod Kumar Vavilapalli added a comment - May be we can 'speculatively' launch tasks by tracking the average completion time of tasks' launching. Thoughts?
        Vinod Kumar Vavilapalli created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Vinod Kumar Vavilapalli
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development