Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-270

TaskTracker could send an out-of-band heartbeat when the last running map/reduce completes

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Release Note:
      Introduced an option to allow tasktrackers to send an out of band heartbeat on task-completion to improve job latency. A new configuration option mapreduce.tasktracker.outofband.heartbeat is defined, which can be enabled to send this heartbeat.

      Description

      Currently the TaskTracker strictly respects the heartbeat interval, this causes utilization issues when all running tasks complete. We could send an out-of-band heartbeat in that case.

      1. MAPREDUCE-270.patch
        13 kB
        Arun C Murthy
      2. MAPREDUCE-270_yhadoop20.patch
        12 kB
        Arun C Murthy
      3. MAPREDUCE-270.patch
        12 kB
        Arun C Murthy
      4. MAPREDUCE-270_yhadoop20.patch
        11 kB
        Arun C Murthy
      5. MAPREDUCE-270.patch
        10 kB
        Arun C Murthy
      6. MAPREDUCE-270_yhadoop20.patch
        9 kB
        Arun C Murthy
      7. MAPREDUCE-270_yhadoop20.patch
        4 kB
        Arun C Murthy
      8. MAPREDUCE-270.patch
        4 kB
        Arun C Murthy
      9. MAPREDUCE-270_yhadoop20.patch
        2 kB
        Arun C Murthy
      10. MAPREDUCE-270.patch
        3 kB
        Arun C Murthy

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Arun C Murthy
            Reporter:
            Arun C Murthy
          • Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development