Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-270

TaskTracker could send an out-of-band heartbeat when the last running map/reduce completes

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Release Note:
      Introduced an option to allow tasktrackers to send an out of band heartbeat on task-completion to improve job latency. A new configuration option mapreduce.tasktracker.outofband.heartbeat is defined, which can be enabled to send this heartbeat.

      Description

      Currently the TaskTracker strictly respects the heartbeat interval, this causes utilization issues when all running tasks complete. We could send an out-of-band heartbeat in that case.

        Attachments

        1. MAPREDUCE-270.patch
          3 kB
          Arun C Murthy
        2. MAPREDUCE-270.patch
          4 kB
          Arun C Murthy
        3. MAPREDUCE-270.patch
          10 kB
          Arun C Murthy
        4. MAPREDUCE-270.patch
          12 kB
          Arun C Murthy
        5. MAPREDUCE-270.patch
          13 kB
          Arun C Murthy
        6. MAPREDUCE-270_yhadoop20.patch
          2 kB
          Arun C Murthy
        7. MAPREDUCE-270_yhadoop20.patch
          4 kB
          Arun C Murthy
        8. MAPREDUCE-270_yhadoop20.patch
          9 kB
          Arun C Murthy
        9. MAPREDUCE-270_yhadoop20.patch
          11 kB
          Arun C Murthy
        10. MAPREDUCE-270_yhadoop20.patch
          12 kB
          Arun C Murthy

          Activity

            People

            • Assignee:
              acmurthy Arun C Murthy
              Reporter:
              acmurthy Arun C Murthy
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: