Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-270

TaskTracker could send an out-of-band heartbeat when the last running map/reduce completes

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.21.0
    • 0.21.0
    • None
    • None
    • Introduced an option to allow tasktrackers to send an out of band heartbeat on task-completion to improve job latency. A new configuration option mapreduce.tasktracker.outofband.heartbeat is defined, which can be enabled to send this heartbeat.

    Description

      Currently the TaskTracker strictly respects the heartbeat interval, this causes utilization issues when all running tasks complete. We could send an out-of-band heartbeat in that case.

      Attachments

        1. MAPREDUCE-270.patch
          3 kB
          Arun Murthy
        2. MAPREDUCE-270.patch
          4 kB
          Arun Murthy
        3. MAPREDUCE-270.patch
          10 kB
          Arun Murthy
        4. MAPREDUCE-270.patch
          12 kB
          Arun Murthy
        5. MAPREDUCE-270.patch
          13 kB
          Arun Murthy
        6. MAPREDUCE-270_yhadoop20.patch
          2 kB
          Arun Murthy
        7. MAPREDUCE-270_yhadoop20.patch
          4 kB
          Arun Murthy
        8. MAPREDUCE-270_yhadoop20.patch
          9 kB
          Arun Murthy
        9. MAPREDUCE-270_yhadoop20.patch
          11 kB
          Arun Murthy
        10. MAPREDUCE-270_yhadoop20.patch
          12 kB
          Arun Murthy

        Activity

          People

            acmurthy Arun Murthy
            acmurthy Arun Murthy
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: