Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1219

JobTracker Metrics causes undue load on JobTracker

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      JobTrackerMetricsInst.doUpdates updates job-level counters of all running jobs into JobTracker's metrics causing very bad performance and hampers heartbeats. Since Job level metrics are better served by JobHistory, it may be a good idea to remove these from the metrics framework.

        Attachments

        1. patch-1219-ydist.txt
          0.6 kB
          Amareshwari Sriramadasu
        2. MR-1219-2.patch
          4 kB
          Sreekanth Ramakrishnan
        3. MR-1219-1.patch
          2 kB
          Sreekanth Ramakrishnan
        4. MAPREDUCE-1219.patch
          0.6 kB
          Arun C Murthy

          Activity

            People

            • Assignee:
              sreekanth Sreekanth Ramakrishnan
              Reporter:
              jothipn Jothi Padmanabhan
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: