Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1219

JobTracker Metrics causes undue load on JobTracker

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.21.0
    • 0.21.0
    • None
    • None
    • Reviewed

    Description

      JobTrackerMetricsInst.doUpdates updates job-level counters of all running jobs into JobTracker's metrics causing very bad performance and hampers heartbeats. Since Job level metrics are better served by JobHistory, it may be a good idea to remove these from the metrics framework.

      Attachments

        1. MAPREDUCE-1219.patch
          0.6 kB
          Arun Murthy
        2. MR-1219-1.patch
          2 kB
          Sreekanth Ramakrishnan
        3. MR-1219-2.patch
          4 kB
          Sreekanth Ramakrishnan
        4. patch-1219-ydist.txt
          0.6 kB
          Amareshwari Sriramadasu

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sreekanth Sreekanth Ramakrishnan
            jothipn Jothi Padmanabhan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment