Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5588

TaskTrackers get killed by JettyBugMonitor because of incredibly high cpu usage

    XMLWordPrintableJSON

    Details

      Description

      We are running a little cluster with 10 servers running task trackers. All of them are getting killed randomly with the following message

      2013-10-17 11:32:31,037 FATAL org.apache.hadoop.mapred.JettyBugMonitor: ************************************************************
      Jetty CPU usage: 120093277.1%. This is greater than the fatal threshold mapred.tasktracker.jetty.cpu.threshold.fatal. Aborting JVM.
      ************************************************************
      2013-10-17 11:32:31,039 INFO org.apache.hadoop.mapred.TaskTracker: SHUTDOWN_MSG:
      /************************************************************
      SHUTDOWN_MSG: Shutting down TaskTracker
      ************************************************************/

      Everytime, the message notices a cpu usage above 120M%. Everything has been running for a while now (since 1.1.2 release) without any problems, and it started just like that.

      Any idea of what could cause this ?

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                cnauroth Chris Nauroth
                Reporter:
                moian Anthony MOI
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: