Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-3521

Hadoop mapreduce task metrics, unable to send metrics data.

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.18.0
    • 0.18.0
    • None
    • None

    Description

      Found the following new metrics in tasktracker:

      mapTaskSlots (short)
      reduceTaskSlots (short)
      tasks_failed_timeout (int)
      tasks_failed_ping (int)

      After configuring Simon to match the new metrics, this error was thrown in the task tracker log:

      Exception in thread "Timer thread for monitoring mapred" java.lang.ClassCastException: java.lang.Long
      at com.yahoo.simon.hadoop.metrics.Client.sendBlurb(Client.java:266)
      at com.yahoo.simon.hadoop.metrics.SimonContext.emitRecord(SimonContext.java:160)
      at org.apache.hadoop.metrics.spi.AbstractMetricsContext.emitRecords(AbstractMetricsContext.java:304)
      at org.apache.hadoop.metrics.spi.AbstractMetricsContext.timerEvent(AbstractMetricsContext.java:290)
      at org.apache.hadoop.metrics.spi.AbstractMetricsContext.access$000(AbstractMetricsContext.java:50)
      at org.apache.hadoop.metrics.spi.AbstractMetricsContext$1.run(AbstractMetricsContext.java:249)
      at java.util.TimerThread.mainLoop(Timer.java:512)
      at java.util.TimerThread.run(Timer.java:462)

      Attachments

        1. HADOOP-3521_0_20080723.patch
          0.6 kB
          Arun Murthy

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            acmurthy Arun Murthy
            eyang Eric Yang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment