[AMBARI-13336] Flume agent specific metrics not showing up as graphs

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.1.2
• Fix Version/s: 2.2.0
• Component/s: ambari-metrics, ambari-server
• Assignee: Dmytro Sen
• Reporter: Dmytro Sen
• Created: 07/Oct/15 10:05
• Updated: 12/Oct/15 17:17
• Resolved: 12/Oct/15 13:07

Description

After creating a Flume agent with below configuration, I selected the host in the agents table of Flume service summary page. I was expecting graphs of metrics to show up for that host, but I dont see any graphs.

# Name the components on this agent
a1.sources = r1
a1.sinks = k1
a1.channels = c1
#
# # Describe/configure the source
a1.sources.r1.type = netcat
a1.sources.r1.bind = localhost
a1.sources.r1.port = 44444
#
# # Describe the sink
#a1.sinks.k1.type = logger
a1.sinks.k1.type = hdfs
a1.sinks.k1.hdfs.path = /tmp/events_a1_%y-%m-%d/%H%M/%S
a1.sinks.k1.hdfs.filePrefix = events-
a1.sinks.k1.hdfs.round = true
a1.sinks.k1.hdfs.roundValue = 1
a1.sinks.k1.hdfs.roundUnit = minute
a1.sinks.k1.hdfs.useLocalTimeStamp = true
#
# # Use a channel which buffers events in memory
a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100
#
# # Bind the source and sink to the channel
a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1

The reason graphs are not getting created is the below GET call which should return (from Ambari-1.7.0)

{
  "href" : "http://gs170-1:8080/api/v1/clusters/c1/hosts/gs170-3/host_components/FLUME_HANDLER?fields=metrics/flume/flume/CHANNEL/*&_=1443160542629",
  "HostRoles" : {
    "cluster_name" : "c1",
    "component_name" : "FLUME_HANDLER",
    "host_name" : "gs170-3"
  },
  "host" : {
    "href" : "http://gs170-1:8080/api/v1/clusters/c1/hosts/gs170-3"
  },
  "metrics" : {
    "flume" : {
      "flume" : {
        "CHANNEL" : {
          "c1" : {
            "ChannelCapacity" : 1000.0,
            "ChannelFillPercentage" : 0.0,
            "ChannelSize" : 0.0,
            "EventPutAttemptCount" : 0.0,
            "EventPutSuccessCount" : 0.0,
            "EventTakeAttemptCount" : 99.0,
            "EventTakeSuccessCount" : 0.0,
            "StartTime" : 1.4431597139E12,
            "StopTime" : 0.0
          }
        }
      }
    }
  }
}

but instead returns without the channel name:

{
  "href" : "http://c6401:8080/api/v1/clusters/c1/hosts/c6402.ambari.apache.org/host_components/FLUME_HANDLER?fields=metrics/flume/flume/CHANNEL/*&_=1443161204742",
  "HostRoles" : {
    "cluster_name" : "c1",
    "component_name" : "FLUME_HANDLER",
    "host_name" : "c6402.ambari.apache.org"
  },
  "host" : {
    "href" : "http://c6401:8080/api/v1/clusters/c1/hosts/c6402.ambari.apache.org"
  },
  "metrics" : {
    "flume" : {
      "flume" : {
        "CHANNEL" : {
          "ChannelCapacity" : 1000.0,
          "ChannelFillPercentage" : 0.0,
          "ChannelSize" : 0.0,
          "EventPutAttemptCount" : 0.0,
          "EventPutSuccessCount" : 0.0,
          "EventTakeAttemptCount" : 8.0,
          "EventTakeSuccessCount" : 0.0,
          "StartTime" : 1.443127087019E12,
          "StopTime" : 0.0
        }
      }
    }
  }
}

Due to this reason no metric graphs are created and the sections are empty.

Issue Links

• links to: Review Board