[AMBARI-18012] Metrics Sink unable to connect to zookeeper to locate collector host.

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 2.5.0
• Fix Version/s: 2.5.0
• Assignee: Aravindan Vijayan
• Reporter: Aravindan Vijayan
• Created: 03/Aug/16 22:32
• Updated: 05/Dec/16 22:17
• Resolved: 17/Aug/16 18:00

Description

Test and validate sink fallback connect to ZK for finding collector

2016-07-14 20:37:01,212 INFO  timeline.HadoopTimelineMetricsSink (AbstractTimelineMetricsSink.java:findPreferredCollectHost(353)) - Collector ambari-sid-5.c.pramod-thangali.internal is not longer live. Removing it from list of know live collector hosts : []
2016-07-14 20:37:03,213 WARN  availability.MetricCollectorHAHelper (MetricCollectorHAHelper.java:findLiveCollectorHostsFromZNode(83)) - Unable to connect to zookeeper.
java.lang.IllegalStateException: Client is not started
        at org.apache.hadoop.metrics2.sink.relocated.google.common.base.Preconditions.checkState(Preconditions.java:149)
        at org.apache.hadoop.metrics2.sink.relocated.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:113)
        at org.apache.hadoop.metrics2.sink.timeline.availability.MetricCollectorHAHelper$1.call(MetricCollectorHAHelper.java:77)
        at org.apache.hadoop.metrics2.sink.timeline.availability.MetricCollectorHAHelper$1.call(MetricCollectorHAHelper.java:74)
        at org.apache.hadoop.metrics2.sink.relocated.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
        at org.apache.hadoop.metrics2.sink.timeline.availability.MetricCollectorHAHelper.findLiveCollectorHostsFromZNode(MetricCollectorHAHelper.java:74)
        at org.apache.hadoop.metrics2.sink.timeline.AbstractTimelineMetricsSink.findPreferredCollectHost(AbstractTimelineMetricsSink.java:363)
        at org.apache.hadoop.metrics2.sink.timeline.AbstractTimelineMetricsSink.emitMetrics(AbstractTimelineMetricsSink.java:209)
        at org.apache.hadoop.metrics2.sink.timeline.HadoopTimelineMetricsSink.putMetrics(HadoopTimelineMetricsSink.java:315)
        at org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.consume(MetricsSinkAdapter.java:186)
        at org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.consume(MetricsSinkAdapter.java:43)
        at org.apache.hadoop.metrics2.impl.SinkQueue.consumeAll(SinkQueue.java:87)
        at org.apache.hadoop.metrics2.impl.MetricsSinkAdapter.publishMetricsFromQueue(MetricsSinkAdapter.java:134)
        at org.apache.hadoop.metrics2.impl.MetricsSinkAdapter$1.run(MetricsSinkAdapter.java:88)
2016-07-14 20:37:03,245 WARN  timeline.HadoopTimelineMetricsSink (AbstractTimelineMetricsSink.java:findLiveCollectorHostsFromKnownCollector(433)) - Unable to conne

Issue Links

• links to: Review Board