[KARAF-6507] AMQ-Alerting endless loop

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: decanter-2.3.0
• Component/s: decanter
• Assignee: Jean-Baptiste Onofré
• Reporter: Jörg Jansen
• Created: 03/Nov/19 13:56
• Updated: 27/Mar/20 07:35
• Resolved: 27/Mar/20 07:35

Description

Follwoing the provided steps, cause an endless loop in the decanter-alerting feature, as the alert ID is shared for all existing queues.

Reproduction: 

install features:

• decanter-collector-jmx-activemq
• decanter-alerting-log

Verify installed decanter features: list | grep -i decanter

 11 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Alerting :: Checker
 12 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: API
 13 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Marshaller :: CSV
 14 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Marshaller :: Json
 15 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Marshaller :: Raw
 16 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Parser :: Identity
 17 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Parser :: Regex
 18 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Parser :: Split
116 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Alerting :: Command
117 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Alerting :: Log
118 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Alerting :: Management
119 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Appender :: File
120 | Active   |  80 | 2.3.0.SNAPSHOT                     | Apache Karaf :: Decanter :: Collector :: JMX 

Create 2 ActiveMQ- queues

• AMQ.DECANTER.TEST
• AMQ.DECANTER.TEST

Configure a global ActiveMQ collector in file: org.apache.karaf.decanter.collector.jmx-activemq.cfg

• object.name=org.apache.activemq:*,destinationType=Queue

Configure a checker on queueSize for AMQ

• jmx-activemq.QueueSize.error=range:[0,3)

Insert messages into one queue to force error

 

After every JMS-check the existing alert is set back to normal and a new  alert is generated: 

 2019-11-03 14:51:50,407 | INFO  | Thread-19        | Logger                           | 117 - org.apache.karaf.decanter.alerting.log - 2.3.0.SNAPSHOT | DECANTER ALERT BACK TO NORMAL: QueueSize was out of pattern range:[0,3)
2019-11-03 14:51:50,408 | ERROR | Thread-19        | Logger                           | 117 - org.apache.karaf.decanter.alerting.log - 2.3.0.SNAPSHOT | DECANTER ALERT: Details: AlwaysRetroactive:false |áMemoryUsageByteCount:3086 |áCursorMemoryUsage:3086 |áCacheEnabled:true |áStoreMessageSize:998 |áfelix.fileinstall.filename:file:/O:/groundstar/inform-trunk/realtime/INF/java/gslisa/etc/org.apache.karaf.decanter.collector.jmx-activemq.cfg |átype:jmx-activemq |áservice.factoryPid:org.apache.karaf.decanter.collector.jmx |áName:AMQ.DECANTER.TEST |áTotalBlockedTime:0 |áMaxAuditDepth:10000 |áBlockedSends:0 |ácomponent.id:14 |ákarafName:root |áhost:null |áscheduler.name:decanter-collector-jmx |áalertAttribute:QueueSize |áEnqueueCount:3 |áMessageGroups:{} |ácomponent.name:org.apache.karaf.decanter.collector.jmx |áAverageMessageSize:1028 |áCursorFull:false |áCursorPercentUsage:0 |áMinEnqueueTime:0 |áservice.pid:org.apache.karaf.decanter.collector.jmx.dbf2f00b-2ada-43e9-a0f7-c624d1c6f8cb |áMinMessageSize:1028 |áMaxEnqueueTime:0 |áDequeueCount:0 |áBlockedProducerWarningInterval:30000 |áMaxMessageSize:1029 |áUseCache:true |áProducerFlowControl:true |áOptions: |áhostName:5580-JJansen |áalertPattern:range:[0,3) |áAverageBlockedTime:0.0 |áMemoryPercentUsage:0 |áSubscriptions:[Ljavax.management.ObjectName;@418c1e57 |áInFlightCount:0 |áDLQ:false |áForwardCount:0 |áAverageEnqueueTime:0.0 |ádecanter.collector.name:jmx |áscheduler.period:60 |áQueueSize:3 |áMaxPageSize:200 |áscheduler.concurrent:false |áPrioritizedMessages:false |áMemoryUsagePortion:1.0 |áPaused:false |átimestamp:1572789110406 |áConsumerCount:0 |áMaxProducersToAudit:64 |áExpiredCount:0 |áalertLevel:error |áurl:local |áObjectName:org.apache.activemq:type=Broker,brokerName=amq-broker,destinationType=Queue,destinationName=AMQ.DECANTER.TEST |áMemoryLimit:1336252826 |áobject.name:org.apache.activemq:*,destinationType=Queue |áDispatchCount:0 |áalertBackToNormal:true |áProducerCount:0 |áMessageGroupType:cached |áhostAddress:10.0.75.1 |áevent.topics:decanter/alert/error |á

Issue Links

• is duplicated by: KARAF-5741 Improve Decanter alerting by supporting time series and multi-attributes
• is related to: KARAF-5741 Improve Decanter alerting by supporting time series and multi-attributes
• links to: GitHub Pull Request #106