[NIFI-6437] a lot of connections from ConsumerAMQP

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 1.9.2
• Component/s: Core Framework
• Assignee: Unassigned
• Reporter: Piotr
• Created: 12/Jul/19 11:25
• Updated: 10/Jul/20 16:28
• Resolved: 10/Jul/20 16:28

Description

hi, when I try to connect to not existing queue on rabbitmq via ConsumerAMQP, nifi was creating more and more connection to rabbitmq. after few minutes rabbitmq "explode". i saw this error in logs:

2019-07-12 13:20:29,853 INFO [Timer-Driven Process Thread-3] o.a.n.c.s.TimerDrivenSchedulingAgent Stopped scheduling ConsumeAMQP[id=e5e84018-016b-1000-edd7-e0de56297dd9] to run
2019-07-12 13:20:29,856 INFO [Timer-Driven Process Thread-1] o.a.nifi.amqp.processors.AMQPConsumer Successfully connected AMQPConsumer to amqp://guest@172.17.0.4:5672/ and 'test_queue' queue
2019-07-12 13:20:29,860 ERROR [Timer-Driven Process Thread-1] o.a.nifi.amqp.processors.ConsumeAMQP ConsumeAMQP[id=e5e84018-016b-1000-edd7-e0de56297dd9] Failed to process session due to org.apache.nifi.processor.exception.ProcessException: Failed to connect to AMQP Broker: org.apache.nifi.processor.exception.ProcessException: Failed to connect to AMQP Broker
org.apache.nifi.processor.exception.ProcessException: Failed to connect to AMQP Broker
    at org.apache.nifi.amqp.processors.ConsumeAMQP.createAMQPWorker(ConsumeAMQP.java:197)
    at org.apache.nifi.amqp.processors.ConsumeAMQP.createAMQPWorker(ConsumeAMQP.java:47)
    at org.apache.nifi.amqp.processors.AbstractAMQPProcessor.createResource(AbstractAMQPProcessor.java:202)
    at org.apache.nifi.amqp.processors.AbstractAMQPProcessor.onTrigger(AbstractAMQPProcessor.java:156)
    at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
    at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1162)
    at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:209)
    at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:117)
    at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: null
    at com.rabbitmq.client.impl.AMQChannel.wrap(AMQChannel.java:126)
    at com.rabbitmq.client.impl.AMQChannel.wrap(AMQChannel.java:122)
    at com.rabbitmq.client.impl.ChannelN.basicConsume(ChannelN.java:1378)
    at com.rabbitmq.client.impl.recovery.AutorecoveringChannel.basicConsume(AutorecoveringChannel.java:540)
    at com.rabbitmq.client.impl.recovery.AutorecoveringChannel.basicConsume(AutorecoveringChannel.java:494)
    at com.rabbitmq.client.impl.recovery.AutorecoveringChannel.basicConsume(AutorecoveringChannel.java:472)
    at org.apache.nifi.amqp.processors.AMQPConsumer.<init>(AMQPConsumer.java:77)
    at org.apache.nifi.amqp.processors.ConsumeAMQP.createAMQPWorker(ConsumeAMQP.java:193)
    ... 15 common frames omitted
Caused by: com.rabbitmq.client.ShutdownSignalException: channel error; protocol method: #method<channel.close>(reply-code=404, reply-text=NOT_FOUND - no queue 'test_queue' in vhost '/', class-id=60, method-id=20)
    at com.rabbitmq.utility.ValueOrException.getValue(ValueOrException.java:66)
    at com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:36)
    at com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:494)
    at com.rabbitmq.client.impl.ChannelN.basicConsume(ChannelN.java:1372)
    ... 20 common frames omitted
Caused by: com.rabbitmq.client.ShutdownSignalException: channel error; protocol method: #method<channel.close>(reply-code=404, reply-text=NOT_FOUND - no queue 'test_queue' in vhost '/', class-id=60, method-id=20)
    at com.rabbitmq.client.impl.ChannelN.asyncShutdown(ChannelN.java:516)
    at com.rabbitmq.client.impl.ChannelN.processAsync(ChannelN.java:346)
    at com.rabbitmq.client.impl.AMQChannel.handleCompleteInboundCommand(AMQChannel.java:178)
    at com.rabbitmq.client.impl.AMQChannel.handleFrame(AMQChannel.java:111)
    at com.rabbitmq.client.impl.AMQConnection.readFrame(AMQConnection.java:670)
    at com.rabbitmq.client.impl.AMQConnection.access$300(AMQConnection.java:48)
    at com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:597)
    ... 1 common frames omitted

Issue Links

• duplicates: NIFI-6997 consumeAMPQ processor opens connections when RabbitMQ-queue not found
• relates to: NIFI-6312 AMQP processors seem to have thread cleanup issues