ActiveMQ
  1. ActiveMQ
  2. AMQ-1991

dequeue is stalled compared to enqueue pace

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Incomplete
    • Affects Version/s: None
    • Fix Version/s: NEEDS_REVIEW
    • Component/s: None
    • Labels:
      None

      Description

      After some time ..ActiveMQ is not dequeueing...We are adding 13K message every 10 minute..It's working for some time after that Dequeuing count stays the same ..while enqueueing count keeps increasing.

      We are using ActiveMQ 5.1
      Spring 2.5
      Tomcat 6
      JDK 1.6

      1. screenshot-2.jpg
        54 kB
        Ashok
      2. screenshot-1.jpg
        96 kB
        Ashok

        Activity

        Hide
        Ashok added a comment -

        Name: ActiveMQ Session Task
        State: RUNNABLE
        Total blocked: 2 Total waited: 0

        Stack trace:
        java.net.SocketInputStream.socketRead0(Native Method)
        java.net.SocketInputStream.read(SocketInputStream.java:129)
        com.sun.mail.util.TraceInputStream.read(TraceInputStream.java:97)
        java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
        java.io.BufferedInputStream.read(BufferedInputStream.java:237)

        • locked java.io.BufferedInputStream@d0b275
          com.sun.mail.util.LineInputStream.readLine(LineInputStream.java:75)
          com.sun.mail.smtp.SMTPTransport.readServerResponse(SMTPTransport.java:1440)
          com.sun.mail.smtp.SMTPTransport.openServer(SMTPTransport.java:1260)
          com.sun.mail.smtp.SMTPTransport.protocolConnect(SMTPTransport.java:370)
          javax.mail.Service.connect(Service.java:275)
          org.springframework.mail.javamail.JavaMailSenderImpl.doSend(JavaMailSenderImpl.java:389)
          org.springframework.mail.javamail.JavaMailSenderImpl.send(JavaMailSenderImpl.java:342)
          org.springframework.mail.javamail.JavaMailSenderImpl.send(JavaMailSenderImpl.java:338)
          com.jpmc.ibtech.spring.email.MimeEmailService.sendEmail(MimeEmailService.java:61)
          com.jpmc.spex.background.events.processor.AbstractEventAction.sendEmail(AbstractEventAction.java:63)
          com.jpmc.spex.background.events.processor.AbstractEventAction.execute(AbstractEventAction.java:79)
          com.jpmc.spex.background.events.processor.system.SystemEventAction.execute(SystemEventAction.java:47)
          com.jpmc.ibtech.spring.jms.EventProcessor.onMessage(EventProcessor.java:100)
          org.springframework.jms.listener.AbstractMessageListenerContainer.doInvokeListener(AbstractMessageListenerContainer.java:531)
          org.springframework.jms.listener.AbstractMessageListenerContainer.invokeListener(AbstractMessageListenerContainer.java:466)
          org.springframework.jms.listener.AbstractMessageListenerContainer.doExecuteListener(AbstractMessageListenerContainer.java:435)
          org.springframework.jms.listener.AbstractMessageListenerContainer.executeListener(AbstractMessageListenerContainer.java:407)
          org.springframework.jms.listener.SimpleMessageListenerContainer.processMessage(SimpleMessageListenerContainer.java:290)
          org.springframework.jms.listener.SimpleMessageListenerContainer$2.onMessage(SimpleMessageListenerContainer.java:266)
          org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:967)
        • locked java.lang.Object@124793a
          org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:122)
          org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:192)
          org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
          org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
          java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
          java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
          java.lang.Thread.run(Thread.java:619)

        ---------------------------------------------------------------------------------------------------------------------------------------------

        Name: Main:memory:queue://UAT_spexEventQueue Usage Thread Pool
        State: WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@debb2d
        Total blocked: 0 Total waited: 10,068

        Stack trace:
        sun.misc.Unsafe.park(Native Method)
        java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
        java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
        java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
        java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:946)
        java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906)
        java.lang.Thread.run(Thread.java:619)

        --------------------------------------------------------------------------------------------------------------------------------------------------

        Name: Main:memory Usage Thread Pool
        State: WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@11edb4e
        Total blocked: 151 Total waited: 9,652

        Stack trace:
        sun.misc.Unsafe.park(Native Method)
        java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
        java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
        java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
        java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:946)
        java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906)
        java.lang.Thread.run(Thread.java:619)

        ----------------------------------------------------------------------------------------------------------------------------------------------------
        Name: ActiveMQ Data File Writer
        State: WAITING on org.apache.activemq.kaha.impl.async.DataFileAppender$1@33ca1c
        Total blocked: 9 Total waited: 1,804,340

        Stack trace:
        java.lang.Object.wait(Native Method)
        java.lang.Object.wait(Object.java:485)
        org.apache.activemq.kaha.impl.async.NIODataFileAppender.processQueue(NIODataFileAppender.java:79)
        org.apache.activemq.kaha.impl.async.DataFileAppender$2.run(DataFileAppender.java:227)

        Show
        Ashok added a comment - Name: ActiveMQ Session Task State: RUNNABLE Total blocked: 2 Total waited: 0 Stack trace: java.net.SocketInputStream.socketRead0(Native Method) java.net.SocketInputStream.read(SocketInputStream.java:129) com.sun.mail.util.TraceInputStream.read(TraceInputStream.java:97) java.io.BufferedInputStream.fill(BufferedInputStream.java:218) java.io.BufferedInputStream.read(BufferedInputStream.java:237) locked java.io.BufferedInputStream@d0b275 com.sun.mail.util.LineInputStream.readLine(LineInputStream.java:75) com.sun.mail.smtp.SMTPTransport.readServerResponse(SMTPTransport.java:1440) com.sun.mail.smtp.SMTPTransport.openServer(SMTPTransport.java:1260) com.sun.mail.smtp.SMTPTransport.protocolConnect(SMTPTransport.java:370) javax.mail.Service.connect(Service.java:275) org.springframework.mail.javamail.JavaMailSenderImpl.doSend(JavaMailSenderImpl.java:389) org.springframework.mail.javamail.JavaMailSenderImpl.send(JavaMailSenderImpl.java:342) org.springframework.mail.javamail.JavaMailSenderImpl.send(JavaMailSenderImpl.java:338) com.jpmc.ibtech.spring.email.MimeEmailService.sendEmail(MimeEmailService.java:61) com.jpmc.spex.background.events.processor.AbstractEventAction.sendEmail(AbstractEventAction.java:63) com.jpmc.spex.background.events.processor.AbstractEventAction.execute(AbstractEventAction.java:79) com.jpmc.spex.background.events.processor.system.SystemEventAction.execute(SystemEventAction.java:47) com.jpmc.ibtech.spring.jms.EventProcessor.onMessage(EventProcessor.java:100) org.springframework.jms.listener.AbstractMessageListenerContainer.doInvokeListener(AbstractMessageListenerContainer.java:531) org.springframework.jms.listener.AbstractMessageListenerContainer.invokeListener(AbstractMessageListenerContainer.java:466) org.springframework.jms.listener.AbstractMessageListenerContainer.doExecuteListener(AbstractMessageListenerContainer.java:435) org.springframework.jms.listener.AbstractMessageListenerContainer.executeListener(AbstractMessageListenerContainer.java:407) org.springframework.jms.listener.SimpleMessageListenerContainer.processMessage(SimpleMessageListenerContainer.java:290) org.springframework.jms.listener.SimpleMessageListenerContainer$2.onMessage(SimpleMessageListenerContainer.java:266) org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:967) locked java.lang.Object@124793a org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:122) org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:192) org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122) org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43) java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) java.lang.Thread.run(Thread.java:619) --------------------------------------------------------------------------------------------------------------------------------------------- Name: Main:memory:queue://UAT_spexEventQueue Usage Thread Pool State: WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@debb2d Total blocked: 0 Total waited: 10,068 Stack trace: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:946) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906) java.lang.Thread.run(Thread.java:619) -------------------------------------------------------------------------------------------------------------------------------------------------- Name: Main:memory Usage Thread Pool State: WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@11edb4e Total blocked: 151 Total waited: 9,652 Stack trace: sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:946) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906) java.lang.Thread.run(Thread.java:619) ---------------------------------------------------------------------------------------------------------------------------------------------------- Name: ActiveMQ Data File Writer State: WAITING on org.apache.activemq.kaha.impl.async.DataFileAppender$1@33ca1c Total blocked: 9 Total waited: 1,804,340 Stack trace: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:485) org.apache.activemq.kaha.impl.async.NIODataFileAppender.processQueue(NIODataFileAppender.java:79) org.apache.activemq.kaha.impl.async.DataFileAppender$2.run(DataFileAppender.java:227)
        Hide
        Timothy Bish added a comment -

        Not test cases or data provided to reproduce.

        Show
        Timothy Bish added a comment - Not test cases or data provided to reproduce.

          People

          • Assignee:
            Unassigned
            Reporter:
            Ashok
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development