Uploaded image for project: 'ActiveMQ Classic'
  1. ActiveMQ Classic
  2. AMQ-1821

Https JMSBridgeConnector failed to recover due to an infinite loop in Journal cleanup.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 4.1.1
    • NEEDS_REVIEW
    • Broker
    • None

    • Win XP

    Description

      Hi,
      I am not sure if this is an known bug.
      I am encountering an issue when I have a broker with a Https Queue Bridge connector in several machines connected with one embedded broker in a remote Tomcat server. Messages are being sent from client machines to the server with no connectivity issue in the first couple days(well, not really, the time it takes to fail varies). During this first period of time, the failover transport was able to recover from connection failures. However, the brokers' https connections started to drop after time and not being able to recover anymore. So It's not able to send messages to the server anymore. The debug logs shows an infinite loop of checkpoints(msgs cleanups) with the Journal Persistence. This also happens with Derby Persistence. I am not sure if this infinite loop prevents the failover to take place in this case. As a note, the time it takes to reach this failure case varies in different client machines, but they are sending messages to the server at the same rate(1 message per hour).

      I have attached a partial text of the log.

      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] WARN HttpClientTransport - Received null command from url: https://publisher.emn2008.com/amq/
      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] DEBUG HttpMethodBase - Buffering response body
      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] DEBUG HttpMethodBase - Resorting to protocol version default close connection policy
      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] DEBUG HttpMethodBase - Should NOT close connection, using HTTP/1.1.
      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] DEBUG HttpConnection - HttpConnection.setSoTimeout(0)
      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] DEBUG HttpMethodBase - Execute loop try 1
      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] DEBUG header - >> "GET /amq/ HTTP/1.1[\r][\n]"
      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] DEBUG HttpMethodBase - Adding Host request header
      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] DEBUG header - >> "clientID: ID:emn2008-82646A4E67-2374-1213758751348-5:5[\r][\n]"
      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] DEBUG header - >> "User-Agent: Jakarta Commons-HttpClient/2.0.1[\r][\n]"
      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] DEBUG header - >> "Host: publisher.emn2008.com[\r][\n]"
      2008-06-20 04:03:57,630 [r.emn2008.com/amq/] DEBUG header - >> "[\r][\n]"
      2008-06-20 04:07:16,505 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint started.
      2008-06-20 04:07:16,505 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:07:16,505 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:07:16,505 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:07:16,505 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:07:16,505 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint done.
      2008-06-20 04:07:48,489 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:07:48,489 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:07:48,489 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:07:48,489 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:12:16,520 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint started.
      2008-06-20 04:12:16,520 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:12:16,520 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:12:16,520 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:12:16,520 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:12:16,520 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint done.
      2008-06-20 04:12:48,505 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:12:48,505 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:12:48,505 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:12:48,505 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:17:16,536 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint started.
      2008-06-20 04:17:16,536 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:17:16,536 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:17:16,536 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:17:16,536 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:17:16,536 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint done.
      2008-06-20 04:17:48,520 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:17:48,520 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:17:48,520 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:17:48,520 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:22:46,552 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint started.
      2008-06-20 04:22:46,552 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:22:46,552 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:22:46,552 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:22:46,552 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:22:46,552 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint done.
      2008-06-20 04:22:48,536 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:22:48,536 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:22:48,536 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:22:48,536 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:27:48,552 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:27:48,552 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:27:48,552 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:27:48,552 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:28:16,552 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint started.
      2008-06-20 04:28:16,567 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:28:16,567 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:28:16,567 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:28:16,567 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:28:16,567 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint done.
      2008-06-20 04:32:48,552 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:32:48,552 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:32:48,567 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:32:48,567 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:33:16,567 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint started.
      2008-06-20 04:33:16,567 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint done.
      2008-06-20 04:37:48,567 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:37:48,567 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:37:48,567 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:37:48,567 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:38:16,583 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint started.
      2008-06-20 04:38:16,583 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:38:16,583 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:38:16,583 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:38:16,583 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:38:16,583 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint done.
      2008-06-20 04:42:11,989 [/127.0.0.1:3106] DEBUG AbstractRegion - Removing consumer: ID:emn2008-82646A4E67-3632-1213901674708-1:47:-1:1
      2008-06-20 04:42:11,989 [/127.0.0.1:3106] DEBUG TransportConnection - Stopping connection: /127.0.0.1:3106
      2008-06-20 04:42:11,989 [/127.0.0.1:3106] DEBUG TransportConnection - Stopped connection: /127.0.0.1:3106
      2008-06-20 04:42:12,005 [localhost:60001] DEBUG WireFormatNegotiator - Sending: WireFormatInfo { version=2, properties=

      {CacheSize=1024, CacheEnabled=true, SizePrefixDisabled=false, TcpNoDelayEnabled=true, MaxInactivityDuration=30000, TightEncodingEnabled=true, StackTraceEnabled=true}, magic=[A,c,t,i,v,e,M,Q]}
      2008-06-20 04:42:12,005 [/127.0.0.1:3128] DEBUG WireFormatNegotiator - Received WireFormat: WireFormatInfo { version=2, properties={CacheSize=1024, CacheEnabled=true, SizePrefixDisabled=false, TcpNoDelayEnabled=true, MaxInactivityDuration=30000, TightEncodingEnabled=true, StackTraceEnabled=true}

      , magic=[A,c,t,i,v,e,M,Q]}
      2008-06-20 04:42:12,005 [/127.0.0.1:3128] DEBUG WireFormatNegotiator - tcp:///127.0.0.1:3128 before negotiation: OpenWireFormat

      {version=2, cacheEnabled=false, stackTraceEnabled=false, tightEncodingEnabled=false, sizePrefixDisabled=false}

      2008-06-20 04:42:12,005 [/127.0.0.1:3128] DEBUG WireFormatNegotiator - tcp:///127.0.0.1:3128 after negotiation: OpenWireFormat

      {version=2, cacheEnabled=true, stackTraceEnabled=true, tightEncodingEnabled=true, sizePrefixDisabled=false}

      2008-06-20 04:42:12,005 [/127.0.0.1:3128] DEBUG TransportConnection - Setting up new connection: org.apache.activemq.broker.jmx.ManagedTransportConnection@1e9d810
      2008-06-20 04:42:12,005 [/127.0.0.1:3128] DEBUG AbstractRegion - Adding consumer: ID:emn2008-82646A4E67-3632-1213901674708-1:48:-1:1
      2008-06-20 04:42:12,036 [758751348-3:1:2] DEBUG ActiveMQSession - Sending message: ActiveMQTextMessage

      {commandId = 5, responseRequired = true, messageId = ID:emn2008-82646A4E67-2374-1213758751348-3:0:2:1:172, originalDestination = null, originalTransactionId = null, producerId = ID:emn2008-82646A4E67-2374-1213758751348-3:0:2:1, destination = queue://emn2008, transactionId = null, expiration = 0, timestamp = 1213962132036, arrival = 0, correlationId = null, replyTo = null, persistent = true, type = null, priority = 4, groupID = null, groupSequence = 0, targetConsumerId = null, compressed = false, userID = null, content = org.apache.activemq.util.ByteSequence@931b44, marshalledProperties = null, dataStructure = null, redeliveryCounter = 0, size = 3239, properties = null, readOnlyProperties = true, readOnlyBody = true, droppable = false, text = null}

      2008-06-20 04:42:12,036 [758751348-3:1:2] DEBUG HttpConnection - An error occurred while reading from the socket, is appears to be stale
      java.net.SocketException: Socket Closed
      at java.net.PlainSocketImpl.setOption(Unknown Source)
      at java.net.Socket.setSoTimeout(Unknown Source)
      at com.sun.net.ssl.internal.ssl.SSLSocketImpl.setSoTimeout(Unknown Source)
      at org.apache.commons.httpclient.HttpConnection.isStale(HttpConnection.java:510)
      at org.apache.commons.httpclient.HttpConnection.isOpen(HttpConnection.java:436)
      at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:626)
      at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:497)
      at org.apache.activemq.transport.http.HttpClientTransport.oneway(HttpClientTransport.java:83)
      at org.apache.activemq.transport.failover.FailoverTransport.oneway(FailoverTransport.java:392)
      at org.apache.activemq.transport.MutexTransport.oneway(MutexTransport.java:47)
      at org.apache.activemq.transport.ResponseCorrelator.asyncRequest(ResponseCorrelator.java:69)
      at org.apache.activemq.transport.ResponseCorrelator.request(ResponseCorrelator.java:74)
      at org.apache.activemq.ActiveMQConnection.syncSendPacket(ActiveMQConnection.java:1175)
      at org.apache.activemq.ActiveMQSession.send(ActiveMQSession.java:1551)
      at org.apache.activemq.ActiveMQMessageProducer.send(ActiveMQMessageProducer.java:465)
      at org.apache.activemq.ActiveMQMessageProducer.send(ActiveMQMessageProducer.java:415)
      at org.apache.activemq.ActiveMQQueueSender.send(ActiveMQQueueSender.java:116)
      at org.apache.activemq.network.jms.QueueBridge.sendMessage(QueueBridge.java:87)
      at org.apache.activemq.network.jms.DestinationBridge.onMessage(DestinationBridge.java:134)
      at org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:854)
      at org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:99)
      at org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:166)
      at org.apache.activemq.thread.DedicatedTaskRunner.runTask(DedicatedTaskRunner.java:101)
      at org.apache.activemq.thread.DedicatedTaskRunner.access$000(DedicatedTaskRunner.java:25)
      at org.apache.activemq.thread.DedicatedTaskRunner$1.run(DedicatedTaskRunner.java:39)
      2008-06-20 04:42:12,052 [758751348-3:1:2] DEBUG HttpConnection - Connection is stale, closing...
      2008-06-20 04:42:13,161 [758751348-3:1:2] DEBUG HttpConnection - HttpConnection.setSoTimeout(30000)
      2008-06-20 04:42:13,161 [758751348-3:1:2] DEBUG HttpMethodBase - Execute loop try 1
      2008-06-20 04:42:13,161 [758751348-3:1:2] DEBUG header - >> "POST /amq/ HTTP/1.1[\r][\n]"
      2008-06-20 04:42:13,161 [758751348-3:1:2] DEBUG HttpMethodBase - Adding Host request header
      2008-06-20 04:42:13,161 [758751348-3:1:2] DEBUG header - >> "clientID: ID:emn2008-82646A4E67-2374-1213758751348-5:5[\r][\n]"
      2008-06-20 04:42:13,161 [758751348-3:1:2] DEBUG header - >> "User-Agent: Jakarta Commons-HttpClient/2.0.1[\r][\n]"
      2008-06-20 04:42:13,161 [758751348-3:1:2] DEBUG header - >> "Host: publisher.emn2008.com[\r][\n]"
      2008-06-20 04:42:13,161 [758751348-3:1:2] DEBUG header - >> "Content-Length: 2950[\r][\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG header - >> "[\r][\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG EntityEnclosingMethod - Using buffered request body
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "<org.apache.activemq.command.ActiveMQTextMessage>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <messageId>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <producerId>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <connectionId>ID:emn2008-82646A4E67-2374-1213758751348-3:0</connectionId>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <sessionId>2</sessionId>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <value>1</value>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " </producerId>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <producerSequenceId>172</producerSequenceId>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <brokerSequenceId>0</brokerSequenceId>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " </messageId>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <producerId reference="../messageId/producerId"/>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <destination class="org.apache.activemq.command.ActiveMQQueue">[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <string>emn2008</string>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <null/>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " </destination>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <expiration>0</expiration>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <timestamp>1213962132036</timestamp>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <arrival>0</arrival>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <persistent>true</persistent>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <priority>4</priority>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <groupSequence>0</groupSequence>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <compressed>false</compressed>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <content>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <data>AAAFRzw/eG1sIHZlcnNpb249IjEuMCIgZW5jb2Rpbmc9IlVURi04IiA/PjxlbW44LW1lc3NhZ2Ug[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "eG1sbnM6eHNpPSJodHRwOi8vd3d3LnczLm9yZy8yMDAxL1hNTFNjaGVtYS1pbnN0YW5jZSIgeHNp[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "Om5vTmFtZXNwYWNlU2NoZW1hTG9jYXRpb249ImVtbjgtbWVzc2FnZS54c2QiIGJ1c2luZXNzRW50[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "aXR5SWQ9Ijg0OCIgYnVzaW5lc3NFbnRpdHlOYW1lPSJDYXJscyBKci4gKDY1MSkgS2lvc2sgMiIg[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "c3RvcmVOYnI9IjY1MSIgaXA9IjE5Mi4xNjguMS4xMiIgY3JlYXRpb25EYXRldGltZT0iMjAwOC0w[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "Ni0yMFQwNDoyNDo0MS43NTUtMDcwMCIgZXhwaXJhdGlvbkRhdGV0aW1lPSIyMDA4LTA2LTIwVDA1[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "OjI0OjM0Ljk1OC0wNzAwIj48a2lvc2tTdGF0dXMgY2xhc3M9Imtpb3NrLXN0YXR1cyIgYXZhaWxh[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "YmlsaXR5PSJPRkZMSU5FIiBtb2RlPSJPUkRFUklOR19NT0RFIiBzZXZlcml0eUxldmVsPSJMT1ci[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "IG1lc3NhZ2U9IlRoZSBhcHBsaWNhdGlvbiBpcyBvZmZsaW5lLiI+PC9raW9za1N0YXR1cz48Y29t[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "cG9uZW50U3RhdHVzTGlzdD48Y29tcG9uZW50LXN0YXR1cyBjb21wb25lbnROYW1lPSJPTkxJTkUi[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "IGF2YWlsYWJpbGl0eT0iT05MSU5FIiBtb2RlPSJSRUdVTEFSIiBzZXZlcml0eUxldmVsPSJMT1ci[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "IG1lc3NhZ2U9IlByaW50ZXIgTW9kZWwgb25saW5lLiI+PC9jb21wb25lbnQtc3RhdHVzPjxjb21w[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "b25lbnQtc3RhdHVzIGNvbXBvbmVudE5hbWU9IkNBUkRSRUFERVJPTkxJTkUiIGF2YWlsYWJpbGl0[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "eT0iT05MSU5FIiBtb2RlPSJPTkxJTkVfTU9ERSIgc2V2ZXJpdHlMZXZlbD0iTE9XIiBtZXNzYWdl[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "PSJDYXJkIFJlYWRlciBEZXZpY2Ugb25saW5lLiI+PC9jb21wb25lbnQtc3RhdHVzPjxjb21wb25l[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "bnQtc3RhdHVzIGNvbXBvbmVudE5hbWU9IkJJTExNQUNISU5FU09OTElORSIgYXZhaWxhYmlsaXR5[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "PSJPTkxJTkUiIG1vZGU9Ik9OTElORV9NT0RFIiBzZXZlcml0eUxldmVsPSJMT1ciIG1lc3NhZ2U9[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "IkJpbGwgTWFjaGluZXMgb25saW5lLiI+PC9jb21wb25lbnQtc3RhdHVzPjxjb21wb25lbnQtc3Rh[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "dHVzIGNvbXBvbmVudE5hbWU9IkNPSU5TT05MSU5FIiBhdmFpbGFiaWxpdHk9Ik9OTElORSIgbW9k[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "ZT0iT05MSU5FX01PREUiIHNldmVyaXR5TGV2ZWw9IkxPVyIgbWVzc2FnZT0iQ29pbnMgRGV2aWNl[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "IG9ubGluZS4iPjwvY29tcG9uZW50LXN0YXR1cz48Y29tcG9uZW50LXN0YXR1cyBjb21wb25lbnRO[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "YW1lPSJQT1NPTkxJTkUiIGF2YWlsYWJpbGl0eT0iT05MSU5FIiBtb2RlPSJPTkxJTkVfTU9ERSIg[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "c2V2ZXJpdHlMZXZlbD0iTE9XIiBtZXNzYWdlPSJQT1MgaXMgb25saW5lLiI+PC9jb21wb25lbnQt[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "c3RhdHVzPjwvY29tcG9uZW50U3RhdHVzTGlzdD48L2VtbjgtbWVzc2FnZT4=</data>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <offset>0</offset>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <length>1355</length>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " </content>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <redeliveryCounter>0</redeliveryCounter>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <size>3239</size>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <readOnlyProperties>true</readOnlyProperties>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <readOnlyBody>true</readOnlyBody>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <droppable>false</droppable>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <commandId>178</commandId>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> " <responseRequired>true</responseRequired>[\n]"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG content - >> "</org.apache.activemq.command.ActiveMQTextMessage>"
      2008-06-20 04:42:13,270 [758751348-3:1:2] DEBUG EntityEnclosingMethod - Request body sent
      2008-06-20 04:42:13,427 [758751348-3:1:2] DEBUG header - << "HTTP/1.1 200 OK[\r][\n]"
      2008-06-20 04:42:13,427 [758751348-3:1:2] DEBUG header - << "Server: Apache-Coyote/1.1[\r][\n]"
      2008-06-20 04:42:13,427 [758751348-3:1:2] DEBUG header - << "Content-Length: 0[\r][\n]"
      2008-06-20 04:42:13,427 [758751348-3:1:2] DEBUG header - << "Date: Fri, 20 Jun 2008 11:40:16 GMT[\r][\n]"
      2008-06-20 04:42:13,427 [758751348-3:1:2] DEBUG HttpMethodBase - Buffering response body
      2008-06-20 04:42:13,427 [758751348-3:1:2] DEBUG HttpMethodBase - Resorting to protocol version default close connection policy
      2008-06-20 04:42:13,427 [758751348-3:1:2] DEBUG HttpMethodBase - Should NOT close connection, using HTTP/1.1.
      2008-06-20 04:42:48,583 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:42:48,583 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:42:48,583 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:42:48,583 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:43:16,598 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint started.
      2008-06-20 04:43:16,598 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:43:16,598 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:43:16,598 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:43:16,598 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:43:16,598 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint done.
      2008-06-20 04:47:48,598 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:47:48,598 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:47:48,598 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:47:48,598 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:48:16,614 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint started.
      2008-06-20 04:48:16,614 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:48:16,614 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:48:16,614 [eckpoint Worker] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:48:16,614 [eckpoint Worker] DEBUG JDBCPersistenceAdapter - Cleanup done.
      2008-06-20 04:48:16,614 [eckpoint Worker] DEBUG JournalPersistenceAdapter - Checkpoint done.
      2008-06-20 04:52:48,614 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleaning up old messages.
      2008-06-20 04:52:48,614 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Executing SQL: DELETE FROM ACTIVEMQ_MSGS WHERE ( EXPIRATION<>0 AND EXPIRATION<?) OR ID <= ( SELECT min(ACTIVEMQ_ACKS.LAST_ACKED_ID) FROM ACTIVEMQ_ACKS WHERE ACTIVEMQ_ACKS.CONTAINER=ACTIVEMQ_MSGS.CONTAINER)
      2008-06-20 04:52:48,614 [Q Cleanup Timer] DEBUG DefaultJDBCAdapter - Deleted 0 old message(s).
      2008-06-20 04:52:48,614 [Q Cleanup Timer] DEBUG JDBCPersistenceAdapter - Cleanup done.

      Any information can help.

      Attachments

        Activity

          People

            Unassigned Unassigned
            hansonkx Hans
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: