[AMQ-3098] Failed to page in more queue messages - Cannot consume messages

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Incomplete
• Affects Version/s: 5.4.2
• Assignee: Unassigned
• Reporter: Loc Truong
• Created: 20/Dec/10 03:07
• Updated: 06/Aug/18 16:21
• Resolved: 17/Feb/12 20:34

Description

With the error messages below, Consumers cannot consume any message until clearing the data folder then restart ActiveMQ, assuming old messages are lost.

ERROR | Failed to fill batch
java.lang.RuntimeException: java.io.IOException: Invalid location: 1711:34233, : java.lang.NegativeArraySizeException
at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:265)
at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:110)
at org.apache.activemq.broker.region.cursors.StoreQueueCursor.reset(StoreQueueCursor.java:157)
at org.apache.activemq.broker.region.Queue.doPageIn(Queue.java:1678)
at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:1898)
at org.apache.activemq.broker.region.Queue.iterate(Queue.java:1425)
at org.apache.activemq.thread.DedicatedTaskRunner.runTask(DedicatedTaskRunner.java:98)
at org.apache.activemq.thread.DedicatedTaskRunner$1.run(DedicatedTaskRunner.java:36)
Caused by: java.io.IOException: Invalid location: 1711:34233, : java.lang.NegativeArraySizeException
at org.apache.kahadb.journal.DataFileAccessor.readRecord(DataFileAccessor.java:94)
at org.apache.kahadb.journal.Journal.read(Journal.java:596)
at org.apache.activemq.store.kahadb.MessageDatabase.load(MessageDatabase.java:786)
at org.apache.activemq.store.kahadb.KahaDBStore.loadMessage(KahaDBStore.java:956)
at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$5.execute(KahaDBStore.java:494)
at org.apache.kahadb.page.Transaction.execute(Transaction.java:728)
at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recoverNextMessages(KahaDBStore.java:485)
at org.apache.activemq.store.ProxyMessageStore.recoverNextMessages(ProxyMessageStore.java:88)
at org.apache.activemq.broker.region.cursors.QueueStorePrefetch.doFillBatch(QueueStorePrefetch.java:97)
at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:262)
... 7 more
ERROR | Failed to page in more queue messages
java.lang.RuntimeException: java.lang.RuntimeException: java.io.IOException: Invalid location: 1711:34233, : java.lang.NegativeArraySizeException
at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:113)
at org.apache.activemq.broker.region.cursors.StoreQueueCursor.reset(StoreQueueCursor.java:157)
at org.apache.activemq.broker.region.Queue.doPageIn(Queue.java:1678)
at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:1898)
at org.apache.activemq.broker.region.Queue.iterate(Queue.java:1425)
at org.apache.activemq.thread.DedicatedTaskRunner.runTask(DedicatedTaskRunner.java:98)
at org.apache.activemq.thread.DedicatedTaskRunner$1.run(DedicatedTaskRunner.java:36)
Caused by: java.lang.RuntimeException: java.io.IOException: Invalid location: 1711:34233, : java.lang.NegativeArraySizeException
at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:265)
at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:110)
... 6 more
Caused by: java.io.IOException: Invalid location: 1711:34233, : java.lang.NegativeArraySizeException
at org.apache.kahadb.journal.DataFileAccessor.readRecord(DataFileAccessor.java:94)
at org.apache.kahadb.journal.Journal.read(Journal.java:596)
at org.apache.activemq.store.kahadb.MessageDatabase.load(MessageDatabase.java:786)
at org.apache.activemq.store.kahadb.KahaDBStore.loadMessage(KahaDBStore.java:956)
at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore$5.execute(KahaDBStore.java:494)
at org.apache.kahadb.page.Transaction.execute(Transaction.java:728)
at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.recoverNextMessages(KahaDBStore.java:485)
at org.apache.activemq.store.ProxyMessageStore.recoverNextMessages(ProxyMessageStore.java:88)
at org.apache.activemq.broker.region.cursors.QueueStorePrefetch.doFillBatch(QueueStorePrefetch.java:97)
at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:262)
... 7 more

Issue Links

• is duplicated by: AMQ-5786 ActiveMQ failed to start with KahaDB reporting corrupt journal records and throwing NegativeArraySizeException
• relates to: AMQ-6134 ActiveMQ corrupted state when local disk fills up and Queues begin to buffer to KahaDB