[AMQ-3325] PList temp store, chunk stream does not exist when broker under stress

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 5.5.0
• Fix Version/s: 5.6.0
• Component/s: Message Store
• Labels: FilePendingMessageCursor Temp

Environment

concurrency issue, multicore under load, sporadic occurrence, related to memory limits and dynamic destination creation/deletion

• Assignee: Gary Tully
• Reporter: Gary Tully
• Created: 17/May/11 08:58
• Updated: 20/Sep/11 10:42
• Resolved: 17/May/11 09:22

Description

apparent concurrency issue, multicore (8 cpu) under load, sporadic occurrence, related to memory limits and dynamic destination creation/deletion. Broker stack trace:

2011-04-07 08:04:07,295 [Queue:loadq-4  ] ERROR FilePendingMessageCursor       - I/O error
java.io.EOFException: Chunk stream does not exist at page: 198
	at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:454)
	at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:431)
	at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:428)
	at org.apache.kahadb.page.Transaction.load(Transaction.java:404)
	at org.apache.kahadb.page.Transaction.load(Transaction.java:361)
	at org.apache.activemq.store.kahadb.plist.PList.loadEntry(PList.java:468)
	at org.apache.activemq.store.kahadb.plist.PList.getNext(PList.java:483)
	at org.apache.activemq.store.kahadb.plist.PList$10.execute(PList.java:312)
	at org.apache.kahadb.page.Transaction.execute(Transaction.java:728)
	at org.apache.activemq.store.kahadb.plist.PList.getNext(PList.java:310)
	at org.apache.activemq.broker.region.cursors.FilePendingMessageCursor$DiskIterator.next(FilePendingMessageCursor.java:500)
	at org.apache.activemq.broker.region.cursors.FilePendingMessageCursor$DiskIterator.next(FilePendingMessageCursor.java:473)
	at org.apache.activemq.broker.region.cursors.FilePendingMessageCursor.next(FilePendingMessageCursor.java:293)
	at org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1714)
	at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:1932)
	at org.apache.activemq.broker.region.Queue.iterate(Queue.java:1440)
	at org.apache.activemq.thread.DedicatedTaskRunner.runTask(DedicatedTaskRunner.java:104)
	at org.apache.activemq.thread.DedicatedTaskRunner$1.run(DedicatedTaskRunner.java:42)