[AMQ-4304] Stopping the broker due ro IO exception. java.io.EOFException: Chunk stream does not exist at page

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 5.4.2
• Fix Version/s: NEEDS_REVIEW
• Component/s: Broker

Environment

OS: aix 6.1 //

• Assignee: Unassigned
• Reporter: richard jung
• Created: 08/Feb/13 10:14
• Updated: 15/Apr/13 18:51
• Resolved: 15/Apr/13 18:51

Description

hi all

we tried to find out these problems:(Active Mq) but we couldn't find anythings
So I'm really asking those problems to u

I tried to capture these logs on website
plz let's me know what is worng? and what am i doing to fix it?
I really need to ur comment here ugently

1. have u experienced this Active Mq system which is stopping by themselves after the first situation?
(INFO: Active Mq version: 5.4.2 // OS AIX 6.1 //)
2. can u do it as same situation?

first situation
2013-02-05 21:59:51,978 | INFO | Transport failed: java.io.IOException: Connection reset by peer | org.apache.activemq.broker.TransportConnection.Transport | ActiveMQ NIO Worker
2013-02-05 21:59:51,978 | INFO | Transport failed: java.io.IOException: Broken pipe | org.apache.activemq.broker.TransportConnection.Transport | Async Exception Handler
2013-02-05 21:59:51,979 | INFO | Transport failed: java.io.IOException: Broken pipe | org.apache.activemq.broker.TransportConnection.Transport | Async Exception Handler
2013-02-05 21:59:51,979 | INFO | Transport failed: java.io.EOFException | org.apache.activemq.broker.TransportConnection.Transport | ActiveMQ NIO Worker
2013-02-05 21:59:51,980 | INFO | Transport failed: java.io.IOException: Broken pipe | org.apache.activemq.broker.TransportConnection.Transport | Async Exception Handler
2013-02-05 21:59:51,980 | WARN | Duplicate message add attempt rejected. Destination: CDKC.COMM.HI.Q, Message id: ID:upafep81-63322-1359597409289-0:467046:1:1:2 | org.apache.activemq.store.kahadb.MessageDatabase | ConcurrentQueueStoreAndDispatch

second situation

• • Kahadb write fail
    2013-02-05 22:00:20,824 | INFO | Transport failed: java.io.IOException: Broken pipe | org.apache.activemq.broker.TransportConnection.Transport | Async Exception Handler
    2013-02-05 22:00:20,824 | INFO | Transport failed: java.io.IOException: Connection reset by peer | org.apache.activemq.broker.TransportConnection.Transport | ActiveMQ NIO Worker
    2013-02-05 22:00:20,825 | INFO | Transport failed: java.io.IOException: Broken pipe | org.apache.activemq.broker.TransportConnection.Transport | Async Exception Handler
    2013-02-05 22:00:20,826 | INFO | Transport failed: java.io.IOException: Connection reset by peer | org.apache.activemq.broker.TransportConnection.Transport | ActiveMQ NIO Worker
    2013-02-05 22:00:20,825 | ERROR | KahaDB failed to store to Journal | org.apache.activemq.store.kahadb.MessageDatabase | ConcurrentQueueStoreAndDispatch
    java.io.EOFException: Chunk stream does not exist at page: 460
    at org.apache.kahadb.page.Transaction$2.readPage(Transaction.java:454)
    at org.apache.kahadb.page.Transaction$2.<init>(Transaction.java:431)
    at org.apache.kahadb.page.Transaction.openInputStream(Transaction.java:428)
    at org.apache.kahadb.page.Transaction.load(Transaction.java:380)
    at org.apache.kahadb.page.Transaction.load(Transaction.java:361)
    at org.apache.kahadb.index.BTreeIndex.loadNode(BTreeIndex.java:262)
    at org.apache.kahadb.index.BTreeNode.getChild(BTreeNode.java:225)
    at org.apache.kahadb.index.BTreeNode.getLeafNode(BTreeNode.java:672)
    at org.apache.kahadb.index.BTreeNode.put(BTreeNode.java:368)
    at org.apache.kahadb.index.BTreeIndex.put(BTreeIndex.java:189)
    at org.apache.activemq.store.kahadb.MessageDatabase$MessageOrderIndex.put(MessageDatabase.java:2220)
    at org.apache.activemq.store.kahadb.MessageDatabase.upadateIndex(MessageDatabase.java:997)
    at org.apache.activemq.store.kahadb.MessageDatabase$14.execute(MessageDatabase.java:872)
    at org.apache.kahadb.page.Transaction.execute(Transaction.java:728)
    at org.apache.activemq.store.kahadb.MessageDatabase.process(MessageDatabase.java:870)
    at org.apache.activemq.store.kahadb.MessageDatabase$13.visit(MessageDatabase.java:828)
    at org.apache.activemq.store.kahadb.data.KahaAddMessageCommand.visit(KahaAddMessageCommand.java:241)
    at org.apache.activemq.store.kahadb.MessageDatabase.process(MessageDatabase.java:825)
    at org.apache.activemq.store.kahadb.MessageDatabase.store(MessageDatabase.java:751)
    at org.apache.activemq.store.kahadb.KahaDBStore$KahaDBMessageStore.addMessage(KahaDBStore.java:366)
    at org.apache.activemq.store.kahadb.KahaDBStore$StoreQueueTask.run(KahaDBStore.java:1123)
    at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:736)

third situation

• • ActiveMQ (itself)
    2013-02-05 22:00:20,994 | INFO | ActiveMQ Message Broker (brokerfcn11, ID:upafep82-32935-1359587803187-0:1) is shutting down | org.apache.activemq.broker.BrokerService | Thread-9152
    2013-02-05 22:00:21,416 | INFO | Connector nio Stopped | org.apache.activemq.broker.TransportConnector | Thread-9151
    2013-02-05 22:00:21,416 | INFO | Connector nio Stopped | org.apache.activemq.broker.TransportConnector | Thread-9152
    2013-02-05 22:00:21,416 | INFO | Connector nio Stopped | org.apache.activemq.broker.TransportConnector | Thread-9150
    2013-02-05 22:00:21,433 | INFO | Stopping async queue tasks | org.apache.activemq.store.kahadb.KahaDBStore | Thread-9151
    2013-02-05 22:00:21,433 | INFO | PListStore:/sfs/activemq/FCN/data/brokerfcn11/tmp_storage stopped | org.apache.activemq.store.kahadb.plist.PListStore | Thread-9152
    2013-02-05 22:00:21,433 | INFO | Stopping async topic tasks | org.apache.activemq.store.kahadb.KahaDBStore | Thread-9151
    2013-02-05 22:00:21,433 | INFO | ActiveMQ JMS Message Broker (brokerfcn11, ID:upafep82-32935-1359587803187-0:1) stopped | org.apache.activemq.broker.BrokerService | Thread-9152
    2013-02-05 22:00:21,434 | INFO | Stopped KahaDB | org.apache.activemq.store.kahadb.KahaDBStore | Thread-9151
    2013-02-05 22:00:21,434 | INFO | ActiveMQ JMS Message Broker (brokerfcn11, ID:upafep82-32935-1359587803187-0:1) stopped | org.apache.activemq.broker.BrokerService | Thread-9150