Uploaded image for project: 'ActiveMQ'
  1. ActiveMQ
  2. AMQ-3122

Recovery after out of disk space (when space freed up) needs manual intervention

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 5.4.1, 5.4.2
    • 5.5.0
    • Message Store
    • None

    Description

      When broker runs out of disk space, the journal excepts and the send fails with an exception as expected. The default IO exception handler ignores the exception. (aside: it is possible to install an exception handler that shuts down the broker: http://activemq.apache.org/configurable-ioexception-handling.html)

      On restart, the last journal file that failed a write is left with 0 size, this impedes restart recovery as it cannot be parsed.

      ERROR | Failed to start ActiveMQ JMS Message Broker. Reason: java.io.EOFException
      java.io.EOFException
      	at java.io.RandomAccessFile.readInt(RandomAccessFile.java:725)
      	at org.apache.kahadb.journal.DataFileAccessor.readLocationDetails(DataFileAccessor.java:115)
      	at org.apache.kahadb.journal.Journal.getNextLocation(Journal.java:498)
      	at org.apache.activemq.store.kahadb.MessageDatabase.recover(MessageDatabase.java:395)
      	at org.apache.activemq.store.kahadb.MessageDatabase.open(MessageDatabase.java:280)
      	at org.apache.activemq.store.kahadb.MessageDatabase.load(MessageDatabase.java:321)
      	at org.apache.activemq.store.kahadb.MessageDatabase.start(MessageDatabase.java:182)
      	at org.apache.activemq.store.kahadb.KahaDBPersistenceAdapter.start(KahaDBPersistenceAdapter.java:183)
      	at org.apache.activemq.broker.BrokerService.start(BrokerService.java:469)

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            gtully Gary Tully
            gtully Gary Tully
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment