[KAFKA-2222] Write "Input/output error" did not result in broker shutdown

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 0.8.1.2
• Assignee: Unassigned
• Reporter: Jason Rosenberg
• Created: 27/May/15 04:26
• Updated: 28/Oct/17 15:19
• Resolved: 28/Oct/17 15:19

Description

We had a disk start failing intermittently, and began seeing errors like this in the broker. Usually, IOExceptions during a file write result in the broker shutting down immediately. This is with version 0.8.2.1.

2015-05-21 23:59:57,841 ERROR [kafka-network-thread-27330-2] network.Processor - Closing socket for /1.2.3.4 because of error
java.io.IOException: Input/output error
        at sun.nio.ch.FileChannelImpl.transferTo0(Native Method)
        at sun.nio.ch.FileChannelImpl.transferToDirectly(FileChannelImpl.java:443)
        at sun.nio.ch.FileChannelImpl.transferTo(FileChannelImpl.java:575)
        at kafka.log.FileMessageSet.writeTo(FileMessageSet.scala:147)
        at kafka.api.PartitionDataSend.writeTo(FetchResponse.scala:70)
        at kafka.network.MultiSend.writeTo(Transmission.scala:101)
        at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:125)
        at kafka.network.MultiSend.writeTo(Transmission.scala:101)
        at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
        at kafka.network.Processor.write(SocketServer.scala:472)
        at kafka.network.Processor.run(SocketServer.scala:342)
        at java.lang.Thread.run(Thread.java:745)

This resulted in intermittent producer failures failing to send messages successfully, etc.