Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2222

Write "Input/output error" did not result in broker shutdown

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.8.1.2
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      We had a disk start failing intermittently, and began seeing errors like this in the broker. Usually, IOExceptions during a file write result in the broker shutting down immediately. This is with version 0.8.2.1.

      2015-05-21 23:59:57,841 ERROR [kafka-network-thread-27330-2] network.Processor - Closing socket for /1.2.3.4 because of error
      java.io.IOException: Input/output error
              at sun.nio.ch.FileChannelImpl.transferTo0(Native Method)
              at sun.nio.ch.FileChannelImpl.transferToDirectly(FileChannelImpl.java:443)
              at sun.nio.ch.FileChannelImpl.transferTo(FileChannelImpl.java:575)
              at kafka.log.FileMessageSet.writeTo(FileMessageSet.scala:147)
              at kafka.api.PartitionDataSend.writeTo(FetchResponse.scala:70)
              at kafka.network.MultiSend.writeTo(Transmission.scala:101)
              at kafka.api.TopicDataSend.writeTo(FetchResponse.scala:125)
              at kafka.network.MultiSend.writeTo(Transmission.scala:101)
              at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:231)
              at kafka.network.Processor.write(SocketServer.scala:472)
              at kafka.network.Processor.run(SocketServer.scala:342)
              at java.lang.Thread.run(Thread.java:745)
      

      This resulted in intermittent producer failures failing to send messages successfully, etc.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jbrosenberg@gmail.com Jason Rosenberg
            • Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: