Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4872

Getting java.io.IOException in kafka 0.10.1.0 & 0.10.1.1

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.10.1.0, 0.10.1.1
    • Fix Version/s: None
    • Component/s: network
    • Labels:
      None
    • Environment:
      Centos machine, 8GB RAM, 4 Core CPUs
    • Flags:
      Important

      Description

      I am running load test(20k msgs / sec) on kafka cluster with 3 nodes with above mentioned configuration.When I run same amount of load on 0.9 version it is working fine.Please look into it.

      After 7-8 hours of running I get this exception on broker:

      [2017-03-09 02:57:55,989] WARN [ReplicaFetcherThread-0-1], Error in fetch kafka.server.ReplicaFetcherThread$FetchRequest@36201b29 (kafka.server.ReplicaFetcherThread)
      java.io.IOException: Connection to 1 was disconnected before the response was read
      at kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$extension$1$$anonfun$apply$1.apply(NetworkClientBlockingOps.scala:115)
      at kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$extension$1$$anonfun$apply$1.apply(NetworkClientBlockingOps.scala:112)
      at scala.Option.foreach(Option.scala:257)
      at kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$extension$1.apply(NetworkClientBlockingOps.scala:112)
      at kafka.utils.NetworkClientBlockingOps$$anonfun$blockingSendAndReceive$extension$1.apply(NetworkClientBlockingOps.scala:108)
      at kafka.utils.NetworkClientBlockingOps$.recursivePoll$1(NetworkClientBlockingOps.scala:137)
      at kafka.utils.NetworkClientBlockingOps$.kafka$utils$NetworkClientBlockingOps$$pollContinuously$extension(NetworkClientBlockingOps.scala:143)
      at kafka.utils.NetworkClientBlockingOps$.blockingSendAndReceive$extension(NetworkClientBlockingOps.scala:108)
      at kafka.server.ReplicaFetcherThread.sendRequest(ReplicaFetcherThread.scala:253)
      at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:238)
      at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:42)
      at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:118)
      at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:103)
      at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              khushboo.sangal Khushboo Sangal
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: