[KAFKA-5805] The console consumer crushes broker on Windows

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 0.11.0.0
• Component/s: consumer
• Labels: windows
• Environment: Windows 7 x86 || Windows 10 x64; jre1.8.0_144; jdk1.8.0_144
• Assignee: Unassigned
• Reporter: Aleksandar
• Created: 29/Aug/17 16:50
• Updated: 19/Jul/18 20:21

Description

I was just following Quick start guide on http://kafka.apache.org/documentation.html#quickstart

Started ZooKeeper server
Started Kafka Server
Created Test topic
Published message under test topic

On other terminal windows I run kafka-console-consumer.bat and that crushed Broker with following exception:

java.io.IOException: Map failed
at sun.nio.ch.FileChannelImpl.map(Unknown Source)
at kafka.log.AbstractIndex.<init>(AbstractIndex.scala:63)
at kafka.log.OffsetIndex.<init>(OffsetIndex.scala:52)
at kafka.log.LogSegment.<init>(LogSegment.scala:77)
at kafka.log.Log.loadSegments(Log.scala:385)
at kafka.log.Log.<init>(Log.scala:179)
at kafka.log.Log$.apply(Log.scala:1580)
at kafka.log.LogManager$$anonfun$createLog$1.apply(LogManager.scala:417)
at kafka.log.LogManager$$anonfun$createLog$1.apply(LogManager.scala:412)
at scala.Option.getOrElse(Option.scala:121)
at kafka.log.LogManager.createLog(LogManager.scala:412)
at kafka.cluster.Partition$$anonfun$getOrCreateReplica$1.apply(Partition.scala:122)
at kafka.cluster.Partition$$anonfun$getOrCreateReplica$1.apply(Partition.scala:119)
at kafka.utils.Pool.getAndMaybePut(Pool.scala:70)
at kafka.cluster.Partition.getOrCreateReplica(Partition.scala:118)
at kafka.cluster.Partition$$anonfun$3$$anonfun$5.apply(Partition.scala:179)
at kafka.cluster.Partition$$anonfun$3$$anonfun$5.apply(Partition.scala:179)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.Iterator$class.foreach(Iterator.scala:891)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at kafka.cluster.Partition$$anonfun$3.apply(Partition.scala:179)
at kafka.cluster.Partition$$anonfun$3.apply(Partition.scala:173)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:213)
at kafka.utils.CoreUtils$.inWriteLock(CoreUtils.scala:221)
at kafka.cluster.Partition.makeLeader(Partition.scala:173)
at kafka.server.ReplicaManager$$anonfun$makeLeaders$4.apply(ReplicaManager.scala:929)
at kafka.server.ReplicaManager$$anonfun$makeLeaders$4.apply(ReplicaManager.scala:928)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:130)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:130)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:236)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:130)
at kafka.server.ReplicaManager.makeLeaders(ReplicaManager.scala:928)
at kafka.server.ReplicaManager.becomeLeaderOrFollower(ReplicaManager.scala:873)
at kafka.server.KafkaApis.handleLeaderAndIsrRequest(KafkaApis.scala:168)
at kafka.server.KafkaApis.handle(KafkaApis.scala:101)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:66)
at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.OutOfMemoryError: Map failed
at sun.nio.ch.FileChannelImpl.map0(Native Method)
... 43 more
[2017-08-29 18:36:37,110] INFO [Group Metadata Manager on Broker 0]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.group.GroupMetadataManager)