[KAFKA-6406] Topic deletion fails and kafka shuts down (on windows only)

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.0.0
• Component/s: core
• Labels: windows
• Environment: Windows only, ; Linux is ok
• Assignee: Unassigned
• Reporter: pre sto
• Created: 28/Dec/17 19:49
• Updated: 30/Jan/20 11:23

Description

[2017-12-28 21:30:40,593] INFO [GroupMetadataManager brokerId=1] Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
[2017-12-28 21:30:40,607] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions skytest-0 (kafka.server.ReplicaFetcherManager)
[2017-12-28 21:30:40,610] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions (kafka.server.ReplicaFetcherManager)
[2017-12-28 21:30:40,611] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions skytest-0 (kafka.server.ReplicaFetcherManager)
[2017-12-28 21:30:40,633] ERROR Error while deleting skytest-0 in dir E:\dev\trunkA\runtime\target\x86_64\windows\skyboxview\server\bin\..\..\data\kafka\db. (kafka.server.LogDirFailureChannel)
java.io.IOException: Failed to rename log directory from E:\dev\trunkA\runtime\target\x86_64\windows\skyboxview\server\bin\..\..\data\kafka\db\skytest-0 to E:\dev\trunkA\runtime\target\x86_64\windows\skyboxview\server\bin\..\..\data\kafka\db\skytest-0.2397c4520a0946f0a1887e31f056477b-delete
at kafka.log.LogManager.asyncDelete(LogManager.scala:671)
at kafka.cluster.Partition$$anonfun$delete$1.apply(Partition.scala:178)
at kafka.cluster.Partition$$anonfun$delete$1.apply(Partition.scala:173)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:217)
at kafka.utils.CoreUtils$.inWriteLock(CoreUtils.scala:225)
at kafka.cluster.Partition.delete(Partition.scala:173)
at kafka.server.ReplicaManager.stopReplica(ReplicaManager.scala:341)
at kafka.server.ReplicaManager$$anonfun$stopReplicas$2.apply(ReplicaManager.scala:373)
at kafka.server.ReplicaManager$$anonfun$stopReplicas$2.apply(ReplicaManager.scala:371)
at scala.collection.Iterator$class.foreach(Iterator.scala:891)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1334)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at kafka.server.ReplicaManager.stopReplicas(ReplicaManager.scala:371)
at kafka.server.KafkaApis.handleStopReplicaRequest(KafkaApis.scala:190)
at kafka.server.KafkaApis.handle(KafkaApis.scala:104)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:65)
at java.lang.Thread.run(Thread.java:748)
[2017-12-28 21:30:40,634] INFO [ReplicaManager broker=1] Stopping serving replicas in dir E:\dev\trunkA\runtime\target\x86_64\windows\skyboxview\server\bin\..\..\data\kafka\db (kafka.server.ReplicaManager)
[2017-12-28 21:30:40,635] INFO [ReplicaManager broker=1] Partitions are offline due to failure on log directory E:\dev\trunkA\runtime\target\x86_64\windows\skyboxview\server\bin\..\..\data\kafka\db (kafka.server.ReplicaManager)
[2017-12-28 21:30:40,636] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions (kafka.server.ReplicaFetcherManager)
[2017-12-28 21:30:40,637] INFO [ReplicaManager broker=1] Broker 1 stopped fetcher for partitions because they are in the failed log dir E:\dev\trunkA\runtime\target\x86_64\windows\skyboxview\server\bin\..\..\data\kafka\db (kafka.server.ReplicaManager)
[2017-12-28 21:30:40,637] INFO Stopping serving logs in dir E:\dev\trunkA\runtime\target\x86_64\windows\skyboxview\server\bin\..\..\data\kafka\db (kafka.log.LogManager)
[2017-12-28 21:30:40,638] FATAL Shutdown broker because all log dirs in E:\dev\trunkA\runtime\target\x86_64\windows\skyboxview\server\bin\..\..\data\kafka\db have failed (kafka.log.LogManager)

Issue Links

• relates to: KAFKA-9458 Kafka crashed in windows environment