[KAFKA-10419] KAFKA BROKER Shuts down when a topic is deleted manually from command line on Windows 1) operating System.

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.6.0
• Component/s: core
• Labels: Windows-10
• Environment: WIndows 10 Operating System
• Flags: Important
• Assignee: Unassigned
• Reporter: Ajay Kapoor
• Created: 18/Aug/20 20:18
• Updated: 19/Aug/20 17:36

Description

KAFKA VERSION: KAFKA_2.13-2.6.0

Delete of topic on Windows causes kafka broker shutdown:

[2020-08-18 15:18:22,858] INFO [ReplicaAlterLogDirsManager on broker 0] Removed fetcher for partitions Set(quickstart-events-0) (kafka.server.ReplicaAlterLogDirsManager)

[2020-08-18 15:18:22,899] ERROR Error while renaming dir for quickstart-events-0 in log dir C:\tmp\kafka-logs (kafka.server.LogDirFailureChannel)

java.nio.file.AccessDeniedException: C:\tmp\kafka-logs\quickstart-events-0 -> C:\tmp\kafka-logs\quickstart-events-0.d767af7933ae4fe087c212994ef02e90-delete

        at java.base/sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:89)

        at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:103)

        at java.base/sun.nio.fs.WindowsFileCopy.move(WindowsFileCopy.java:395)

        at java.base/sun.nio.fs.WindowsFileSystemProvider.move(WindowsFileSystemProvider.java:292)

        at java.base/java.nio.file.Files.move(Files.java:1425)

        at org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:913)

        at kafka.log.Log.$anonfun$renameDir$2(Log.scala:981)

        at kafka.log.Log.renameDir(Log.scala:2340)

        at kafka.log.LogManager.asyncDelete(LogManager.scala:935)

        at kafka.cluster.Partition.$anonfun$delete$1(Partition.scala:470)

        at kafka.cluster.Partition.delete(Partition.scala:461)

        at kafka.server.ReplicaManager.stopReplica(ReplicaManager.scala:344)

        at kafka.server.ReplicaManager.$anonfun$stopReplicas$9(ReplicaManager.scala:448)

        at scala.collection.mutable.HashMap$Node.foreach(HashMap.scala:587)

        at scala.collection.mutable.HashMap.foreach(HashMap.scala:475)

        at kafka.server.ReplicaManager.stopReplicas(ReplicaManager.scala:445)

        at kafka.server.KafkaApis.handleStopReplicaRequest(KafkaApis.scala:252)

        at kafka.server.KafkaApis.handle(KafkaApis.scala:137)

        at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:70)

        at java.base/java.lang.Thread.run(Thread.java:830)

        Suppressed: java.nio.file.AccessDeniedException: C:\tmp\kafka-logs\quickstart-events-0 -> C:\tmp\kafka-logs\quickstart-events-0.d767af7933ae4fe087c212994ef02e90-delete

                at java.base/sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:89)

                at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:103)

                at java.base/sun.nio.fs.WindowsFileCopy.move(WindowsFileCopy.java:309)

                at java.base/sun.nio.fs.WindowsFileSystemProvider.move(WindowsFileSystemProvider.java:292)

                at java.base/java.nio.file.Files.move(Files.java:1425)

                at org.apache.kafka.common.utils.Utils.atomicMoveWithFallback(Utils.java:910)

                ... 14 more

[2020-08-18 15:18:22,914] WARN [ReplicaManager broker=0] Stopping serving replicas in dir C:\tmp\kafka-logs (kafka.server.ReplicaManager)

[2020-08-18 15:18:22,930] WARN [ReplicaManager broker=0] Broker 0 stopped fetcher for partitions  and stopped moving logs for partitions  because they are in the failed log directory C:\tmp\kafka-logs. (kafka.server.ReplicaManager)

[2020-08-18 15:18:22,932] WARN Stopping serving logs in dir C:\tmp\kafka-logs (kafka.log.LogManager)

[2020-08-18 15:18:22,946] ERROR Shutdown broker because all log dirs in C:\tmp\kafka-logs
have failed (kafka.log.LogManager)

How to reproduce::
1. Start Zookeeper on windows
>bin\windows\zookeeper-server-start.bat config\zookeeper.properties
2. Start Kafka Broker on Windows
>bin\windows\kafka-server-start.bat config\server.properties
3. Create a Topic on Kafka Broker
>bin\windows\kafka-topics.bat --create --topic quickstart-events --bootstrap-server localhost:9092
4. Delete the Kafka Topic created above.
>bin\windows\kafka-topics.bat --delete --topic quickstart-events --bootstrap-server localhost:9092

Issue Links

• Blocked: KAFKA-8811 Can not delete topics in Windows OS