[KAFKA-5183] Transient failure: ReassignPartitionsClusterTest.shouldChangeThrottleOnRerunAndRemoveOnVerify - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:
None

Description

https://builds.apache.org/job/kafka-pr-jdk8-scala2.11/3577/testReport/junit/kafka.admin/ReassignPartitionsClusterTest/shouldChangeThrottleOnRerunAndRemoveOnVerify/

Error Message

java.lang.AssertionError: throttle limit/replicas was not set

Stacktrace

java.lang.AssertionError: throttle limit/replicas was not set
	at kafka.utils.TestUtils$.fail(TestUtils.scala:311)
	at kafka.utils.TestUtils$.waitUntilTrue(TestUtils.scala:811)
	at kafka.admin.ReplicationQuotaUtils$.checkThrottleConfigAddedToZK(ReplicationQuotaUtils.scala:38)
	at kafka.admin.ReassignPartitionsClusterTest.shouldChangeThrottleOnRerunAndRemoveOnVerify(ReassignPartitionsClusterTest.scala:266)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
	at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
	at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:114)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:57)
	at org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:66)
	at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
	at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
	at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
	at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
	at org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:109)
	at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
	at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
	at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:147)
	at org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:129)
	at org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:404)
	at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63)
	at org.gradle.internal.concurrent.StoppableExecutorImpl$1.run(StoppableExecutorImpl.java:46)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

Standard Output

[2017-05-05 22:23:53,206] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100,101]}]}

Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The throttle limit was set to 10000000 B/s
Successfully started reassignment of partitions.
[2017-05-05 22:24:03,427] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:03,483] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:05,122] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:05,138] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:06,185] ERROR [ReplicaFetcherThread-0-104]: Error for partition [topic2,1] to broker 104:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread:99)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"topic2","partition":1,"replicas":[104,105]},{"topic":"topic2","partition":0,"replicas":[104,105]},{"topic":"topic1","partition":1,"replicas":[100,101]},{"topic":"topic1","partition":2,"replicas":[103,104]},{"topic":"topic1","partition":0,"replicas":[100,101]},{"topic":"topic2","partition":2,"replicas":[103,104]}]}

Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The throttle limit was set to 1000000 B/s
Successfully started reassignment of partitions.
[2017-05-05 22:24:07,067] ERROR [Controller 100]: Error completing reassignment of partition [topic2,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic2,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:07,143] ERROR [Controller 100]: Error completing reassignment of partition [topic1,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
	at scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:428)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:07,255] ERROR [Controller 100]: Error completing reassignment of partition [topic1,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,2] to be reassigned is already assigned to replicas 103,104. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:221)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:10,139] WARN caught end of stream exception (org.apache.zookeeper.server.NIOServerCnxn:368)
EndOfStreamException: Unable to read additional data from client sessionid 0x15bdab6800b0003, likely client has closed socket
	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
	at java.lang.Thread.run(Thread.java:745)
[2017-05-05 22:24:11,420] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:11,434] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":1,"replicas":[100,101]},{"topic":"my-topic","partition":0,"replicas":[100,101]},{"topic":"my-topic","partition":2,"replicas":[100,101]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:12,271] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,1] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,1] to be reassigned is already assigned to replicas 102,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:16,144] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:16,157] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:18,698] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:18,708] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:20,312] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:20,323] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:21,782] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:21,797] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:22,037] ERROR [ReplicaFetcherThread-0-102]: Error for partition [my-topic,2] to broker 102:org.apache.kafka.common.errors.UnknownTopicOrPartitionException: This server does not host this topic-partition. (kafka.server.ReplicaFetcherThread:99)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":1,"replicas":[101,102]},{"topic":"my-topic","partition":0,"replicas":[100,101]},{"topic":"my-topic","partition":2,"replicas":[102,100]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:22,472] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,0] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map3.foreach(Map.scala:161)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:22,531] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,1] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,1] to be reassigned is already assigned to replicas 101,100. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:22,587] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,2] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:22,589] ERROR [Controller 100]: Error completing reassignment of partition [my-topic,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [my-topic,2] to be reassigned is already assigned to replicas 100,101. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:25,282] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:25,294] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
The throttle limit was set to 1000 B/s
[2017-05-05 22:24:27,545] ERROR [Controller 0]: Error completing reassignment of partition [orders,1] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [orders,1] to be reassigned is already assigned to replicas 0,1,2. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map4.foreach(Map.scala:188)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:27,637] ERROR [Controller 0]: Error completing reassignment of partition [orders,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [orders,0] to be reassigned is already assigned to replicas 0,2,3. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:28,114] ERROR [Controller 0]: Error completing reassignment of partition [deliveries,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [deliveries,0] to be reassigned is already assigned to replicas 1,2. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:31,022] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:31,040] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"my-topic","partition":0,"replicas":[100,101]}]}

Save this to use as the --reassignment-json-file option during rollback
Warning: You must run Verify periodically, until the reassignment completes, to ensure the throttle is removed. You can also alter the throttle by rerunning the Execute command passing a new value.
The throttle limit was set to 1000000 B/s
Successfully started reassignment of partitions.
Status of partition reassignment: 
Reassignment of partition [my-topic,0] is still in progress
There is an existing assignment running.
[2017-05-05 22:24:50,684] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
[2017-05-05 22:24:50,734] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)
Current partition replica assignment

{"version":1,"partitions":[{"topic":"topic2","partition":1,"replicas":[101,102]},{"topic":"topic2","partition":0,"replicas":[100,101]},{"topic":"topic1","partition":1,"replicas":[101,102]},{"topic":"topic1","partition":2,"replicas":[102,100]},{"topic":"topic1","partition":0,"replicas":[100,101]},{"topic":"topic2","partition":2,"replicas":[102,100]}]}

Save this to use as the --reassignment-json-file option during rollback
Successfully started reassignment of partitions.
[2017-05-05 22:24:51,982] ERROR [Controller 100]: Error completing reassignment of partition [topic1,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,0] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map2.foreach(Map.scala:137)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:51,989] ERROR [Controller 100]: Error completing reassignment of partition [topic2,2] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic2,2] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map2.foreach(Map.scala:137)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:51,993] ERROR [Controller 100]: Error completing reassignment of partition [topic1,0] (kafka.controller.KafkaController:105)
kafka.common.KafkaException: Partition [topic1,0] to be reassigned is already assigned to replicas 100,102. Ignoring request for partition reassignment
	at kafka.controller.KafkaController.initiateReassignReplicasForTopicPartition(KafkaController.scala:553)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1274)
	at kafka.controller.KafkaController$PartitionReassignment$$anonfun$process$16.apply(KafkaController.scala:1267)
	at scala.collection.immutable.Map$Map1.foreach(Map.scala:116)
	at kafka.controller.KafkaController$PartitionReassignment.process(KafkaController.scala:1267)
	at kafka.controller.KafkaController$ControllerEventThread.doWork(KafkaController.scala:1147)
	at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:64)
[2017-05-05 22:24:54,342] ERROR ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes (org.apache.zookeeper.server.ZooKeeperServer:472)

Attachments

Issue Links

is related to

KAFKA-6410 Scala ReassignPartitionsClusterTest (shouldExecuteThrottledReassignment)

Open

KAFKA-4262 Intermittent unit test failure ReassignPartitionsClusterTest.shouldExecuteThrottledReassignment

Reopened

KAFKA-6078 Investigate failure of ReassignPartitionsClusterTest.shouldExpandCluster

Resolved

KAFKA-6736 ReassignPartitionsClusterTest#shouldMoveSubsetOfPartitions is flaky

Resolved

relates to

KAFKA-7977 Flaky Test ReassignPartitionsClusterTest#shouldOnlyThrottleMovingReplicas

Resolved

Activity

People

Assignee:: Unassigned

Reporter:: Xavier Léauté

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 05/May/17 23:01

Updated:: 22/Feb/19 03:09