[2017-04-24 22:41:32,922] WARN [ReplicaFetcherThread-0-73], Error in fetch kafka.server.ReplicaFetcherThread$FetchRequest@10333995 (kafk a.server.ReplicaFetcherThread) java.io.IOException: Connection to 73 was disconnected before the response was read at kafka.utils.NetworkClientBlockingOps$.$anonfun$blockingSendAndReceive$3(NetworkClientBlockingOps.scala:114) at kafka.utils.NetworkClientBlockingOps$.$anonfun$blockingSendAndReceive$3$adapted(NetworkClientBlockingOps.scala:112) at scala.Option.foreach(Option.scala:257) at kafka.utils.NetworkClientBlockingOps$.$anonfun$blockingSendAndReceive$1(NetworkClientBlockingOps.scala:112) at kafka.utils.NetworkClientBlockingOps$.recursivePoll$1(NetworkClientBlockingOps.scala:136) at kafka.utils.NetworkClientBlockingOps$.pollContinuously$extension(NetworkClientBlockingOps.scala:142) at kafka.utils.NetworkClientBlockingOps$.blockingSendAndReceive$extension(NetworkClientBlockingOps.scala:108) at kafka.server.ReplicaFetcherThread.sendRequest(ReplicaFetcherThread.scala:249) at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:234) at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:42) at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:118) at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:103) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63) [2017-04-24 22:41:33,386] INFO Partition [__consumer_offsets,17] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,386] INFO Partition [__consumer_offsets,26] on broker 72: Shrinking ISR for partition [__consumer_offsets,26] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,389] INFO re-registering broker info in ZK for broker 72 (kafka.server.KafkaHealthcheck$SessionExpireListener) [2017-04-24 22:41:33,390] INFO Creating /brokers/ids/72 (is it secure? false) (kafka.utils.ZKCheckedEphemeral) [2017-04-24 22:41:33,391] INFO Partition [__consumer_offsets,26] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,391] INFO Partition [__consumer_offsets,5] on broker 72: Shrinking ISR for partition [__consumer_offsets,5] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,392] INFO Result of znode creation is: OK (kafka.utils.ZKCheckedEphemeral) [2017-04-24 22:41:33,392] INFO Registered broker 72 at path /brokers/ids/72 with addresses: EndPoint(10.52.208.72,9092,ListenerName(PLAINTEXT),PLAINTEXT) (kafka.utils.ZkUtils) [2017-04-24 22:41:33,393] INFO done re-registering broker (kafka.server.KafkaHealthcheck$SessionExpireListener) [2017-04-24 22:41:33,393] INFO Subscribing to /brokers/topics path to watch for new topics (kafka.server.KafkaHealthcheck$SessionExpireListener) [2017-04-24 22:41:33,397] INFO Partition [__consumer_offsets,5] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,397] INFO Partition [__consumer_offsets,38] on broker 72: Shrinking ISR for partition [__consumer_offsets,38] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,400] INFO New leader is 74 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener) [2017-04-24 22:41:33,402] INFO Partition [__consumer_offsets,38] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,402] INFO Partition [__consumer_offsets,41] on broker 72: Shrinking ISR for partition [__consumer_offsets,41] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,406] INFO Partition [__consumer_offsets,41] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,407] INFO Partition [__consumer_offsets,20] on broker 72: Shrinking ISR for partition [__consumer_offsets,20] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,410] INFO Partition [__consumer_offsets,20] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,410] INFO Partition [DSLAM,0] on broker 72: Shrinking ISR for partition [DSLAM,0] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,413] INFO Partition [DSLAM,0] on broker 72: Cached zkVersion [42] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,413] INFO Partition [__consumer_offsets,29] on broker 72: Shrinking ISR for partition [__consumer_offsets,29] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,417] INFO Partition [__consumer_offsets,29] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,418] INFO Partition [__consumer_offsets,8] on broker 72: Shrinking ISR for partition [__consumer_offsets,8] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,420] INFO Partition [__consumer_offsets,8] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,421] INFO Partition [test,1] on broker 72: Shrinking ISR for partition [test,1] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,424] INFO Partition [test,1] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,424] INFO Partition [__consumer_offsets,11] on broker 72: Shrinking ISR for partition [__consumer_offsets,11] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,427] INFO Partition [__consumer_offsets,11] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,427] INFO Partition [__consumer_offsets,44] on broker 72: Shrinking ISR for partition [__consumer_offsets,44] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,430] INFO Partition [__consumer_offsets,44] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,431] INFO Partition [__consumer_offsets,23] on broker 72: Shrinking ISR for partition [__consumer_offsets,23] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,434] INFO Partition [__consumer_offsets,23] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,434] INFO Partition [__consumer_offsets,32] on broker 72: Shrinking ISR for partition [__consumer_offsets,32] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,437] INFO Partition [__consumer_offsets,32] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,437] INFO Partition [__consumer_offsets,47] on broker 72: Shrinking ISR for partition [__consumer_offsets,47] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,440] INFO Partition [__consumer_offsets,47] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,440] INFO Partition [IL2S,2] on broker 72: Shrinking ISR for partition [IL2S,2] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,443] INFO Partition [IL2S,2] on broker 72: Cached zkVersion [38] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,471] INFO Partition [SEGMENT,2] on broker 72: Shrinking ISR for partition [SEGMENT,2] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,476] INFO Partition [SEGMENT,2] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,476] INFO Partition [__consumer_offsets,35] on broker 72: Shrinking ISR for partition [__consumer_offsets,35] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,481] INFO Partition [__consumer_offsets,35] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,481] INFO Partition [__consumer_offsets,41] on broker 72: Shrinking ISR for partition [__consumer_offsets,41] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,486] INFO Partition [__consumer_offsets,41] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,486] INFO Partition [__consumer_offsets,32] on broker 72: Shrinking ISR for partition [__consumer_offsets,32] from 72,74,73 to 72 (kafka.cluster.Partition) [2017-04-24 22:41:33,491] INFO Partition [__consumer_offsets,32] on broker 72: Cached zkVersion [60] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 22:41:33,495] INFO [ReplicaFetcherManager on broker 72] Removed fetcher for partitions test-2,__consumer_offsets-6,__consumer_offsets-32,IL2S-2,__consumer_offsets-14,__consumer_offsets-36,SEGMENT-2,__consumer_offsets-18,__consumer_offsets-0,__consumer_offsets-41,__consumer_offsets-26,__consumer_offsets-23,__consumer_offsets-45,DSLAM-0,__consumer_offsets-8,__consumer_offsets-27,DSLAM-1,__consumer_offsets-9,__consumer_offsets-12,__consumer_offsets-35,__consumer_offsets-17,__consumer_offsets-39,__consumer_offsets-21,__consumer_offsets-47,__consumer_offsets-44,__consumer_offsets-3,__consumer_offsets-29,__consumer_offsets-48,__consumer_offsets-11,__consumer_offsets-30,__consumer_offsets-33,IL2S-0,__consumer_offsets-15,SEGMENT-0,__consumer_offsets-38,__consumer_offsets-20,__consumer_offsets-42,test-1,__consumer_offsets-5,__consumer_offsets-2,__consumer_offsets-24 (kafka.server.ReplicaFetcherManager) [2017-04-24 22:41:33,496] INFO Truncating log __consumer_offsets-30 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,496] INFO Truncating log IL2S-2 to offset 2826803539. (kafka.log.Log) [2017-04-24 22:41:33,497] INFO Truncating log __consumer_offsets-8 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,497] INFO Truncating log __consumer_offsets-21 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,497] INFO Truncating log __consumer_offsets-27 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,497] INFO Truncating log __consumer_offsets-9 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,497] INFO Truncating log DSLAM-0 to offset 3096993008. (kafka.log.Log) [2017-04-24 22:41:33,497] INFO Truncating log __consumer_offsets-35 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,499] INFO Truncating log __consumer_offsets-41 to offset 684. (kafka.log.Log) [2017-04-24 22:41:33,499] INFO Truncating log __consumer_offsets-33 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,499] INFO Truncating log __consumer_offsets-23 to offset 9. (kafka.log.Log) [2017-04-24 22:41:33,499] INFO Truncating log __consumer_offsets-47 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,499] INFO Truncating log __consumer_offsets-36 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,499] INFO Truncating log __consumer_offsets-42 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,500] INFO Truncating log __consumer_offsets-3 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,500] INFO Truncating log IL2S-0 to offset 2857934184. (kafka.log.Log) [2017-04-24 22:41:33,500] INFO Truncating log __consumer_offsets-18 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,500] INFO Truncating log __consumer_offsets-15 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,500] INFO Truncating log __consumer_offsets-24 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,500] INFO Truncating log DSLAM-1 to offset 3096969440. (kafka.log.Log) [2017-04-24 22:41:33,500] INFO Truncating log __consumer_offsets-38 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,501] INFO Truncating log __consumer_offsets-17 to offset 11. (kafka.log.Log) [2017-04-24 22:41:33,501] INFO Truncating log __consumer_offsets-48 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,501] INFO Truncating log test-1 to offset 6. (kafka.log.Log) [2017-04-24 22:41:33,501] INFO Truncating log __consumer_offsets-11 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,501] INFO Truncating log SEGMENT-0 to offset 101343322. (kafka.log.Log) [2017-04-24 22:41:33,502] INFO Truncating log __consumer_offsets-2 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,502] INFO Truncating log __consumer_offsets-6 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,502] INFO Truncating log __consumer_offsets-14 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,502] INFO Truncating log SEGMENT-2 to offset 101342591. (kafka.log.Log) [2017-04-24 22:41:33,503] INFO Truncating log __consumer_offsets-20 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,504] INFO Truncating log __consumer_offsets-0 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,504] INFO Truncating log __consumer_offsets-44 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,504] INFO Truncating log __consumer_offsets-39 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,504] INFO Truncating log __consumer_offsets-12 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,504] INFO Truncating log __consumer_offsets-45 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,504] INFO Truncating log __consumer_offsets-5 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,504] INFO Truncating log __consumer_offsets-26 to offset 2. (kafka.log.Log) [2017-04-24 22:41:33,504] INFO Truncating log __consumer_offsets-29 to offset 0. (kafka.log.Log) [2017-04-24 22:41:33,504] INFO Truncating log __consumer_offsets-32 to offset 2. (kafka.log.Log) [2017-04-24 22:41:33,504] INFO Truncating log test-2 to offset 5. (kafka.log.Log) [2017-04-24 22:41:33,507] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,525] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,525] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,526] WARN Attempting to send response via channel for which there is no open connection, connection id 1 (kafka.network.Processor) [2017-04-24 22:41:33,526] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,526] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,526] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,526] WARN Attempting to send response via channel for which there is no open connection, connection id 1 (kafka.network.Processor) [2017-04-24 22:41:33,526] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,527] WARN Attempting to send response via channel for which there is no open connection, connection id 1 (kafka.network.Processor) [2017-04-24 22:41:33,527] WARN Attempting to send response via channel for which there is no open connection, connection id 1 (kafka.network.Processor) [2017-04-24 22:41:33,527] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,527] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,527] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,528] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,528] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,528] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,528] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,528] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,528] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,528] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,528] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,528] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.net: work.Processor) [2017-04-24 22:41:33,529] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,529] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,529] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,530] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,530] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,530] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,531] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,531] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,531] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,531] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,531] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,531] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,531] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,532] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,532] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,532] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,532] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,539] WARN Attempting to send response via channel for which there is no open connection, connection id 1 (kafka.network.Processor) [2017-04-24 22:41:33,539] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,539] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,539] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,540] WARN Attempting to send response via channel for which there is no open connection, connection id 1 (kafka.network.Processor) [2017-04-24 22:41:33,540] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,540] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,540] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,540] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,540] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,540] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,540] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,540] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,540] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,540] WARN Attempting to send response via channel for which there is no open connection, connection id 1 (kafka.network.Processor) [2017-04-24 22:41:33,541] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,541] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,541] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,541] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,541] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,541] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,541] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,541] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,541] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,541] WARN Attempting to send response via channel for which there is no open connection, connection id 1 (kafka.network.Processor) [2017-04-24 22:41:33,541] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 22:41:33,542] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,542] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 22:41:33,542] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,542] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 22:41:33,542] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 22:41:33,542] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.network.Processor) [2017-04-24 23:02:37,919] INFO Rolled new log segment for 'DSLAM-1' in 1 ms. (kafka.log.Log) [2017-04-24 23:03:23,164] INFO [Group Metadata Manager on Broker 72]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.Gr oupMetadataManager) [2017-04-24 23:13:23,165] INFO [Group Metadata Manager on Broker 72]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.Gr oupMetadataManager) [2017-04-24 23:15:51,745] INFO Rolled new log segment for 'DSLAM-0' in 1 ms. (kafka.log.Log) [2017-04-24 23:16:08,133] INFO Rolled new log segment for 'DSLAM-2' in 1 ms. (kafka.log.Log) [2017-04-24 23:18:52,944] INFO Scheduling log segment 2350710897 for log IL2S-0 for deletion. (kafka.log.Log) [2017-04-24 23:19:52,946] INFO Deleting segment 2350710897 from log IL2S-0. (kafka.log.Log) [2017-04-24 23:19:52,975] INFO Deleting index /npm/application/Telemetry/kafka_2.12-0.10.2.0/logs/IL2S-0/00000000002350710897.index.dele ted (kafka.log.OffsetIndex) [2017-04-24 23:19:52,977] INFO Deleting index /npm/application/Telemetry/kafka_2.12-0.10.2.0/logs/IL2S-0/00000000002350710897.timeindex. deleted (kafka.log.TimeIndex) [2017-04-24 23:23:23,164] INFO [Group Metadata Manager on Broker 72]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.Gr oupMetadataManager) [2017-04-24 23:23:52,944] INFO Scheduling log segment 2591917648 for log DSLAM-1 for deletion. (kafka.log.Log) [2017-04-24 23:23:52,945] INFO Scheduling log segment 2592043489 for log DSLAM-0 for deletion. (kafka.log.Log) [2017-04-24 23:23:52,946] INFO Scheduling log segment 2592030929 for log DSLAM-2 for deletion. (kafka.log.Log) [2017-04-24 23:24:52,945] INFO Deleting segment 2591917648 from log DSLAM-1. (kafka.log.Log) [2017-04-24 23:24:52,946] INFO Deleting segment 2592043489 from log DSLAM-0. (kafka.log.Log) [2017-04-24 23:24:52,946] INFO Deleting segment 2592030929 from log DSLAM-2. (kafka.log.Log) [2017-04-24 23:24:52,958] INFO Deleting index /npm/application/Telemetry/kafka_2.12-0.10.2.0/logs/DSLAM-2/00000000002592030929.index.del eted (kafka.log.OffsetIndex) [2017-04-24 23:24:52,959] INFO Deleting index /npm/application/Telemetry/kafka_2.12-0.10.2.0/logs/DSLAM-1/00000000002591917648.index.del eted (kafka.log.OffsetIndex) [2017-04-24 23:24:52,959] INFO Deleting index /npm/application/Telemetry/kafka_2.12-0.10.2.0/logs/DSLAM-0/00000000002592043489.index.del eted (kafka.log.OffsetIndex) [2017-04-24 23:24:52,960] INFO Deleting index /npm/application/Telemetry/kafka_2.12-0.10.2.0/logs/DSLAM-2/00000000002592030929.timeindex .deleted (kafka.log.TimeIndex) [2017-04-24 23:24:52,960] INFO Deleting index /npm/application/Telemetry/kafka_2.12-0.10.2.0/logs/DSLAM-1/00000000002591917648.timeindex .deleted (kafka.log.TimeIndex) [2017-04-24 23:24:52,960] INFO Deleting index /npm/application/Telemetry/kafka_2.12-0.10.2.0/logs/DSLAM-0/00000000002592043489.timeindex .deleted (kafka.log.TimeIndex) [2017-04-24 23:33:23,164] INFO [Group Metadata Manager on Broker 72]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager) [2017-04-24 23:43:23,164] INFO [Group Metadata Manager on Broker 72]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager) [2017-04-24 23:46:04,374] WARN [ReplicaFetcherThread-0-73], Error in fetch kafka.server.ReplicaFetcherThread$FetchRequest@59604855 (kafka.server.ReplicaFetcherThread) java.io.IOException: Connection to 73 was disconnected before the response was read at kafka.utils.NetworkClientBlockingOps$.$anonfun$blockingSendAndReceive$3(NetworkClientBlockingOps.scala:114) at kafka.utils.NetworkClientBlockingOps$.$anonfun$blockingSendAndReceive$3$adapted(NetworkClientBlockingOps.scala:112) at scala.Option.foreach(Option.scala:257) at kafka.utils.NetworkClientBlockingOps$.$anonfun$blockingSendAndReceive$1(NetworkClientBlockingOps.scala:112) at kafka.utils.NetworkClientBlockingOps$.recursivePoll$1(NetworkClientBlockingOps.scala:136) at kafka.utils.NetworkClientBlockingOps$.pollContinuously$extension(NetworkClientBlockingOps.scala:142) at kafka.utils.NetworkClientBlockingOps$.blockingSendAndReceive$extension(NetworkClientBlockingOps.scala:108) at kafka.server.ReplicaFetcherThread.sendRequest(ReplicaFetcherThread.scala:249) at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:234) at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:42) at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:118) at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:103) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63) [2017-04-24 23:46:04,375] INFO Partition [__consumer_offsets,17] on broker 72: Shrinking ISR for partition [__consumer_offsets,17] from 72,73,74 to 72 (kafka.cluster.Partition) [2017-04-24 23:46:04,375] WARN [ReplicaFetcherThread-0-74], Error in fetch kafka.server.ReplicaFetcherThread$FetchRequest@46a925e5 (kafka.server.ReplicaFetcherThread) java.io.IOException: Connection to 74 was disconnected before the response was read at kafka.utils.NetworkClientBlockingOps$.$anonfun$blockingSendAndReceive$3(NetworkClientBlockingOps.scala:114) at kafka.utils.NetworkClientBlockingOps$.$anonfun$blockingSendAndReceive$3$adapted(NetworkClientBlockingOps.scala:112) at scala.Option.foreach(Option.scala:257) at kafka.utils.NetworkClientBlockingOps$.$anonfun$blockingSendAndReceive$1(NetworkClientBlockingOps.scala:112) at kafka.utils.NetworkClientBlockingOps$.recursivePoll$1(NetworkClientBlockingOps.scala:136) at kafka.utils.NetworkClientBlockingOps$.pollContinuously$extension(NetworkClientBlockingOps.scala:142) at kafka.utils.NetworkClientBlockingOps$.blockingSendAndReceive$extension(NetworkClientBlockingOps.scala:108) at kafka.server.ReplicaFetcherThread.sendRequest(ReplicaFetcherThread.scala:249) at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:234) at kafka.server.ReplicaFetcherThread.fetch(ReplicaFetcherThread.scala:42) at kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:118) at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:103) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63) [2017-04-24 23:46:04,439] WARN Attempting to send response via channel for which there is no open connection, connection id 4 (kafka.network.Processor) [2017-04-24 23:46:04,465] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 23:46:04,494] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 23:46:04,494] WARN Attempting to send response via channel for which there is no open connection, connection id 0 (kafka.network.Processor) [2017-04-24 23:46:04,510] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 23:46:05,048] INFO Partition [__consumer_offsets,17] on broker 72: Cached zkVersion [66] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,048] INFO Partition [__consumer_offsets,26] on broker 72: Shrinking ISR for partition [__consumer_offsets,26] from 72,73,74 to 72,74 (kafka.cluster.Partition) [2017-04-24 23:46:05,052] INFO re-registering broker info in ZK for broker 72 (kafka.server.KafkaHealthcheck$SessionExpireListener) [2017-04-24 23:46:05,052] INFO Creating /brokers/ids/72 (is it secure? false) (kafka.utils.ZKCheckedEphemeral) [2017-04-24 23:46:05,053] INFO Partition [__consumer_offsets,26] on broker 72: Cached zkVersion [66] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,053] INFO Partition [__consumer_offsets,5] on broker 72: Shrinking ISR for partition [__consumer_offsets,5] from 72,73,74 to 72,74 (kafka.cluster.Partition) [2017-04-24 23:46:05,055] INFO Result of znode creation is: OK (kafka.utils.ZKCheckedEphemeral) [2017-04-24 23:46:05,055] INFO Registered broker 72 at path /brokers/ids/72 with addresses: EndPoint(10.52.208.72,9092,ListenerName(PLAINTEXT),PLAINTEXT) (kafka.utils.ZkUtils) [2017-04-24 23:46:05,055] INFO done re-registering broker (kafka.server.KafkaHealthcheck$SessionExpireListener) [2017-04-24 23:46:05,055] INFO Subscribing to /brokers/topics path to watch for new topics (kafka.server.KafkaHealthcheck$SessionExpireListener) [2017-04-24 23:46:05,058] INFO Partition [__consumer_offsets,5] on broker 72: Cached zkVersion [66] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,058] INFO Partition [__consumer_offsets,38] on broker 72: Shrinking ISR for partition [__consumer_offsets,38] from 72,73,74 to 72,74 (kafka.cluster.Partition) [2017-04-24 23:46:05,062] INFO Partition [__consumer_offsets,38] on broker 72: Cached zkVersion [66] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,063] INFO Partition [__consumer_offsets,41] on broker 72: Shrinking ISR for partition [__consumer_offsets,41] from 72,73,74 to 72,74 (kafka.cluster.Partition) [2017-04-24 23:46:05,066] INFO Partition [__consumer_offsets,41] on broker 72: Cached zkVersion [66] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,066] INFO Partition [__consumer_offsets,20] on broker 72: Shrinking ISR for partition [__consumer_offsets,20] from 72,73,74 to 72,74 (kafka.cluster.Partition) [2017-04-24 23:46:05,070] INFO Partition [__consumer_offsets,20] on broker 72: Cached zkVersion [66] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,070] INFO Partition [DSLAM,0] on broker 72: Shrinking ISR for partition [DSLAM,0] from 72,73,74 to 72 (kafka.cluster.Partition) [2017-04-24 23:46:05,071] INFO New leader is 73 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener) [2017-04-24 23:46:05,074] INFO Partition [DSLAM,0] on broker 72: Cached zkVersion [48] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,074] INFO Partition [__consumer_offsets,29] on broker 72: Shrinking ISR for partition [__consumer_offsets,29] from 72,73,74 to 72,74 (kafka.cluster.Partition) [2017-04-24 23:46:05,078] INFO Partition [__consumer_offsets,29] on broker 72: Cached zkVersion [66] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,078] INFO Partition [__consumer_offsets,8] on broker 72: Shrinking ISR for partition [__consumer_offsets,8] from 72,73,74 to 72,74 (kafka.cluster.Partition) [2017-04-24 23:46:05,081] INFO Partition [__consumer_offsets,8] on broker 72: Cached zkVersion [66] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,081] INFO Partition [test,1] on broker 72: Shrinking ISR for partition [test,1] from 72,73,74 to 72,74 (kafka.cluster.Partition) [2017-04-24 23:46:05,086] INFO Partition [test,1] on broker 72: Cached zkVersion [66] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,086] INFO Partition [__consumer_offsets,44] on broker 72: Shrinking ISR for partition [__consumer_offsets,44] from 72,73,74 to 72,74 (kafka.cluster.Partition) [2017-04-24 23:46:05,090] INFO Partition [__consumer_offsets,44] on broker 72: Cached zkVersion [66] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,090] INFO Partition [__consumer_offsets,32] on broker 72: Shrinking ISR for partition [__consumer_offsets,32] from 72,73,74 to 72,74 (kafka.cluster.Partition) [2017-04-24 23:46:05,094] INFO Partition [__consumer_offsets,32] on broker 72: Cached zkVersion [66] not equal to that in zookeeper, skip updating ISR (kafka.cluster.Partition) [2017-04-24 23:46:05,095] INFO [ReplicaFetcherManager on broker 72] Removed fetcher for partitions __consumer_offsets-17,__consumer_offsets-32,IL2S-2,__consumer_offsets-14,__consumer_offsets-44,__consumer_offsets-47,SEGMENT-2,__consumer_offsets-29,__consumer_offsets-11,__consumer_offsets-41,__consumer_offsets-26,__consumer_offsets-23,DSLAM-0,__consumer_offsets-8,__consumer_offsets-38,__consumer_offsets-20,test-1,__consumer_offsets-5,__consumer_offsets-2,__consumer_offsets-35 (kafka.server.ReplicaFetcherManager) [2017-04-24 23:46:05,095] INFO Truncating log IL2S-2 to offset 2836802018. (kafka.log.Log) [2017-04-24 23:46:05,098] INFO Truncating log __consumer_offsets-8 to offset 0. (kafka.log.Log) [2017-04-24 23:46:05,098] INFO Truncating log DSLAM-0 to offset 3107432827. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log __consumer_offsets-35 to offset 0. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log __consumer_offsets-41 to offset 684. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log __consumer_offsets-23 to offset 9. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log __consumer_offsets-47 to offset 0. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log __consumer_offsets-38 to offset 0. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log __consumer_offsets-17 to offset 11. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log test-1 to offset 6. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log __consumer_offsets-11 to offset 0. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log __consumer_offsets-2 to offset 0. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log __consumer_offsets-14 to offset 0. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log SEGMENT-2 to offset 102363057. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log __consumer_offsets-20 to offset 0. (kafka.log.Log) [2017-04-24 23:46:05,101] INFO Truncating log __consumer_offsets-44 to offset 0. (kafka.log.Log) [2017-04-24 23:46:05,102] INFO Truncating log __consumer_offsets-5 to offset 0. (kafka.log.Log) [2017-04-24 23:46:05,102] INFO Truncating log __consumer_offsets-26 to offset 2. (kafka.log.Log) [2017-04-24 23:46:05,102] INFO Truncating log __consumer_offsets-29 to offset 0. (kafka.log.Log) [2017-04-24 23:46:05,102] INFO Truncating log __consumer_offsets-32 to offset 2. (kafka.log.Log) [2017-04-24 23:46:05,116] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 23:46:05,118] WARN Attempting to send response via channel for which there is no open connection, connection id 3 (kafka.network.Processor) [2017-04-24 23:46:05,118] WARN Attempting to send response via channel for which there is no open connection, connection id 2 (kafka.net