[2014-11-05 12:35:43,236] DEBUG Got notification sessionid:0x149811c1e860006 (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,236] DEBUG Got WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/topics for sessionid 0x149811c1e860006 (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,236] DEBUG Received event: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/topics (org.I0Itec.zkclient.ZkClient) [2014-11-05 12:35:43,237] DEBUG New event: ZkEvent[Children of /brokers/topics changed sent to kafka.controller.PartitionStateMachine$TopicChangeListener@43b38ff1] (org.I0Itec.zkclient.ZkEventThread) [2014-11-05 12:35:43,237] DEBUG Leaving process event (org.I0Itec.zkclient.ZkClient) [2014-11-05 12:35:43,237] DEBUG Delivering event #3 ZkEvent[Children of /brokers/topics changed sent to kafka.controller.PartitionStateMachine$TopicChangeListener@43b38ff1] (org.I0Itec.zkclient.ZkEventThread) [2014-11-05 12:35:43,237] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 387,3 replyHeader:: 387,13976,0 request:: '/brokers/topics,T response:: s{6,6,1415130748279,1415130748279,0,36,0,0,0,36,13976} (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,238] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 388,8 replyHeader:: 388,13976,0 request:: '/brokers/topics,T response:: v{'topic_23,'topic_22,'topic_25,'topic_24,'topic_5,'topic_7,'topic_60,'topic_6,'topic_9,'topic_8,'topic_20,'topic_21,'topic_36,'topic_18,'topic_35,'topic_17,'topic_34,'topic_16,'topic_33,'topic_15,'topic_14,'topic_13,'topic_38,'topic_12,'topic_37,'topic_11,'topic_19,'topic_53,'topic_52,'topic_51,'topic_50,'Test1,'topic_10,'topic_31,'topic_32,'topic_30} (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,242] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 389,4 replyHeader:: 389,13976,0 request:: '/brokers/topics/topic_60,F response:: #7b2276657273696f6e223a312c22706172746974696f6e73223a7b2230223a5b305d7d7d,s{13976,13976,1415212543235,1415212543235,0,0,0,0,36,0,13976} (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,243] DEBUG Replicas assigned to topic [topic_60], partition [0] are [List(0)] (kafka.utils.ZkUtils$) [2014-11-05 12:35:43,243] DEBUG Replicas assigned to topic [topic_60], partition [0] are [List(0)] (kafka.utils.ZkUtils$) [2014-11-05 12:35:43,246] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 390,3 replyHeader:: 390,13976,0 request:: '/brokers/topics/topic_60,T response:: s{13976,13976,1415212543235,1415212543235,0,0,0,0,36,0,13976} (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,246] DEBUG Subscribed data changes for /brokers/topics/topic_60 (org.I0Itec.zkclient.ZkClient) [2014-11-05 12:35:43,248] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 391,4 replyHeader:: 391,13976,0 request:: '/brokers/topics/topic_60,T response:: #7b2276657273696f6e223a312c22706172746974696f6e73223a7b2230223a5b305d7d7d,s{13976,13976,1415212543235,1415212543235,0,0,0,0,36,0,13976} (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,252] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 392,4 replyHeader:: 392,13977,-101 request:: '/brokers/topics/topic_60/partitions/0/state,F response:: (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,256] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 393,1 replyHeader:: 393,13978,-101 request:: '/brokers/topics/topic_60/partitions/0/state,#7b22636f6e74726f6c6c65725f65706f6368223a31302c226c6561646572223a302c2276657273696f6e223a312c226c65616465725f65706f6368223a302c22697372223a5b305d7d,v{s{31,s{'world,'anyone}}},0 response:: (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,257] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 394,1 replyHeader:: 394,13979,-101 request:: '/brokers/topics/topic_60/partitions/0,,v{s{31,s{'world,'anyone}}},0 response:: (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,259] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 395,1 replyHeader:: 395,13980,0 request:: '/brokers/topics/topic_60/partitions,,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics/topic_60/partitions (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,259] TRACE Begining execution of scheduled task 'highwatermark-checkpoint'. (kafka.utils.KafkaScheduler) [2014-11-05 12:35:43,259] TRACE Begining execution of scheduled task 'highwatermark-checkpoint'. (kafka.utils.KafkaScheduler) [2014-11-05 12:35:43,262] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 396,1 replyHeader:: 396,13981,0 request:: '/brokers/topics/topic_60/partitions/0,,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics/topic_60/partitions/0 (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,264] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 397,1 replyHeader:: 397,13982,0 request:: '/brokers/topics/topic_60/partitions/0/state,#7b22636f6e74726f6c6c65725f65706f6368223a31302c226c6561646572223a302c2276657273696f6e223a312c226c65616465725f65706f6368223a302c22697372223a5b305d7d,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics/topic_60/partitions/0/state (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,264] TRACE 130 bytes written. (kafka.network.BoundedByteBufferSend) [2014-11-05 12:35:43,264] TRACE 130 bytes written. (kafka.network.BoundedByteBufferSend) [2014-11-05 12:35:43,264] TRACE Processor id 0 selection time = 108080961 ns (kafka.network.Processor) [2014-11-05 12:35:43,264] TRACE Processor id 0 selection time = 108080961 ns (kafka.network.Processor) [2014-11-05 12:35:43,265] TRACE 126 bytes read from /10.192.1.120:43925 (kafka.network.Processor) [2014-11-05 12:35:43,265] TRACE 126 bytes read from /10.192.1.120:43925 (kafka.network.Processor) [2014-11-05 12:35:43,265] TRACE [Kafka Request Handler 5 on Broker 0], Kafka request handler 5 on broker 0 handling request Request(0,sun.nio.ch.SelectionKeyImpl@a485d22,null,1415212543265,/10.192.1.120:43925) (kafka.server.KafkaRequestHandler) [2014-11-05 12:35:43,265] TRACE [Kafka Request Handler 5 on Broker 0], Kafka request handler 5 on broker 0 handling request Request(0,sun.nio.ch.SelectionKeyImpl@a485d22,null,1415212543265,/10.192.1.120:43925) (kafka.server.KafkaRequestHandler) [2014-11-05 12:35:43,265] TRACE [KafkaApi-0] Handling request: Name:LeaderAndIsrRequest;Version:0;Controller:0;ControllerEpoch:10;CorrelationId:8;ClientId:id_0-host_10.192.1.120-port_9092;Leaders:id:0,host:10.192.1.120,port:9092;PartitionState:(topic_60,0) -> (LeaderAndIsrInfo:(Leader:0,ISR:0,LeaderEpoch:0,ControllerEpoch:10),ReplicationFactor:1),AllReplicas:0) from client: /10.192.1.120:43925 (kafka.server.KafkaApis) [2014-11-05 12:35:43,265] TRACE [KafkaApi-0] Handling request: Name:LeaderAndIsrRequest;Version:0;Controller:0;ControllerEpoch:10;CorrelationId:8;ClientId:id_0-host_10.192.1.120-port_9092;Leaders:id:0,host:10.192.1.120,port:9092;PartitionState:(topic_60,0) -> (LeaderAndIsrInfo:(Leader:0,ISR:0,LeaderEpoch:0,ControllerEpoch:10),ReplicationFactor:1),AllReplicas:0) from client: /10.192.1.120:43925 (kafka.server.KafkaApis) [2014-11-05 12:35:43,266] DEBUG Delivering event #3 done (org.I0Itec.zkclient.ZkEventThread) [2014-11-05 12:35:43,266] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [topic_60,0] (kafka.server.ReplicaFetcherManager) [2014-11-05 12:35:43,266] INFO [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [topic_60,0] (kafka.server.ReplicaFetcherManager) [2014-11-05 12:35:43,267] DEBUG Reading reply sessionid:0x149811c1e860006, packet:: clientPath:null serverPath:null finished:false header:: 398,4 replyHeader:: 398,13982,0 request:: '/config/topics/topic_60,F response:: #7b2276657273696f6e223a312c22636f6e666967223a7b7d7d,s{13975,13975,1415212543230,1415212543230,0,0,0,0,25,0,13975} (org.apache.zookeeper.ClientCnxn) [2014-11-05 12:35:43,275] TRACE Completed execution of scheduled task 'highwatermark-checkpoint'. (kafka.utils.KafkaScheduler) [2014-11-05 12:35:43,275] TRACE Completed execution of scheduled task 'highwatermark-checkpoint'. (kafka.utils.KafkaScheduler) [2014-11-05 12:35:43,275] DEBUG Loaded index file /data/dmip/kafka/topic_60-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2014-11-05 12:35:43,275] DEBUG Loaded index file /data/dmip/kafka/topic_60-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2014-11-05 12:35:43,275] INFO Completed load of log topic_60-0 with log end offset 0 (kafka.log.Log) [2014-11-05 12:35:43,275] INFO Completed load of log topic_60-0 with log end offset 0 (kafka.log.Log) [2014-11-05 12:35:43,281] INFO Created log for partition [topic_60,0] in /data/dmip/kafka with properties {segment.index.bytes -> 10485760, file.delete.delay.ms -> 60000, segment.bytes -> 1073741824, flush.ms -> 9223372036854775807, delete.retention.ms -> 86400000, index.interval.bytes -> 4096, retention.bytes -> -1, min.insync.replicas -> 1, cleanup.policy -> delete, unclean.leader.election.enable -> true, segment.ms -> 604800000, max.message.bytes -> 1000012, flush.messages -> 9223372036854775807, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 7200000, segment.jitter.ms -> 0}. (kafka.log.LogManager) [2014-11-05 12:35:43,281] INFO Created log for partition [topic_60,0] in /data/dmip/kafka with properties {segment.index.bytes -> 10485760, file.delete.delay.ms -> 60000, segment.bytes -> 1073741824, flush.ms -> 9223372036854775807, delete.retention.ms -> 86400000, index.interval.bytes -> 4096, retention.bytes -> -1, min.insync.replicas -> 1, cleanup.policy -> delete, unclean.leader.election.enable -> true, segment.ms -> 604800000, max.message.bytes -> 1000012, flush.messages -> 9223372036854775807, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 7200000, segment.jitter.ms -> 0}. (kafka.log.LogManager) [2014-11-05 12:35:43,282] WARN Partition [topic_60,0] on broker 0: No checkpointed highwatermark is found for partition [topic_60,0] (kafka.cluster.Partition) [2014-11-05 12:35:43,282] WARN Partition [topic_60,0] on broker 0: No checkpointed highwatermark is found for partition [topic_60,0] (kafka.cluster.Partition) [2014-11-05 12:35:43,282] TRACE Reading 1 bytes from offset 0 in log topic_60-0 of length 0 bytes (kafka.log.Log) [2014-11-05 12:35:43,282] TRACE Reading 1 bytes from offset 0 in log topic_60-0 of length 0 bytes (kafka.log.Log) [2014-11-05 12:35:43,283] DEBUG Partition [topic_60,0] on broker 0: Skipping update high watermark since Old hw 0 [0 : 0] is larger than new hw 0 [0 : 0] for partition [topic_60,0]. All leo's are 0 [0 : 0] (kafka.cluster.Partition) [2014-11-05 12:35:43,283] DEBUG Partition [topic_60,0] on broker 0: Skipping update high watermark since Old hw 0 [0 : 0] is larger than new hw 0 [0 : 0] for partition [topic_60,0]. All leo's are 0 [0 : 0] (kafka.cluster.Partition) [2014-11-05 12:35:43,283] TRACE Processor id 0 selection time = 17882816 ns (kafka.network.Processor) [2014-11-05 12:35:43,283] TRACE Processor id 0 selection time = 17882816 ns (kafka.network.Processor) [2014-11-05 12:35:43,283] TRACE Socket server received response to send, registering for write: Response(0,Request(0,sun.nio.ch.SelectionKeyImpl@a485d22,null,1415212543265,/10.192.1.120:43925),kafka.network.BoundedByteBufferSend@56c1ec95,SendAction) (kafka.network.Processor) [2014-11-05 12:35:43,283] TRACE Socket server received response to send, registering for write: Response(0,Request(0,sun.nio.ch.SelectionKeyImpl@a485d22,null,1415212543265,/10.192.1.120:43925),kafka.network.BoundedByteBufferSend@56c1ec95,SendAction) (kafka.network.Processor) [2014-11-05 12:35:43,283] TRACE Processor id 0 selection time = 24525 ns (kafka.network.Processor) [2014-11-05 12:35:43,283] TRACE Processor id 0 selection time = 24525 ns (kafka.network.Processor) [2014-11-05 12:35:43,283] TRACE 30 bytes written to /10.192.1.120:43925 using key sun.nio.ch.SelectionKeyImpl@a485d22 (kafka.network.Processor) [2014-11-05 12:35:43,283] TRACE 30 bytes written to /10.192.1.120:43925 using key sun.nio.ch.SelectionKeyImpl@a485d22 (kafka.network.Processor) [2014-11-05 12:35:43,283] TRACE 26 bytes read. (kafka.network.BoundedByteBufferReceive) [2014-11-05 12:35:43,283] TRACE 26 bytes read. (kafka.network.BoundedByteBufferReceive) [2014-11-05 12:35:43,284] TRACE Finished writing, registering for read on connection /10.192.1.120:43925 (kafka.network.Processor) [2014-11-05 12:35:43,284] TRACE Finished writing, registering for read on connection /10.192.1.120:43925 (kafka.network.Processor) [2014-11-05 12:35:43,284] TRACE 175 bytes written. (kafka.network.BoundedByteBufferSend) [2014-11-05 12:35:43,284] TRACE 175 bytes written. (kafka.network.BoundedByteBufferSend) [2014-11-05 12:35:43,284] TRACE Processor id 0 selection time = 167570 ns (kafka.network.Processor) [2014-11-05 12:35:43,284] TRACE Processor id 0 selection time = 167570 ns (kafka.network.Processor) [2014-11-05 12:35:43,284] TRACE 171 bytes read from /10.192.1.120:43925 (kafka.network.Processor) [2014-11-05 12:35:43,284] TRACE 171 bytes read from /10.192.1.120:43925 (kafka.network.Processor) [2014-11-05 12:35:43,285] TRACE [Kafka Request Handler 2 on Broker 0], Kafka request handler 2 on broker 0 handling request Request(0,sun.nio.ch.SelectionKeyImpl@a485d22,null,1415212543284,/10.192.1.120:43925) (kafka.server.KafkaRequestHandler) [2014-11-05 12:35:43,285] TRACE [Kafka Request Handler 2 on Broker 0], Kafka request handler 2 on broker 0 handling request Request(0,sun.nio.ch.SelectionKeyImpl@a485d22,null,1415212543284,/10.192.1.120:43925) (kafka.server.KafkaRequestHandler) [2014-11-05 12:35:43,285] TRACE [KafkaApi-0] Handling request: Name:UpdateMetadataRequest;Version:0;Controller:0;ControllerEpoch:10;CorrelationId:8;ClientId:id_0-host_10.192.1.120-port_9092;AliveBrokers:id:0,host:10.192.1.120,port:9092;PartitionState:[topic_60,0] -> (LeaderAndIsrInfo:(Leader:0,ISR:0,LeaderEpoch:0,ControllerEpoch:10),ReplicationFactor:1),AllReplicas:0),[topic_5,0] -> (LeaderAndIsrInfo:(Leader:-2,ISR:0,LeaderEpoch:0,ControllerEpoch:10),ReplicationFactor:1),AllReplicas:0) from client: /10.192.1.120:43925 (kafka.server.KafkaApis) [2014-11-05 12:35:43,285] TRACE [KafkaApi-0] Handling request: Name:UpdateMetadataRequest;Version:0;Controller:0;ControllerEpoch:10;CorrelationId:8;ClientId:id_0-host_10.192.1.120-port_9092;AliveBrokers:id:0,host:10.192.1.120,port:9092;PartitionState:[topic_60,0] -> (LeaderAndIsrInfo:(Leader:0,ISR:0,LeaderEpoch:0,ControllerEpoch:10),ReplicationFactor:1),AllReplicas:0),[topic_5,0] -> (LeaderAndIsrInfo:(Leader:-2,ISR:0,LeaderEpoch:0,ControllerEpoch:10),ReplicationFactor:1),AllReplicas:0) from client: /10.192.1.120:43925 (kafka.server.KafkaApis) [2014-11-05 12:35:43,285] TRACE Processor id 0 selection time = 570359 ns (kafka.network.Processor) [2014-11-05 12:35:43,285] TRACE Processor id 0 selection time = 570359 ns (kafka.network.Processor) [2014-11-05 12:35:43,285] TRACE Socket server received response to send, registering for write: Response(0,Request(0,sun.nio.ch.SelectionKeyImpl@a485d22,null,1415212543284,/10.192.1.120:43925),kafka.network.BoundedByteBufferSend@20b621d,SendAction) (kafka.network.Processor) [2014-11-05 12:35:43,285] TRACE Socket server received response to send, registering for write: Response(0,Request(0,sun.nio.ch.SelectionKeyImpl@a485d22,null,1415212543284,/10.192.1.120:43925),kafka.network.BoundedByteBufferSend@20b621d,SendAction) (kafka.network.Processor) [2014-11-05 12:35:43,285] TRACE Processor id 0 selection time = 17213 ns (kafka.network.Processor) [2014-11-05 12:35:43,285] TRACE Processor id 0 selection time = 17213 ns (kafka.network.Processor) [2014-11-05 12:35:43,286] TRACE 10 bytes written to /10.192.1.120:43925 using key sun.nio.ch.SelectionKeyImpl@a485d22 (kafka.network.Processor) [2014-11-05 12:35:43,286] TRACE 10 bytes written to /10.192.1.120:43925 using key sun.nio.ch.SelectionKeyImpl@a485d22 (kafka.network.Processor) [2014-11-05 12:35:43,286] TRACE 6 bytes read. (kafka.network.BoundedByteBufferReceive) [2014-11-05 12:35:43,286] TRACE 6 bytes read. (kafka.network.BoundedByteBufferReceive) [2014-11-05 12:35:43,286] TRACE Finished writing, registering for read on connection /10.192.1.120:43925 (kafka.network.Processor) [2014-11-05 12:35:43,286] TRACE Finished writing, registering for read on connection /10.192.1.120:43925 (kafka.network.Processor) [2014-11-05 12:35:43,286] TRACE Processor id 7 selection time = 300241622 ns (kafka.network.Processor) [2014-11-05 12:35