[2013-01-08 16:44:51,975] INFO [Kafka Server 0], starting (kafka.server.KafkaServer) [2013-01-08 16:44:51,978] DEBUG Initializing task scheduler. (kafka.utils.KafkaScheduler) [2013-01-08 16:44:52,013] TRACE Acquiring lock on /tmp/kafka-logs/.lock (kafka.utils.FileLock) [2013-01-08 16:44:52,018] INFO [Log Manager on Broker 0] Loading log 'test-0' (kafka.log.LogManager) [2013-01-08 16:44:52,070] INFO [Log Manager on Broker 0] Starting log cleanup with a period of 60000 ms. (kafka.log.LogManager) [2013-01-08 16:44:52,071] DEBUG Scheduling task kafka-log-cleaner with initial delay 30000 ms and period 60000 ms. (kafka.utils.KafkaScheduler) [2013-01-08 16:44:52,076] INFO [Log Manager on Broker 0] Starting log flusher with a default period of 1000 ms with the following overrides: . (kafka.log.LogManager) [2013-01-08 16:44:52,076] DEBUG Scheduling task kafka-log-flusher with initial delay 30000 ms and period 1000 ms. (kafka.utils.KafkaScheduler) [2013-01-08 16:44:52,101] INFO Awaiting socket connections on 0.0.0.0:9092. (kafka.network.Acceptor) [2013-01-08 16:44:52,102] INFO [Socket Server on Broker 0], started (kafka.network.SocketServer) [2013-01-08 16:44:52,108] INFO connecting to ZK: localhost:2181 (kafka.server.KafkaZooKeeper) [2013-01-08 16:44:52,115] DEBUG Creating new ZookKeeper instance to connect to localhost:2181. (org.I0Itec.zkclient.ZkConnection) [2013-01-08 16:44:52,115] INFO Starting ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread) [2013-01-08 16:44:52,123] INFO Client environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 GMT (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:host.name=192.168.2.1 (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:java.version=1.6.0_37 (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:java.vendor=Apple Inc. (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:java.home=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:java.class.path=:./bin/../project/boot/scala-2.8.0/lib/scala-compiler.jar:./bin/../project/boot/scala-2.8.0/lib/scala-library.jar:./bin/../core/target/scala_2.8.0/core-kafka_2.8.0-0.8.0-SNAPSHOT-test.jar:./bin/../core/target/scala_2.8.0/core-kafka_2.8.0-0.8.0-SNAPSHOT.jar:./bin/../core/lib/metrics-annotation-3.0.0-c0c8be71.jar:./bin/../core/lib/metrics-core-3.0.0-c0c8be71.jar:./bin/../core/lib/zkclient-20120522.jar:./bin/../perf/target/scala_2.8.0/kafka-perf-0.8.0-SNAPSHOT.jar:./bin/../core/lib_managed/scala_2.8.0/compile/jopt-simple-3.2.jar:./bin/../core/lib_managed/scala_2.8.0/compile/log4j-1.2.15.jar:./bin/../core/lib_managed/scala_2.8.0/compile/slf4j-api-1.6.4.jar:./bin/../core/lib_managed/scala_2.8.0/compile/slf4j-simple-1.6.4.jar:./bin/../core/lib_managed/scala_2.8.0/compile/snappy-java-1.0.4.1.jar:./bin/../core/lib_managed/scala_2.8.0/compile/zookeeper-3.3.4.jar (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:java.library.path=.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:java.io.tmpdir=/var/folders/zp/dcgys8fs05v47cwdbg90dwsw0000gn/T/ (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:java.compiler= (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:os.name=Mac OS X (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:os.arch=x86_64 (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:os.version=10.7.5 (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:user.name=mumrah (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:user.home=/Users/mumrah (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,123] INFO Client environment:user.dir=/Users/mumrah/Code/apache/kafka (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,124] INFO Initiating client connection, connectString=localhost:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@2ce99681 (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:44:52,126] DEBUG zookeeper.disableAutoWatchReset is false (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,132] DEBUG Awaiting connection to Zookeeper server (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,133] INFO Opening socket connection to server localhost/fe80:0:0:0:0:0:0:1%1:2181 (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,133] DEBUG Waiting for keeper state SyncConnected (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,137] INFO Socket connection established to localhost/fe80:0:0:0:0:0:0:1%1:2181, initiating session (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,139] DEBUG Session establishment request sent on localhost/fe80:0:0:0:0:0:0:1%1:2181 (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,144] INFO Session establishment complete on server localhost/fe80:0:0:0:0:0:0:1%1:2181, sessionid = 0x13c15a1d848002e, negotiated timeout = 6000 (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,146] DEBUG Received event: WatchedEvent state:SyncConnected type:None path:null (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,146] INFO zookeeper state changed (SyncConnected) (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,146] DEBUG Leaving process event (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,146] DEBUG State is SyncConnected (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,156] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 1,1 replyHeader:: 1,280,0 request:: '/brokers/ids/0,#3139322e3136382e322e313a393039323a39393939,v{s{31,s{'world,'anyone}}},1 response:: '/brokers/ids/0 (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,157] INFO Registered broker 0 at path /brokers/ids/0 with address 192.168.2.1:9092. (kafka.utils.ZkUtils$) [2013-01-08 16:44:52,158] INFO [Kafka Server 0], Connecting to ZK: localhost:2181 (kafka.server.KafkaServer) [2013-01-08 16:44:52,200] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 2,3 replyHeader:: 2,280,0 request:: '/controllerEpoch,F response:: s{241,277,1357679976045,1357681481854,6,0,0,0,1,0,241} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,203] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 3,4 replyHeader:: 3,280,0 request:: '/controllerEpoch,F response:: #37,s{241,277,1357679976045,1357681481854,6,0,0,0,1,0,241} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,207] INFO [ControllerEpochListener on 0]: Initialized controller epoch to 7 and zk version 6 (kafka.controller.ControllerEpochListener) [2013-01-08 16:44:52,209] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 4,3 replyHeader:: 4,280,0 request:: '/controllerEpoch,T response:: s{241,277,1357679976045,1357681481854,6,0,0,0,1,0,241} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,209] DEBUG Subscribed data changes for /controllerEpoch (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,243] DEBUG Will try to load MX4j now, if it's in the classpath (kafka.utils.Mx4jLoader$) [2013-01-08 16:44:52,243] INFO Will not load MX4J, mx4j-tools.jar is not in the classpath (kafka.utils.Mx4jLoader$) [2013-01-08 16:44:52,244] DEBUG Scheduling task isr-expiration with initial delay 0 ms and period 10000 ms. (kafka.utils.KafkaScheduler) [2013-01-08 16:44:52,244] INFO [Controller 0]: Controller starting up (kafka.controller.KafkaController) [2013-01-08 16:44:52,245] TRACE Begining execution of scheduled task 'isr-expiration'. (kafka.utils.KafkaScheduler) [2013-01-08 16:44:52,245] TRACE Replica Manager on Broker 0: Evaluating ISR list of partitions to see which replicas can be removed from the ISR (kafka.server.ReplicaManager) [2013-01-08 16:44:52,246] TRACE Completed execution of scheduled task 'isr-expiration'. (kafka.utils.KafkaScheduler) [2013-01-08 16:44:52,246] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 5,3 replyHeader:: 5,280,-101 request:: '/controller,T response:: (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,248] DEBUG Subscribed data changes for /controller (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,271] DEBUG Got notification sessionid:0x13c15a1d848002e (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,272] DEBUG Got WatchedEvent state:SyncConnected type:NodeCreated path:/controller for sessionid 0x13c15a1d848002e (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,272] DEBUG Received event: WatchedEvent state:SyncConnected type:NodeCreated path:/controller (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,272] DEBUG New event: ZkEvent[Data of /controller changed sent to kafka.server.ZookeeperLeaderElector$LeaderChangeListener@21ed5459] (org.I0Itec.zkclient.ZkEventThread) [2013-01-08 16:44:52,272] DEBUG Leaving process event (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,272] DEBUG Delivering event #1 ZkEvent[Data of /controller changed sent to kafka.server.ZookeeperLeaderElector$LeaderChangeListener@21ed5459] (org.I0Itec.zkclient.ZkEventThread) [2013-01-08 16:44:52,272] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 6,1 replyHeader:: 6,281,0 request:: '/controller,#30,v{s{31,s{'world,'anyone}}},1 response:: '/controller (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,273] INFO 0 successfully elected as leader (kafka.server.ZookeeperLeaderElector) [2013-01-08 16:44:52,274] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 7,3 replyHeader:: 7,281,0 request:: '/controller,T response:: s{281,281,1357681492248,1357681492248,0,0,0,88969877503082542,1,0,281} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,274] INFO [Controller 0]: Broker 0 starting become controller state transition (kafka.controller.KafkaController) [2013-01-08 16:44:52,276] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 8,4 replyHeader:: 8,281,0 request:: '/controller,T response:: #30,s{281,281,1357681492248,1357681492248,0,0,0,88969877503082542,1,0,281} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,276] DEBUG Got notification sessionid:0x13c15a1d848002e (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,277] DEBUG Got WatchedEvent state:SyncConnected type:NodeDataChanged path:/controllerEpoch for sessionid 0x13c15a1d848002e (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,277] DEBUG Received event: WatchedEvent state:SyncConnected type:NodeDataChanged path:/controllerEpoch (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,277] DEBUG New event: ZkEvent[Data of /controllerEpoch changed sent to kafka.controller.ControllerEpochListener@58c16b18] (org.I0Itec.zkclient.ZkEventThread) [2013-01-08 16:44:52,277] DEBUG Leaving process event (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,278] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 9,5 replyHeader:: 9,282,0 request:: '/controllerEpoch,#38,6 response:: s{241,282,1357679976045,1357681492276,7,0,0,0,1,0,241} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,279] INFO Conditional update of zkPath /controllerEpoch with value 8 and expected version 6 succeeded, returning the new version: 7 (kafka.utils.ZkUtils$) [2013-01-08 16:44:52,280] INFO [Controller 0]: Controller 0 incremented epoch to 8 (kafka.controller.KafkaController) [2013-01-08 16:44:52,283] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 10,3 replyHeader:: 10,282,-101 request:: '/admin/reassign_partitions,T response:: (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,283] DEBUG Subscribed data changes for /admin/reassign_partitions (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,286] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 11,3 replyHeader:: 11,282,-101 request:: '/admin/preferred_replica_election,T response:: (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,286] DEBUG Subscribed data changes for /admin/preferred_replica_election (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:44:52,289] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 12,3 replyHeader:: 12,282,0 request:: '/brokers/topics,T response:: s{109,109,1357572678516,1357572678516,0,1,0,0,0,1,267} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,292] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 13,8 replyHeader:: 13,282,0 request:: '/brokers/topics,T response:: v{'test} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,294] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 14,3 replyHeader:: 14,282,0 request:: '/brokers/ids,T response:: s{237,237,1357679975905,1357679975905,0,15,0,0,0,1,280} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,294] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 15,8 replyHeader:: 15,282,0 request:: '/brokers/ids,T response:: v{'0} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,297] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 16,8 replyHeader:: 16,282,0 request:: '/brokers/ids,T response:: v{'0} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,308] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 17,4 replyHeader:: 17,282,0 request:: '/brokers/ids/0,F response:: #3139322e3136382e322e313a393039323a39393939,s{280,280,1357681492154,1357681492154,0,0,0,88969877503082542,21,0,280} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,311] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 18,8 replyHeader:: 18,282,0 request:: '/brokers/topics,T response:: v{'test} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,313] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 19,4 replyHeader:: 19,282,0 request:: '/brokers/topics/test,F response:: #7b202230223a205b2230225d207d,s{267,267,1357681028842,1357681028842,0,1,0,0,14,1,270} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,387] DEBUG Replicas assigned to topic [test], partition [0] are [List(0)] (kafka.utils.ZkUtils$) [2013-01-08 16:44:52,389] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 20,4 replyHeader:: 20,282,0 request:: '/brokers/topics/test,F response:: #7b202230223a205b2230225d207d,s{267,267,1357681028842,1357681028842,0,1,0,0,14,1,270} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,397] DEBUG Partition map for /brokers/topics/test is Map(0 -> List(0)) (kafka.utils.ZkUtils$) [2013-01-08 16:44:52,398] DEBUG partition assignment of /brokers/topics/test is Map(0 -> List(0)) (kafka.utils.ZkUtils$) [2013-01-08 16:44:52,409] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 21,4 replyHeader:: 21,282,0 request:: '/brokers/topics/test/partitions/0/leaderAndISR,F response:: #7b2022495352223a2230222c226c6561646572223a2230222c22636f6e74726f6c6c657245706f6368223a2236222c226c656164657245706f6368223a223022207d,s{272,272,1357681029058,1357681029058,0,0,0,0,66,0,272} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,440] DEBUG Leader 0, Epoch 0, Isr ArrayBuffer(0), Zk path version 0 for topic test and partition 0 (kafka.utils.ZkUtils$) [2013-01-08 16:44:52,447] DEBUG Accepted connection from /192.168.2.1 on /192.168.2.1:9092 (kafka.network.Acceptor) [2013-01-08 16:44:52,447] DEBUG Created socket with SO_TIMEOUT = 30000 (requested 30000), SO_RCVBUF = 66608 (requested -1), SO_SNDBUF = 66608 (requested -1). (kafka.network.BlockingChannel) [2013-01-08 16:44:52,447] DEBUG Listening to new connection from /192.168.2.1:61522 (kafka.network.Processor) [2013-01-08 16:44:52,450] INFO [Controller 0]: Currently active brokers in the cluster: Set(0) (kafka.controller.KafkaController) [2013-01-08 16:44:52,450] INFO [Controller-0-to-broker-0-send-thread], Starting (kafka.controller.RequestSendThread) [2013-01-08 16:44:52,450] INFO [Controller 0]: Currently shutting brokers in the cluster: Set() (kafka.controller.KafkaController) [2013-01-08 16:44:52,451] INFO [Controller 0]: Current list of topics in the cluster: Set(test) (kafka.controller.KafkaController) [2013-01-08 16:44:52,452] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 22,4 replyHeader:: 22,282,-101 request:: '/admin/reassign_partitions,T response:: (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,457] INFO [Controller 0]: Partitions being reassigned: Map() (kafka.controller.KafkaController) [2013-01-08 16:44:52,457] INFO [Controller 0]: Partitions already reassigned: List() (kafka.controller.KafkaController) [2013-01-08 16:44:52,458] INFO [Controller 0]: Resuming reassignment of partitions: Map() (kafka.controller.KafkaController) [2013-01-08 16:44:52,459] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 23,4 replyHeader:: 23,282,-101 request:: '/admin/preferred_replica_election,T response:: (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,460] INFO [Controller 0]: Partitions undergoing preferred replica election: (kafka.controller.KafkaController) [2013-01-08 16:44:52,460] INFO [Controller 0]: Partitions that completed preferred replica election: (kafka.controller.KafkaController) [2013-01-08 16:44:52,461] INFO [Controller 0]: Resuming preferred replica election for partitions: (kafka.controller.KafkaController) [2013-01-08 16:44:52,461] INFO [Controller 0]: Starting preferred replica leader election for partitions (kafka.controller.KafkaController) [2013-01-08 16:44:52,462] INFO [Partition state machine on Controller 0]: Invoking state change to OnlinePartition for partitions (kafka.controller.PartitionStateMachine) [2013-01-08 16:44:52,465] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 24,4 replyHeader:: 24,282,0 request:: '/brokers/topics/test/partitions/0/leaderAndISR,F response:: #7b2022495352223a2230222c226c6561646572223a2230222c22636f6e74726f6c6c657245706f6368223a2236222c226c656164657245706f6368223a223022207d,s{272,272,1357681029058,1357681029058,0,0,0,0,66,0,272} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,477] DEBUG Leader 0, Epoch 0, Isr ArrayBuffer(0), Zk path version 0 for topic test and partition 0 (kafka.utils.ZkUtils$) [2013-01-08 16:44:52,479] INFO [Partition state machine on Controller 0]: Started partition state machine with initial state -> Map([test,0] -> OnlinePartition) (kafka.controller.PartitionStateMachine) [2013-01-08 16:44:52,481] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 25,4 replyHeader:: 25,282,0 request:: '/brokers/topics/test,F response:: #7b202230223a205b2230225d207d,s{267,267,1357681028842,1357681028842,0,1,0,0,14,1,270} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,484] DEBUG Partition map for /brokers/topics/test is Map(0 -> List(0)) (kafka.utils.ZkUtils$) [2013-01-08 16:44:52,489] INFO [Replica state machine on Controller 0]: Invoking state change to OnlineReplica for replicas PartitionAndReplica(test,0,0) (kafka.controller.ReplicaStateMachine) [2013-01-08 16:44:52,492] INFO [Replica state machine on Controller 0]: Replica 0 for partition [test, 0] state changed to OnlineReplica (kafka.controller.ReplicaStateMachine) [2013-01-08 16:44:52,501] DEBUG The leaderAndIsr request sent to broker 0 is LeaderAndIsrRequest(0,0,,1000,Map((test,0) -> PartitionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0","leader":"0","leaderEpoch":"0" },6),1)),Set(id:0,host:192.168.2.1,port:9092),8) (kafka.controller.ControllerBrokerRequestBatch) [2013-01-08 16:44:52,502] INFO [Replica state machine on Controller 0]: Started replica state machine with initial state -> Map((test,0,0) -> OnlineReplica) (kafka.controller.ReplicaStateMachine) [2013-01-08 16:44:52,503] INFO [Controller 0]: Broker 0 is ready to serve as the new controller with epoch 8 (kafka.controller.KafkaController) [2013-01-08 16:44:52,504] INFO [Controller 0]: Controller startup complete (kafka.controller.KafkaController) [2013-01-08 16:44:52,505] INFO New leader is 0 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener) [2013-01-08 16:44:52,505] DEBUG Delivering event #1 done (org.I0Itec.zkclient.ZkEventThread) [2013-01-08 16:44:52,505] DEBUG Delivering event #2 ZkEvent[Data of /controllerEpoch changed sent to kafka.controller.ControllerEpochListener@58c16b18] (org.I0Itec.zkclient.ZkEventThread) [2013-01-08 16:44:52,506] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 26,3 replyHeader:: 26,282,0 request:: '/controllerEpoch,T response:: s{241,282,1357679976045,1357681492276,7,0,0,0,1,0,241} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,507] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 27,4 replyHeader:: 27,282,0 request:: '/controllerEpoch,T response:: #38,s{241,282,1357679976045,1357681492276,7,0,0,0,1,0,241} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,508] DEBUG [ControllerEpochListener on 0]: Controller epoch listener fired with new epoch 8 (kafka.controller.ControllerEpochListener) [2013-01-08 16:44:52,509] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 28,3 replyHeader:: 28,282,0 request:: '/controllerEpoch,T response:: s{241,282,1357679976045,1357681492276,7,0,0,0,1,0,241} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,509] TRACE 84 bytes written. (kafka.network.BoundedByteBufferSend) [2013-01-08 16:44:52,510] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 29,4 replyHeader:: 29,282,0 request:: '/controllerEpoch,T response:: #38,s{241,282,1357679976045,1357681492276,7,0,0,0,1,0,241} (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:52,510] INFO [ControllerEpochListener on 0]: Initialized controller epoch to 8 and zk version 7 (kafka.controller.ControllerEpochListener) [2013-01-08 16:44:52,510] DEBUG Delivering event #2 done (org.I0Itec.zkclient.ZkEventThread) [2013-01-08 16:44:52,511] TRACE 80 bytes read from /192.168.2.1:61522 (kafka.network.Processor) [2013-01-08 16:44:52,517] INFO [Kafka Server 0], started (kafka.server.KafkaServer) [2013-01-08 16:44:52,517] INFO Verifying properties (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,518] INFO Property socket.receive.buffer is overridden to 1048576 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,518] INFO Property log.dir is overridden to /tmp/kafka-logs (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,518] INFO Property log.cleanup.interval.mins is overridden to 1 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,519] INFO Property log.default.flush.interval.ms is overridden to 1000 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,519] INFO Property log.retention.hours is overridden to 168 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,519] INFO Property network.threads is overridden to 2 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,519] INFO Property kafka.csv.metrics.reporter.enabled is overridden to false (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,519] INFO Property brokerid is overridden to 0 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,519] INFO Property port is overridden to 9092 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,520] INFO Property max.socket.request.bytes is overridden to 104857600 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,520] INFO Property kafka.metrics.reporters is overridden to kafka.metrics.KafkaCSVMetricsReporter (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,520] INFO Property kafka.csv.metrics.dir is overridden to /tmp/kafka_metrics (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,520] INFO Property kafka.metrics.polling.interval.secs is overridden to 5 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,520] INFO Property log.flush.interval is overridden to 10000 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,520] INFO Property io.threads is overridden to 2 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,521] INFO Property log.file.size is overridden to 536870912 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,521] INFO Property socket.send.buffer is overridden to 1048576 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,521] INFO Property log.default.flush.scheduler.interval.ms is overridden to 1000 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,521] INFO Property zk.connectiontimeout.ms is overridden to 1000000 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,521] INFO Property zk.connect is overridden to localhost:2181 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,522] INFO Property num.partitions is overridden to 1 (kafka.utils.VerifiableProperties) [2013-01-08 16:44:52,523] TRACE Received request: ProducerRequest(0,0,,0,0,Map()) (kafka.network.RequestChannel$) [2013-01-08 16:44:52,523] TRACE Received request: LeaderAndIsrRequest(0,0,,1000,Map((test,0) -> PartitionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0","leader":"0","leaderEpoch":"0" },6),1)),Set(id:0,host:192.168.2.1,port:9092),8) (kafka.network.RequestChannel$) [2013-01-08 16:44:52,524] TRACE Recieved request, sending for processing by handler: Request(0,sun.nio.ch.SelectionKeyImpl@4945f939,java.nio.HeapByteBuffer[pos=0 lim=80 cap=80],1357681492512) (kafka.network.Processor) [2013-01-08 16:44:52,524] DEBUG [Kafka Request Handler 0 on Broker 0], handles request Request(0,sun.nio.ch.SelectionKeyImpl@4945f939,java.nio.HeapByteBuffer[pos=0 lim=80 cap=80],1357681492512) (kafka.server.KafkaRequestHandler) [2013-01-08 16:44:52,524] TRACE Handling leader and ISR request LeaderAndIsrRequest(0,0,,1000,Map((test,0) -> PartitionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0","leader":"0","leaderEpoch":"0" },6),1)),Set(id:0,host:192.168.2.1,port:9092),8) (kafka.request.logger) [2013-01-08 16:44:52,525] TRACE [KafkaApi-0] Handling leader and ISR request LeaderAndIsrRequest(0,0,,1000,Map((test,0) -> PartitionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0","leader":"0","leaderEpoch":"0" },6),1)),Set(id:0,host:192.168.2.1,port:9092),8) (kafka.server.KafkaApis) [2013-01-08 16:44:52,525] INFO Replica Manager on Broker 0: Handling leader and isr request LeaderAndIsrRequest(0,0,,1000,Map((test,0) -> PartitionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0","leader":"0","leaderEpoch":"0" },6),1)),Set(id:0,host:192.168.2.1,port:9092),8) (kafka.server.ReplicaManager) [2013-01-08 16:44:52,532] INFO Replica Manager on Broker 0: Becoming Leader for topic [test] partition [0] (kafka.server.ReplicaManager) [2013-01-08 16:44:52,535] TRACE Partition [test, 0] on broker 0: Started to become leader at the request { "ISR":"0","leader":"0","leaderEpoch":"0" } (kafka.cluster.Partition) [2013-01-08 16:44:52,535] INFO [ReplicaFetcherManager on broker 0] removing fetcher on topic test, partition 0 (kafka.server.ReplicaFetcherManager) [2013-01-08 16:44:52,537] DEBUG Read hw 2 for topic test partition 0 from highwatermark checkpoint file (kafka.server.HighwaterMarkCheckpoint) [2013-01-08 16:44:52,543] DEBUG Partition [test, 0] on broker 0: Old hw for topic test partition 0 is 2. New hw is 2. All leo's are 2 (kafka.cluster.Partition) [2013-01-08 16:44:52,543] INFO Replica Manager on Broker 0: Completed the leader state transition for topic test partition 0 (kafka.server.ReplicaManager) [2013-01-08 16:44:52,544] INFO Replica Manager on Broker 0: Completed leader and isr request LeaderAndIsrRequest(0,0,,1000,Map((test,0) -> PartitionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0","leader":"0","leaderEpoch":"0" },6),1)),Set(id:0,host:192.168.2.1,port:9092),8) (kafka.server.ReplicaManager) [2013-01-08 16:44:52,546] TRACE Socket server received response to send, registering for write: Response(0,Request(0,sun.nio.ch.SelectionKeyImpl@4945f939,java.nio.HeapByteBuffer[pos=0 lim=80 cap=80],1357681492512),kafka.network.BoundedByteBufferSend@38bdc9b3) (kafka.network.Processor) [2013-01-08 16:44:52,547] TRACE 26 bytes written to /192.168.2.1:61522 (kafka.network.Processor) [2013-01-08 16:44:52,547] TRACE 22 bytes read. (kafka.network.BoundedByteBufferReceive) [2013-01-08 16:44:52,550] TRACE [Controller-0-to-broker-0-send-thread], Controller 0 request to broker 0 got a response LeaderAndIsrResponse(0,Map((test,0) -> 0),0) (kafka.controller.RequestSendThread) [2013-01-08 16:44:52,565] TRACE Completed request: LeaderAndIsrRequest(0,0,,1000,Map((test,0) -> PartitionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0","leader":"0","leaderEpoch":"0" },6),1)),Set(id:0,host:192.168.2.1,port:9092),8) totalTime:35 queueTime:11 localTime:23 remoteTime:0 sendTime:1 (kafka.network.RequestChannel$) [2013-01-08 16:44:54,376] DEBUG Accepted connection from /127.0.0.1 on /127.0.0.1:9092 (kafka.network.Acceptor) [2013-01-08 16:44:54,376] DEBUG Listening to new connection from /127.0.0.1:61523 (kafka.network.Processor) [2013-01-08 16:44:54,376] TRACE 97 bytes read from /127.0.0.1:61523 (kafka.network.Processor) [2013-01-08 16:44:54,379] TRACE Received request: ProducerRequest(0,0,kafka-python,1,1000,Map([test-topic,0] -> ByteBufferMessageSet(MessageAndOffset(Message(magic = 2, attributes = 0, crc = 2053170379, key = java.nio.HeapByteBuffer[pos=0 lim=3 cap=19], payload = java.nio.HeapByteBuffer[pos=0 lim=12 cap=12]),0)))) (kafka.network.RequestChannel$) [2013-01-08 16:44:54,379] TRACE Recieved request, sending for processing by handler: Request(1,sun.nio.ch.SelectionKeyImpl@7acc7439,java.nio.HeapByteBuffer[pos=0 lim=97 cap=97],1357681494376) (kafka.network.Processor) [2013-01-08 16:44:54,380] DEBUG [Kafka Request Handler 1 on Broker 0], handles request Request(1,sun.nio.ch.SelectionKeyImpl@7acc7439,java.nio.HeapByteBuffer[pos=0 lim=97 cap=97],1357681494376) (kafka.server.KafkaRequestHandler) [2013-01-08 16:44:54,380] TRACE Handling producer request Request(1,sun.nio.ch.SelectionKeyImpl@7acc7439,java.nio.HeapByteBuffer[pos=0 lim=97 cap=97],1357681494376) (kafka.request.logger) [2013-01-08 16:44:54,380] TRACE [KafkaApi-0] Handling producer request Request(1,sun.nio.ch.SelectionKeyImpl@7acc7439,java.nio.HeapByteBuffer[pos=0 lim=97 cap=97],1357681494376) (kafka.server.KafkaApis) [2013-01-08 16:44:54,381] TRACE [KafkaApi-0] Append [Map([test-topic,0] -> ByteBufferMessageSet(MessageAndOffset(Message(magic = 2, attributes = 0, crc = 2053170379, key = java.nio.HeapByteBuffer[pos=0 lim=3 cap=19], payload = java.nio.HeapByteBuffer[pos=0 lim=12 cap=12]),0)))] to local log (kafka.server.KafkaApis) [2013-01-08 16:44:54,383] ERROR [KafkaApi-0] Error processing ProducerRequest on test-topic:0 (kafka.server.KafkaApis) kafka.common.UnknownTopicOrPartitionException: Topic test-topic partition 0 doesn't exist on 0 at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:163) at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:269) at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.scala:264) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) at scala.collection.TraversableLike$class.map(TraversableLike.scala:206) at scala.collection.immutable.Map$Map1.map(Map.scala:93) at kafka.server.KafkaApis.appendToLocalLog(KafkaApis.scala:264) at kafka.server.KafkaApis.handleProducerRequest(KafkaApis.scala:204) at kafka.server.KafkaApis.handle(KafkaApis.scala:60) at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41) at java.lang.Thread.run(Thread.java:680) [2013-01-08 16:44:54,384] DEBUG [KafkaApi-0] Produce to local log in 4 ms (kafka.server.KafkaApis) [2013-01-08 16:44:54,385] TRACE [KafkaApi-0] Producer request to (test-topic-0) unblocked 0 fetch requests. (kafka.server.KafkaApis) [2013-01-08 16:44:54,389] TRACE Socket server received response to send, registering for write: Response(1,Request(1,sun.nio.ch.SelectionKeyImpl@7acc7439,java.nio.HeapByteBuffer[pos=0 lim=97 cap=97],1357681494376),kafka.network.BoundedByteBufferSend@1958015a) (kafka.network.Processor) [2013-01-08 16:44:54,389] TRACE 42 bytes written to /127.0.0.1:61523 (kafka.network.Processor) [2013-01-08 16:44:54,390] TRACE Completed request: ProducerRequest(0,0,kafka-python,1,1000,Map([test-topic,0] -> ByteBufferMessageSet(MessageAndOffset(Message(magic = 2, attributes = 0, crc = 2053170379, key = java.nio.HeapByteBuffer[pos=0 lim=3 cap=19], payload = java.nio.HeapByteBuffer[pos=0 lim=12 cap=12]),0)))) totalTime:13 queueTime:3 localTime:10 remoteTime:0 sendTime:0 (kafka.network.RequestChannel$) [2013-01-08 16:44:54,390] TRACE 70 bytes read from /127.0.0.1:61523 (kafka.network.Processor) [2013-01-08 16:44:54,393] TRACE Received request: FetchRequest(0,1,kafka-python,-1,100,1024,Map([test-topic,0] -> PartitionFetchInfo(0,512))) (kafka.network.RequestChannel$) [2013-01-08 16:44:54,393] TRACE Recieved request, sending for processing by handler: Request(1,sun.nio.ch.SelectionKeyImpl@7acc7439,java.nio.HeapByteBuffer[pos=0 lim=70 cap=70],1357681494390) (kafka.network.Processor) [2013-01-08 16:44:54,393] DEBUG [Kafka Request Handler 0 on Broker 0], handles request Request(1,sun.nio.ch.SelectionKeyImpl@7acc7439,java.nio.HeapByteBuffer[pos=0 lim=70 cap=70],1357681494390) (kafka.server.KafkaRequestHandler) [2013-01-08 16:44:54,393] TRACE Handling fetch request FetchRequest(0,1,kafka-python,-1,100,1024,Map([test-topic,0] -> PartitionFetchInfo(0,512))) (kafka.request.logger) [2013-01-08 16:44:54,393] TRACE [KafkaApi-0] Handling fetch request FetchRequest(0,1,kafka-python,-1,100,1024,Map([test-topic,0] -> PartitionFetchInfo(0,512))) (kafka.server.KafkaApis) [2013-01-08 16:44:54,396] ERROR [KafkaApi-0] error when processing request (test-topic,0,0,512) (kafka.server.KafkaApis) kafka.common.UnknownTopicOrPartitionException: Topic test-topic partition 0 doesn't exist on 0 at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:163) at kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388) at kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:355) at kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:351) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) at scala.collection.TraversableLike$class.map(TraversableLike.scala:206) at scala.collection.immutable.Map$Map1.map(Map.scala:93) at kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:351) at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:319) at kafka.server.KafkaApis.handle(KafkaApis.scala:61) at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41) at java.lang.Thread.run(Thread.java:680) [2013-01-08 16:44:54,400] DEBUG [KafkaApi-0] Putting fetch request into purgatory (kafka.server.KafkaApis) [2013-01-08 16:44:54,502] DEBUG [FetchRequestPurgatory-0] Expiring fetch request FetchRequest(0,1,kafka-python,-1,100,1024,Map([test-topic,0] -> PartitionFetchInfo(0,512))). (kafka.server.KafkaApis$FetchRequestPurgatory) [2013-01-08 16:44:54,502] ERROR [KafkaApi-0] error when processing request (test-topic,0,0,512) (kafka.server.KafkaApis) kafka.common.UnknownTopicOrPartitionException: Topic test-topic partition 0 doesn't exist on 0 at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.scala:163) at kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:388) at kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:355) at kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:351) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) at scala.collection.immutable.Map$Map1.foreach(Map.scala:105) at scala.collection.TraversableLike$class.map(TraversableLike.scala:206) at scala.collection.immutable.Map$Map1.map(Map.scala:93) at kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:351) at kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:665) at kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:647) at kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:222) at java.lang.Thread.run(Thread.java:680) [2013-01-08 16:44:54,509] TRACE Socket server received response to send, registering for write: Response(1,Request(1,sun.nio.ch.SelectionKeyImpl@7acc7439,java.nio.HeapByteBuffer[pos=0 lim=70 cap=70],1357681494390),kafka.api.FetchResponseSend@45f8acdc) (kafka.network.Processor) [2013-01-08 16:44:54,509] TRACE 18 bytes written. (kafka.api.TopicDataSend$$anon$1) [2013-01-08 16:44:54,509] TRACE 34 bytes written. (kafka.api.FetchResponseSend$$anon$2) [2013-01-08 16:44:54,509] TRACE 46 bytes written to /127.0.0.1:61523 (kafka.network.Processor) [2013-01-08 16:44:54,510] TRACE Completed request: FetchRequest(0,1,kafka-python,-1,100,1024,Map([test-topic,0] -> PartitionFetchInfo(0,512))) totalTime:119 queueTime:3 localTime:8 remoteTime:108 sendTime:0 (kafka.network.RequestChannel$) [2013-01-08 16:44:54,511] INFO Closing socket connection to /127.0.0.1. (kafka.network.Processor) [2013-01-08 16:44:54,511] DEBUG Got ping response for sessionid: 0x13c15a1d848002e after 0ms (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:54,511] DEBUG Closing connection from /127.0.0.1:61523 (kafka.network.Processor) [2013-01-08 16:44:56,511] DEBUG Got ping response for sessionid: 0x13c15a1d848002e after 0ms (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:44:58,512] DEBUG Got ping response for sessionid: 0x13c15a1d848002e after 0ms (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:00,512] DEBUG Got ping response for sessionid: 0x13c15a1d848002e after 0ms (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:01,003] DEBUG Accepted connection from /127.0.0.1 on /127.0.0.1:9092 (kafka.network.Acceptor) [2013-01-08 16:45:01,004] DEBUG Listening to new connection from /127.0.0.1:61526 (kafka.network.Processor) [2013-01-08 16:45:01,004] TRACE 91 bytes read from /127.0.0.1:61526 (kafka.network.Processor) [2013-01-08 16:45:01,004] TRACE Received request: ProducerRequest(0,0,kafka-python,1,1000,Map([test,0] -> ByteBufferMessageSet(MessageAndOffset(Message(magic = 2, attributes = 0, crc = 2053170379, key = java.nio.HeapByteBuffer[pos=0 lim=3 cap=19], payload = java.nio.HeapByteBuffer[pos=0 lim=12 cap=12]),0)))) (kafka.network.RequestChannel$) [2013-01-08 16:45:01,004] TRACE Recieved request, sending for processing by handler: Request(0,sun.nio.ch.SelectionKeyImpl@27a36a2,java.nio.HeapByteBuffer[pos=0 lim=91 cap=91],1357681501004) (kafka.network.Processor) [2013-01-08 16:45:01,004] DEBUG [Kafka Request Handler 1 on Broker 0], handles request Request(0,sun.nio.ch.SelectionKeyImpl@27a36a2,java.nio.HeapByteBuffer[pos=0 lim=91 cap=91],1357681501004) (kafka.server.KafkaRequestHandler) [2013-01-08 16:45:01,004] TRACE Handling producer request Request(0,sun.nio.ch.SelectionKeyImpl@27a36a2,java.nio.HeapByteBuffer[pos=0 lim=91 cap=91],1357681501004) (kafka.request.logger) [2013-01-08 16:45:01,005] TRACE [KafkaApi-0] Handling producer request Request(0,sun.nio.ch.SelectionKeyImpl@27a36a2,java.nio.HeapByteBuffer[pos=0 lim=91 cap=91],1357681501004) (kafka.server.KafkaApis) [2013-01-08 16:45:01,005] TRACE [KafkaApi-0] Append [Map([test,0] -> ByteBufferMessageSet(MessageAndOffset(Message(magic = 2, attributes = 0, crc = 2053170379, key = java.nio.HeapByteBuffer[pos=0 lim=3 cap=19], payload = java.nio.HeapByteBuffer[pos=0 lim=12 cap=12]),0)))] to local log (kafka.server.KafkaApis) [2013-01-08 16:45:01,008] TRACE Appending message set to test-0 with offsets 2 to 2. (kafka.log.Log) [2013-01-08 16:45:01,009] TRACE Inserting 41 bytes at offset 2 at position 72 (kafka.log.LogSegment) [2013-01-08 16:45:01,009] TRACE Setting hw for replica 0 topic test partition 0 on broker 0 to 3 (kafka.cluster.Replica) [2013-01-08 16:45:01,010] DEBUG Partition [test, 0] on broker 0: Highwatermark for topic test partition 0 updated to 3 (kafka.cluster.Partition) [2013-01-08 16:45:01,011] TRACE [KafkaApi-0] 1 bytes written to log test-0 beginning at offset 2 and ending at offset 2 (kafka.server.KafkaApis) [2013-01-08 16:45:01,012] DEBUG [KafkaApi-0] Produce to local log in 7 ms (kafka.server.KafkaApis) [2013-01-08 16:45:01,012] TRACE [KafkaApi-0] Producer request to (test-0) unblocked 0 fetch requests. (kafka.server.KafkaApis) [2013-01-08 16:45:01,012] TRACE Socket server received response to send, registering for write: Response(0,Request(0,sun.nio.ch.SelectionKeyImpl@27a36a2,java.nio.HeapByteBuffer[pos=0 lim=91 cap=91],1357681501004),kafka.network.BoundedByteBufferSend@1ee2433b) (kafka.network.Processor) [2013-01-08 16:45:01,012] TRACE 36 bytes written to /127.0.0.1:61526 (kafka.network.Processor) [2013-01-08 16:45:01,013] TRACE Completed request: ProducerRequest(0,0,kafka-python,1,1000,Map([test,0] -> ByteBufferMessageSet(MessageAndOffset(Message(magic = 2, attributes = 0, crc = 2053170379, key = java.nio.HeapByteBuffer[pos=0 lim=3 cap=19], payload = java.nio.HeapByteBuffer[pos=0 lim=12 cap=12]),2)))) totalTime:8 queueTime:0 localTime:8 remoteTime:0 sendTime:0 (kafka.network.RequestChannel$) [2013-01-08 16:45:01,013] TRACE 64 bytes read from /127.0.0.1:61526 (kafka.network.Processor) [2013-01-08 16:45:01,013] TRACE Received request: FetchRequest(0,1,kafka-python,-1,100,1024,Map([test,0] -> PartitionFetchInfo(0,512))) (kafka.network.RequestChannel$) [2013-01-08 16:45:01,013] TRACE Recieved request, sending for processing by handler: Request(0,sun.nio.ch.SelectionKeyImpl@27a36a2,java.nio.HeapByteBuffer[pos=0 lim=64 cap=64],1357681501013) (kafka.network.Processor) [2013-01-08 16:45:01,014] DEBUG [Kafka Request Handler 0 on Broker 0], handles request Request(0,sun.nio.ch.SelectionKeyImpl@27a36a2,java.nio.HeapByteBuffer[pos=0 lim=64 cap=64],1357681501013) (kafka.server.KafkaRequestHandler) [2013-01-08 16:45:01,014] TRACE Handling fetch request FetchRequest(0,1,kafka-python,-1,100,1024,Map([test,0] -> PartitionFetchInfo(0,512))) (kafka.request.logger) [2013-01-08 16:45:01,014] TRACE [KafkaApi-0] Handling fetch request FetchRequest(0,1,kafka-python,-1,100,1024,Map([test,0] -> PartitionFetchInfo(0,512))) (kafka.server.KafkaApis) [2013-01-08 16:45:01,014] TRACE [KafkaApi-0] Fetching log segment for topic, partition, offset, size = (test,0,0,512) (kafka.server.KafkaApis) [2013-01-08 16:45:01,016] TRACE Reading 512 bytes from offset 0 in log test-0 of length 113 bytes (kafka.log.Log) [2013-01-08 16:45:01,017] DEBUG [KafkaApi-0] Putting fetch request into purgatory (kafka.server.KafkaApis) [2013-01-08 16:45:01,118] DEBUG [FetchRequestPurgatory-0] Expiring fetch request FetchRequest(0,1,kafka-python,-1,100,1024,Map([test,0] -> PartitionFetchInfo(0,512))). (kafka.server.KafkaApis$FetchRequestPurgatory) [2013-01-08 16:45:01,118] TRACE [KafkaApi-0] Fetching log segment for topic, partition, offset, size = (test,0,0,512) (kafka.server.KafkaApis) [2013-01-08 16:45:01,118] TRACE Reading 512 bytes from offset 0 in log test-0 of length 113 bytes (kafka.log.Log) [2013-01-08 16:45:01,119] TRACE Socket server received response to send, registering for write: Response(0,Request(0,sun.nio.ch.SelectionKeyImpl@27a36a2,java.nio.HeapByteBuffer[pos=0 lim=64 cap=64],1357681501013),kafka.api.FetchResponseSend@6ec5122f) (kafka.network.Processor) [2013-01-08 16:45:01,121] TRACE 131 bytes written. (kafka.api.TopicDataSend$$anon$1) [2013-01-08 16:45:01,121] TRACE 141 bytes written. (kafka.api.FetchResponseSend$$anon$2) [2013-01-08 16:45:01,121] TRACE 153 bytes written to /127.0.0.1:61526 (kafka.network.Processor) [2013-01-08 16:45:01,121] TRACE Completed request: FetchRequest(0,1,kafka-python,-1,100,1024,Map([test,0] -> PartitionFetchInfo(0,512))) totalTime:108 queueTime:0 localTime:4 remoteTime:101 sendTime:3 (kafka.network.RequestChannel$) [2013-01-08 16:45:01,122] INFO Closing socket connection to /127.0.0.1. (kafka.network.Processor) [2013-01-08 16:45:01,122] DEBUG Closing connection from /127.0.0.1:61526 (kafka.network.Processor) [2013-01-08 16:45:02,245] TRACE Begining execution of scheduled task 'isr-expiration'. (kafka.utils.KafkaScheduler) [2013-01-08 16:45:02,245] TRACE Replica Manager on Broker 0: Evaluating ISR list of partitions to see which replicas can be removed from the ISR (kafka.server.ReplicaManager) [2013-01-08 16:45:02,247] DEBUG Partition [test, 0] on broker 0: Possibly stuck replicas for topic test partition 0 are (kafka.cluster.Partition) [2013-01-08 16:45:02,249] DEBUG Partition [test, 0] on broker 0: Stuck replicas for topic test partition 0 are (kafka.cluster.Partition) [2013-01-08 16:45:02,250] DEBUG Partition [test, 0] on broker 0: Slow replicas for topic test partition 0 are (kafka.cluster.Partition) [2013-01-08 16:45:02,250] TRACE Completed execution of scheduled task 'isr-expiration'. (kafka.utils.KafkaScheduler) [2013-01-08 16:45:02,514] DEBUG Got ping response for sessionid: 0x13c15a1d848002e after 0ms (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:04,108] INFO [Kafka Server 0], shutting down (kafka.server.KafkaServer) [2013-01-08 16:45:04,109] INFO [Kafka Request Handler on Broker 0], shutting down (kafka.server.KafkaRequestHandlerPool) [2013-01-08 16:45:04,110] TRACE [Kafka Request Handler 0 on Broker 0], receives shut down command, shut down (kafka.server.KafkaRequestHandler) [2013-01-08 16:45:04,110] TRACE [Kafka Request Handler 1 on Broker 0], receives shut down command, shut down (kafka.server.KafkaRequestHandler) [2013-01-08 16:45:04,111] INFO [Kafka Request Handler on Broker 0], shutted down completely (kafka.server.KafkaRequestHandlerPool) [2013-01-08 16:45:04,111] DEBUG Shutting down task scheduler. (kafka.utils.KafkaScheduler) [2013-01-08 16:45:04,112] DEBUG [KafkaApi-0] Shutting down. (kafka.server.KafkaApis) [2013-01-08 16:45:04,112] DEBUG ExpiredRequestReaper-0 Shutting down. (kafka.server.RequestPurgatory$ExpiredRequestReaper) [2013-01-08 16:45:04,113] DEBUG ExpiredRequestReaper-0 Purged 0 requests from delay queue. (kafka.server.RequestPurgatory$ExpiredRequestReaper) [2013-01-08 16:45:04,114] DEBUG ExpiredRequestReaper-0 Purged 2 (watcher) requests. (kafka.server.RequestPurgatory$ExpiredRequestReaper) [2013-01-08 16:45:04,114] DEBUG ExpiredRequestReaper-0 Shut down complete. (kafka.server.RequestPurgatory$ExpiredRequestReaper) [2013-01-08 16:45:04,114] DEBUG ExpiredRequestReaper-0 Shutting down. (kafka.server.RequestPurgatory$ExpiredRequestReaper) [2013-01-08 16:45:04,120] DEBUG ExpiredRequestReaper-0 Purged 0 requests from delay queue. (kafka.server.RequestPurgatory$ExpiredRequestReaper) [2013-01-08 16:45:04,120] DEBUG ExpiredRequestReaper-0 Purged 0 (watcher) requests. (kafka.server.RequestPurgatory$ExpiredRequestReaper) [2013-01-08 16:45:04,120] DEBUG ExpiredRequestReaper-0 Shut down complete. (kafka.server.RequestPurgatory$ExpiredRequestReaper) [2013-01-08 16:45:04,120] DEBUG [KafkaApi-0] Shut down complete. (kafka.server.KafkaApis) [2013-01-08 16:45:04,123] INFO Closing zookeeper client... (kafka.server.KafkaZooKeeper) [2013-01-08 16:45:04,123] DEBUG Closing ZkClient... (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:45:04,123] INFO Terminate ZkClient event thread. (org.I0Itec.zkclient.ZkEventThread) [2013-01-08 16:45:04,123] DEBUG Closing ZooKeeper connected to localhost:2181 (org.I0Itec.zkclient.ZkConnection) [2013-01-08 16:45:04,123] DEBUG Closing session: 0x13c15a1d848002e (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:45:04,123] DEBUG Closing client for session: 0x13c15a1d848002e (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:04,125] DEBUG Got notification sessionid:0x13c15a1d848002e (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:04,125] DEBUG Got WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/ids for sessionid 0x13c15a1d848002e (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:04,125] DEBUG Received event: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/ids (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:45:04,125] DEBUG Got notification sessionid:0x13c15a1d848002e (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:04,125] DEBUG Got WatchedEvent state:SyncConnected type:NodeDeleted path:/controller for sessionid 0x13c15a1d848002e (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:04,126] DEBUG Reading reply sessionid:0x13c15a1d848002e, packet:: clientPath:null serverPath:null finished:false header:: 30,-11 replyHeader:: 30,283,0 request:: null response:: null (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:04,126] DEBUG Disconnecting client for session: 0x13c15a1d848002e (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:04,126] INFO Session: 0x13c15a1d848002e closed (org.apache.zookeeper.ZooKeeper) [2013-01-08 16:45:04,126] DEBUG An exception was thrown while closing send thread for session 0x13c15a1d848002e : Unable to read additional data from server sessionid 0x13c15a1d848002e, likely server has closed socket (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:04,126] DEBUG ignoring event '{NodeChildrenChanged | /brokers/ids}' since shutdown triggered (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:45:04,126] DEBUG Closing ZkClient...done (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:45:04,127] DEBUG Leaving process event (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:45:04,127] DEBUG Received event: WatchedEvent state:SyncConnected type:NodeDeleted path:/controller (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:45:04,127] DEBUG ignoring event '{NodeDeleted | /controller}' since shutdown triggered (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:45:04,127] DEBUG Leaving process event (org.I0Itec.zkclient.ZkClient) [2013-01-08 16:45:04,127] INFO EventThread shut down (org.apache.zookeeper.ClientCnxn) [2013-01-08 16:45:04,128] INFO Replica Manager on Broker 0: Shut down (kafka.server.ReplicaManager) [2013-01-08 16:45:04,128] DEBUG Ignoring exception during shutdown input (org.apache.zookeeper.ClientCnxn) java.net.SocketException: Socket is not connected at sun.nio.ch.SocketChannelImpl.shutdown(Native Method) at sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:665) at sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:430) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1232) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1211) [2013-01-08 16:45:04,128] INFO [ReplicaFetcherManager on broker 0] shutting down (kafka.server.ReplicaFetcherManager) [2013-01-08 16:45:04,129] INFO [ReplicaFetcherManager on broker 0] shutdown completed (kafka.server.ReplicaFetcherManager) [2013-01-08 16:45:04,133] INFO Replica Manager on Broker 0: Shutted down completely (kafka.server.ReplicaManager) [2013-01-08 16:45:04,134] INFO [Socket Server on Broker 0], shutting down (kafka.network.SocketServer) [2013-01-08 16:45:04,134] DEBUG Closing server socket and selector. (kafka.network.Acceptor) [2013-01-08 16:45:04,136] DEBUG Closing selector. (kafka.network.Processor) [2013-01-08 16:45:04,136] DEBUG Closing selector. (kafka.network.Processor) [2013-01-08 16:45:04,137] INFO [Socket Server on Broker 0], shut down completely (kafka.network.SocketServer) [2013-01-08 16:45:04,137] DEBUG [Log Manager on Broker 0] Shutting down. (kafka.log.LogManager) [2013-01-08 16:45:04,138] DEBUG Closing log test-0 (kafka.log.Log) [2013-01-08 16:45:04,141] TRACE Releasing lock on /tmp/kafka-logs/.lock (kafka.utils.FileLock) [2013-01-08 16:45:04,142] DEBUG [Log Manager on Broker 0] Shutdown complete. (kafka.log.LogManager) [2013-01-08 16:45:04,144] INFO [Controller-0-to-broker-0-send-thread], Shutting down (kafka.controller.RequestSendThread) [2013-01-08 16:45:04,144] INFO [Controller-0-to-broker-0-send-thread], Stopped (kafka.controller.RequestSendThread) [2013-01-08 16:45:04,145] INFO [Controller-0-to-broker-0-send-thread], Shutdown completed (kafka.controller.RequestSendThread) [2013-01-08 16:45:04,145] INFO [Controller 0]: Controller shutdown complete (kafka.controller.KafkaController) [2013-01-08 16:45:04,145] INFO [Kafka Server 0], shut down completed (kafka.server.KafkaServer)