[2014-07-28 11:29:43,992] [DEBUG] [kafka-request-handler-1] [kafka.server.KafkaApis] [KafkaApi-0] Maybe update partition HW due to fetch request: Name: FetchRequest; Version: 0; CorrelationId: 753; ClientId: ReplicaFetcherThread-0-0; ReplicaId: 2; MaxWait: 500 ms; MinBytes: 1 bytes; RequestInfo: [EventServiceU psertTopic,13] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,11] -> PartitionFetchInfo(9499,1048576),[EventServiceUpsertTopic,17] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,7] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,9] -> PartitionFetchInfo(0,1048576),[EventServiceUpser tTopic,1] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,15] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,19] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,3] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,5] -> PartitionFetchInfo(0,1048576) [2014-07-28 11:29:43,992] [DEBUG] [kafka-request-handler-2] [kafka.server.KafkaApis] [KafkaApi-0] Maybe update partition HW due to fetch request: Name: FetchRequest; Version: 0; CorrelationId: 910; ClientId: ReplicaFetcherThread-0-0; ReplicaId: 1; MaxWait: 500 ms; MinBytes: 1 bytes; RequestInfo: [EventServiceU psertTopic,13] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,11] -> PartitionFetchInfo(9499,1048576),[EventServiceUpsertTopic,17] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,7] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,9] -> PartitionFetchInfo(0,1048576),[EventServiceUpser [2014-07-28 11:29:43,992] [DEBUG] [kafka-request-handler-1] [kafka.cluster.Partition] Partition [EventServiceUpsertTopic,11] on broker 0: Recording follower 2 position 9499 for partition [EventServiceUpsertTopic,11]. [2014-07-28 11:29:43,992] [DEBUG] [kafka-request-handler-1] [kafka.cluster.Partition] Partition [EventServiceUpsertTopic,11] on broker 0: Old hw for partition [EventServiceUpsertTopic,11] is 9497. New hw is 9497. All leo's are 9500,9497,9499 [2014-07-28 11:29:43,992] [DEBUG] [kafka-request-handler-2] [kafka.cluster.Partition] Partition [EventServiceUpsertTopic,11] on broker 0: Recording follower 1 position 9499 for partition [EventServiceUpsertTopic,11]. [2014-07-28 11:29:43,992] [DEBUG] [kafka-request-handler-2] [kafka.cluster.Partition] Partition [EventServiceUpsertTopic,11] on broker 0: Highwatermark for partition [EventServiceUpsertTopic,11] updated to 9499 [2014-07-28 11:29:43,993] [DEBUG] [kafka-request-handler-1] [kafka.server.KafkaApis] [KafkaApi-0] Leader 0 for partition [EventServiceUpsertTopic,11] received fetch request from follower 2 [2014-07-28 11:29:43,993] [DEBUG] [kafka-request-handler-2] [kafka.server.KafkaApis] [KafkaApi-0] Leader 0 for partition [EventServiceUpsertTopic,11] received fetch request from follower 1 [2014-07-28 11:29:43,994] [DEBUG] [kafka-request-handler-3] [kafka.cluster.Partition] Partition [EventServiceUpsertTopic,11] on broker 0: Old hw for partition [EventServiceUpsertTopic,11] is 9499. New hw is 9499. All leo's are 9501,9499 [2014-07-28 11:29:43,994] [DEBUG] [kafka-request-handler-3] [kafka.server.KafkaApis] [KafkaApi-0] Produce to local log in 1 ms [2014-07-28 11:29:43,996] [DEBUG] [kafka-request-handler-0] [kafka.cluster.Partition] Partition [EventServiceUpsertTopic,11] on broker 0: Old hw for partition [EventServiceUpsertTopic,11] is 9499. New hw is 9499. All leo's are 9502,9499 [2014-07-28 11:29:43,996] [DEBUG] [kafka-request-handler-0] [kafka.server.KafkaApis] [KafkaApi-0] Produce to local log in 0 ms [2014-07-28 11:29:43,997] [DEBUG] [kafka-processor-54156-1] [kafka.request.logger] Completed request:Name: ProducerRequest; Version: 0; CorrelationId: 19029; ClientId: ; RequiredAcks: -1; AckTimeoutMs: 10000 ms from client /127.0.0.1:54410;totalTime:0,requestQueueTime:0,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:0 [2014-07-28 11:29:43,998] [INFO ] [ZkClient-EventThread-13-localhost:54132,localhost:54135,localhost:54138] [kafka.controller.KafkaController] [Controller 0]: Partition [EventServiceUpsertTopic,11] completed preferred replica leader election. New leader is 2 [2014-07-28 11:29:44,000] [INFO ] [kafka-request-handler-4] [kafka.server.ReplicaFetcherManager] [ReplicaFetcherManager on broker 0] Removed fetcher for partitions [EventServiceUpsertTopic,13],[EventServiceUpsertTopic,11],[EventServiceUpsertTopic,17],[EventServiceUpsertTopic,14],[EventServiceUpsertTopic,7],[EventServiceUpsertTopic,8],[EventServiceUpsertTopic,1],[EventServiceUpsertTopic,2],[EventServiceUpsertTopic,19],[EventServiceUpsertTopic,5] [2014-07-28 11:29:44,000] [INFO ] [kafka-request-handler-4] [kafka.log.Log] Truncating log EventServiceUpsertTopic-11 to offset 9499. [2014-07-28 11:29:44,001] [WARN ] [kafka-request-handler-7] [kafka.server.KafkaApis] [KafkaApi-0] Produce request with correlation id 19031 from client on partition [EventServiceUpsertTopic,11] failed due to Leader not local for partition [EventServiceUpsertTopic,11] on broker 0 [2014-07-28 11:29:44,001] [DEBUG] [kafka-request-handler-7] [kafka.server.KafkaApis] [KafkaApi-0] Produce to local log in 2 ms [2014-07-28 11:29:44,002] [DEBUG] [kafka-request-handler-5] [kafka.server.KafkaApis] [KafkaApi-0] Maybe update partition HW due to fetch request: Name: FetchRequest; Version: 0; CorrelationId: 754; ClientId: ReplicaFetcherThread-0-0; ReplicaId: 2; MaxWait: 500 ms; MinBytes: 1 bytes; RequestInfo: [EventServiceUpsertTopic,13] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,11] -> PartitionFetchInfo(9500,1048576),[EventServiceUpsertTopic,17] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,7] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,9] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,1] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,15] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,19] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,3] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,5] -> PartitionFetchInfo(0,1048576) [2014-07-28 11:29:44,002] [DEBUG] [kafka-request-handler-5] [kafka.cluster.Partition] Partition [EventServiceUpsertTopic,11] on broker 0: Recording follower 2 position 9500 for partition [EventServiceUpsertTopic,11]. [2014-07-28 11:29:44,004] [WARN ] [kafka-request-handler-5] [kafka.server.KafkaApis] [KafkaApi-0] Fetch request with correlation id 754 from client ReplicaFetcherThread-0-0 on partition [EventServiceUpsertTopic,11] failed due to Leader not local for partition [EventServiceUpsertTopic,11] on broker 0 [2014-07-28 11:29:44,008] [INFO ] [ReplicaFetcherThread-0-2] [kafka.server.ReplicaFetcherThread] [ReplicaFetcherThread-0-2], Starting [2014-07-28 11:29:44,008] [INFO ] [kafka-request-handler-4] [kafka.server.ReplicaFetcherManager] [ReplicaFetcherManager on broker 0] Added fetcher for partitions ArrayBuffer([[EventServiceUpsertTopic,7], initOffset 0 to broker id:1,host:localhost,port:54159] , [[EventServiceUpsertTopic,17], initOffset 0 to broker id:2,host:localhost,port:54383] , [[EventServiceUpsertTopic,5], initOffset 0 to broker id:2,host:localhost,port:54383] , [[EventServiceUpsertTopic,1], initOffset 0 to broker id:1,host:localhost,port:54159] , [[EventServiceUpsertTopic,13], initOffset 0 to broker id:1,host:localhost,port:54159] , [[EventServiceUpsertTopic,8], initOffset 0 to broker id:2,host:localhost,port:54383] , [[EventServiceUpsertTopic,11], initOffset 9499 to broker id:2,host:localhost,port:54383] , [[EventServiceUpsertTopic,2], initOffset 0 to broker id:2,host:localhost,port:54383] , [[EventServiceUpsertTopic,14], initOffset 0 to broker id:2,host:localhost,port:54383] , [[EventServiceUpsertTopic,19], initOffset 0 to broker id:1,host:localhost,port:54159] ) [2014-07-28 11:29:44,506] [DEBUG] [request-expiration-task] [k.s.KafkaApis$FetchRequestPurgatory] [FetchRequestPurgatory-0] Expiring fetch request Name: FetchRequest; Version: 0; CorrelationId: 754; ClientId: ReplicaFetcherThread-0-0; ReplicaId: 2; MaxWait: 500 ms; MinBytes: 1 bytes; RequestInfo: [EventServiceUpsertTopic,13] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,11] -> PartitionFetchInfo(9500,1048576),[EventServiceUpsertTopic,17] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,7] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,9] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,1] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,15] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,19] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,3] -> PartitionFetchInfo(0,1048576),[EventServiceUpsertTopic,5] -> PartitionFetchInfo(0,1048576). [2014-07-28 11:29:44,506] [WARN ] [request-expiration-task] [kafka.server.KafkaApis] [KafkaApi-0] Fetch request with correlation id 754 from client ReplicaFetcherThread-0-0 on partition [EventServiceUpsertTopic,11] failed due to Leader not local for partition [EventServiceUpsertTopic,11] on broker 0