[2018-03-14 05:00:23,158] INFO Rolled new log segment for 'egret_lambda_AdUnitPublisherFill_ams1_enhanced-3' in 6 ms. (kafka.log.Log) [2018-03-14 05:00:41,275] INFO Deleting segment 4741033041 from log perfRR-19. (kafka.log.Log) [2018-03-14 05:00:41,293] INFO Deleting segment 3977019004 from log ifcp_ams1-11. (kafka.log.Log) [2018-03-14 05:00:41,293] INFO Deleting segment 2568633751 from log napp-48. (kafka.log.Log) [2018-03-14 05:00:41,299] INFO Deleting segment 935185176 from log network_beacon_ams1_publisherfill-3. (kafka.log.Log) [2018-03-14 05:00:41,300] INFO Deleting segment 1252269 from log network_beacon_lhr1_publisherfill-2. (kafka.log.Log) [2018-03-14 05:00:41,300] INFO Deleting segment 21263 from log network_render_cpc_ams1_global-2. (kafka.log.Log) [2018-03-14 05:00:41,301] INFO Deleting segment 2784943686 from log sdkpubreq-7. (kafka.log.Log) [2018-03-14 05:00:41,306] INFO Deleting segment 857473400 from log beacon_rr_ams1_cpm_render-2. (kafka.log.Log) [2018-03-14 05:00:41,314] INFO Deleting segment 2732606789 from log rr-31. (kafka.log.Log) [2018-03-14 05:00:41,341] INFO Deleting index /data/d1/kafka/network_render_cpc_ams1_global-2/00000000000000021263.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,341] INFO Deleting index /data/d1/kafka/network_render_cpc_ams1_global-2/00000000000000021263.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,347] INFO Deleting segment 3977049510 from log ifcp_ams1-7. (kafka.log.Log) [2018-03-14 05:00:41,350] INFO Deleting index /data/d1/kafka/perfRR-19/00000000004741033041.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,351] INFO Deleting index /data/d1/kafka/perfRR-19/00000000004741033041.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,351] INFO Deleting segment 3662025830 from log nested_activity_add-network-1. (kafka.log.Log) [2018-03-14 05:00:41,353] INFO Deleting index /data/d1/kafka/network_beacon_lhr1_publisherfill-2/00000000000001252269.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,354] INFO Deleting index /data/d1/kafka/network_beacon_lhr1_publisherfill-2/00000000000001252269.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,354] INFO Deleting segment 3851597399 from log cas_rr-18. (kafka.log.Log) [2018-03-14 05:00:41,354] INFO Deleting segment 2845542785 from log supplyRR-25. (kafka.log.Log) [2018-03-14 05:00:41,372] INFO Deleting index /data/d1/kafka/napp-48/00000000002568633751.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,379] INFO Deleting index /data/d1/kafka/supplyRR-25/00000000002845542785.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,383] INFO Deleting index /data/d1/kafka/sdkpubreq-7/00000000002784943686.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,386] INFO Deleting index /data/d1/kafka/nested_activity_add-network-1/00000000003662025830.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,387] INFO Deleting index /data/d1/kafka/rr-31/00000000002732606789.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,474] INFO Deleting index /data/d1/kafka/ifcp_ams1-11/00000000003977019004.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,482] INFO Deleting index /data/d1/kafka/ifcp_ams1-7/00000000003977049510.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,561] INFO Deleting index /data/d1/kafka/ifcp_ams1-7/00000000003977049510.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,561] INFO Deleting index /data/d1/kafka/nested_activity_add-network-1/00000000003662025830.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,561] INFO Deleting segment 1110400 from log audit_producer-2. (kafka.log.Log) [2018-03-14 05:00:41,561] INFO Deleting index /data/d1/kafka/ifcp_ams1-11/00000000003977019004.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,562] INFO Deleting segment 1103822 from log audit_producer-0. (kafka.log.Log) [2018-03-14 05:00:41,561] INFO Deleting segment 1104244 from log audit_producer-1. (kafka.log.Log) [2018-03-14 05:00:41,616] INFO Deleting index /data/d1/kafka/cas_rr-18/00000000003851597399.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,617] INFO Deleting index /data/d1/kafka/cas_rr-18/00000000003851597399.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,617] INFO Deleting segment 825827146 from log egret_lambda_AdUnitBeacon_ams1_enhanced-6. (kafka.log.Log) [2018-03-14 05:00:41,617] INFO Deleting index /data/d1/kafka/audit_producer-1/00000000000001104244.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,617] INFO Deleting index /data/d1/kafka/audit_producer-1/00000000000001104244.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,618] INFO Deleting index /data/d1/kafka/audit_producer-2/00000000000001110400.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,618] INFO Deleting index /data/d1/kafka/supplyRR-25/00000000002845542785.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,618] INFO Deleting segment 4749411184 from log perfRR-3. (kafka.log.Log) [2018-03-14 05:00:41,618] INFO Deleting index /data/d1/kafka/audit_producer-2/00000000000001110400.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,618] INFO Deleting segment 4427915070 from log merge_network_beacon_adunit_interaction_ams1-0. (kafka.log.Log) [2018-03-14 05:00:41,619] INFO Deleting index /data/d1/kafka/audit_producer-0/00000000000001103822.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,619] INFO Deleting index /data/d1/kafka/sdkpubreq-7/00000000002784943686.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,619] INFO Deleting index /data/d1/kafka/audit_producer-0/00000000000001103822.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,630] INFO Deleting index /data/d1/kafka/rr-31/00000000002732606789.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,630] INFO Deleting index /data/d1/kafka/napp-48/00000000002568633751.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,630] INFO Deleting index /data/d1/kafka/network_beacon_ams1_publisherfill-3/00000000000935185176.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,631] INFO Deleting index /data/d1/kafka/network_beacon_ams1_publisherfill-3/00000000000935185176.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,642] INFO Deleting index /data/d1/kafka/perfRR-3/00000000004749411184.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,642] INFO Deleting index /data/d1/kafka/perfRR-3/00000000004749411184.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,657] INFO Deleting index /data/d1/kafka/merge_network_beacon_adunit_interaction_ams1-0/00000000004427915070.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,657] INFO Deleting index /data/d1/kafka/merge_network_beacon_adunit_interaction_ams1-0/00000000004427915070.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,665] INFO Deleting index /data/d1/kafka/egret_lambda_AdUnitBeacon_ams1_enhanced-6/00000000000825827146.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,671] INFO Deleting index /data/d1/kafka/egret_lambda_AdUnitBeacon_ams1_enhanced-6/00000000000825827146.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:00:41,692] INFO Deleting index /data/d1/kafka/beacon_rr_ams1_cpm_render-2/00000000000857473400.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:00:41,694] INFO Deleting index /data/d1/kafka/beacon_rr_ams1_cpm_render-2/00000000000857473400.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:01:32,831] INFO Rolled new log segment for '__consumer_offsets-9' in 3 ms. (kafka.log.Log) [2018-03-14 05:01:40,517] INFO Rolled new log segment for 'network_beacon_lhr1_adunit-4' in 6 ms. (kafka.log.Log) [2018-03-14 05:01:44,953] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-9. (kafka.log.LogCleaner) [2018-03-14 05:01:44,953] INFO Cleaner 0: Building offset map for __consumer_offsets-9... (kafka.log.LogCleaner) [2018-03-14 05:01:44,977] INFO Cleaner 0: Building offset map for log __consumer_offsets-9 for 1 segments in offset range [90634, 93034). (kafka.log.LogCleaner) [2018-03-14 05:01:44,980] INFO Cleaner 0: Offset map for log __consumer_offsets-9 complete. (kafka.log.LogCleaner) [2018-03-14 05:01:44,980] INFO Cleaner 0: Cleaning log __consumer_offsets-9 (cleaning prior to Wed Mar 14 05:01:30 UTC 2018, discarding tombstones prior to Tue Mar 13 04:01:29 UTC 2018)... (kafka.log.LogCleaner) [2018-03-14 05:01:44,981] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-9 (largest timestamp Wed Mar 14 04:01:29 UTC 2018) into 0, retaining deletes. (kafka.log.LogCleaner) [2018-03-14 05:01:44,984] INFO Cleaner 0: Cleaning segment 90634 in log __consumer_offsets-9 (largest timestamp Wed Mar 14 05:01:30 UTC 2018) into 0, retaining deletes. (kafka.log.LogCleaner) [2018-03-14 05:01:45,000] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0,90634 in log __consumer_offsets-9. (kafka.log.LogCleaner) [2018-03-14 05:01:45,001] INFO [kafka-log-cleaner-thread-0], [2018-03-14 05:01:52,239] INFO Partition [ifc_organic_activity_ams1_dfw2,1] on broker 15: Shrinking ISR for partition [ifc_organic_activity_ams1_dfw2,1] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,245] INFO Partition [network_conversion_ams1,1] on broker 15: Shrinking ISR for partition [network_conversion_ams1,1] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,250] INFO Partition [non_nw_click_cpm_ams1,0] on broker 15: Shrinking ISR for partition [non_nw_click_cpm_ams1,0] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,256] INFO Partition [network_activity_ams1_global,7] on broker 15: Shrinking ISR for partition [network_activity_ams1_global,7] from 2,15,3 to 15,3 (kafka.cluster.Partition) [2018-03-14 05:01:52,264] INFO Partition [network_click_lhr1,14] on broker 15: Shrinking ISR for partition [network_click_lhr1,14] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,269] INFO Partition [network_beacon_ams1_publisherfill,3] on broker 15: Shrinking ISR for partition [network_beacon_ams1_publisherfill,3] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,275] INFO Partition [network_click_dfw2,0] on broker 15: Shrinking ISR for partition [network_click_dfw2,0] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,282] INFO Partition [brand_attributes_ams1,1] on broker 15: Shrinking ISR for partition [brand_attributes_ams1,1] from 2,15,3 to 15,3 (kafka.cluster.Partition) [2018-03-14 05:01:52,288] INFO Partition [georrlite,0] on broker 15: Shrinking ISR for partition [georrlite,0] from 2,15,3 to 15,3 (kafka.cluster.Partition) [2018-03-14 05:01:52,293] INFO Partition [__consumer_offsets,39] on broker 15: Shrinking ISR for partition [__consumer_offsets,39] from 2,15,3 to 15,3 (kafka.cluster.Partition) [2018-03-14 05:01:52,311] INFO Partition [network_activity_ams1_dfw2,7] on broker 15: Shrinking ISR for partition [network_activity_ams1_dfw2,7] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,318] INFO Partition [audience-attributes_lhr1,4] on broker 15: Shrinking ISR for partition [audience-attributes_lhr1,4] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,323] INFO Partition [network_attribute_ams1_pek1,10] on broker 15: Shrinking ISR for partition [network_attribute_ams1_pek1,10] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,328] INFO Partition [brand_attributes_ams1_ams1,4] on broker 15: Shrinking ISR for partition [brand_attributes_ams1_ams1,4] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,334] INFO Partition [merge_ifc_ff_ams1,0] on broker 15: Shrinking ISR for partition [merge_ifc_ff_ams1,0] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,339] INFO Partition [network_beacon_pek1_adunit,0] on broker 15: Shrinking ISR for partition [network_beacon_pek1_adunit,0] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,344] INFO Partition [georrcore,16] on broker 15: Shrinking ISR for partition [georrcore,16] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,349] INFO Partition [photon_appd_flat_activity_ams1,0] on broker 15: Shrinking ISR for partition [photon_appd_flat_activity_ams1,0] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,357] INFO Partition [network_attribute_ams1_global,13] on broker 15: Shrinking ISR for partition [network_attribute_ams1_global,13] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,363] INFO Partition [egret_lambda_NWClickCPC_ams1_enhanced,1] on broker 15: Shrinking ISR for partition [egret_lambda_NWClickCPC_ams1_enhanced,1] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,370] INFO Partition [network_activity_ams1,2] on broker 15: Shrinking ISR for partition [network_activity_ams1,2] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,376] INFO Partition [renderCpmAms1,9] on broker 15: Shrinking ISR for partition [renderCpmAms1,9] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,382] INFO Partition [network_render_cpm_ams1,13] on broker 15: Shrinking ISR for partition [network_render_cpm_ams1,13] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,389] INFO Partition [supplyRR,29] on broker 15: Shrinking ISR for partition [supplyRR,29] from 15,2,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,400] INFO Partition [rr,4] on broker 15: Shrinking ISR for partition [rr,4] from 15,2,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,406] INFO Partition [wadogorr,1] on broker 15: Shrinking ISR for partition [wadogorr,1] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,411] INFO Partition [network_attribute_ams1_dfw1,13] on broker 15: Shrinking ISR for partition [network_attribute_ams1_dfw1,13] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,417] INFO Partition [photon_appd_flat_activity_dfw2,1] on broker 15: Shrinking ISR for partition [photon_appd_flat_activity_dfw2,1] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,424] INFO Partition [load_test,2] on broker 15: Shrinking ISR for partition [load_test,2] from 2,15,3 to 15,3 (kafka.cluster.Partition) [2018-03-14 05:01:52,446] INFO Partition [attribute_change-brand,2] on broker 15: Shrinking ISR for partition [attribute_change-brand,2] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,452] INFO Partition [nonNwClickCpcAms1,2] on broker 15: Shrinking ISR for partition [nonNwClickCpcAms1,2] from 2,15,3 to 15,3 (kafka.cluster.Partition) [2018-03-14 05:01:52,456] INFO Partition [custom_type_record_update-ifcinorg,3] on broker 15: Shrinking ISR for partition [custom_type_record_update-ifcinorg,3] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,461] INFO Partition [ifc_organic_activity_dfw1,2] on broker 15: Shrinking ISR for partition [ifc_organic_activity_dfw1,2] from 2,15,3 to 15,3 (kafka.cluster.Partition) [2018-03-14 05:01:52,467] INFO Partition [network_render_cpm_ams1_global,0] on broker 15: Shrinking ISR for partition [network_render_cpm_ams1_global,0] from 2,15,3 to 15,3 (kafka.cluster.Partition) [2018-03-14 05:01:52,474] INFO Partition [__consumer_offsets,24] on broker 15: Shrinking ISR for partition [__consumer_offsets,24] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,480] INFO Partition [merge_network_click_cpm_ams1,0] on broker 15: Shrinking ISR for partition [merge_network_click_cpm_ams1,0] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,493] INFO Partition [network_activity_lhr1,5] on broker 15: Shrinking ISR for partition [network_activity_lhr1,5] from 2,15,1 to 15,1 (kafka.cluster.Partition) [2018-03-14 05:01:52,499] INFO Partition [appd_attribute_dfw1,3] on broker 15: Shrinking ISR for partition [appd_attribute_dfw1,3] from 2,15,3 to 15,3 (kafka.cluster.Partition) [2018-03-14 05:01:58,113] INFO Creating /controller (is it secure? true) (kafka.utils.ZKCheckedEphemeral) [2018-03-14 05:01:58,161] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral) [2018-03-14 05:01:58,234] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener) [2018-03-14 05:02:07,037] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions beeswax_bid_logs-0,ifc_organic_activity_ams1_ams1-0,network_click_pek1-11,render_cpc_ams1-10,audience-attributes_ams1_ams1-11,network_render_cpc_ams1_global-4,attribute_change-core-2,appd-debug-14,audience-attributes_ams1-6,network_render_cpc_ams1_pek1-2,sdk_health_monitoring-10,network_activity_ams1_pek1-6,adhoc_network_click_ams1_ams1-5 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:02:07,038] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions merge_network_render_cpc_ams1-5,sdkpubreq-7,nonNwClickInvalidAms1-0,beaconDefaultAms1-5,ifc_activity_ams1_dfw1-1,nested_activity_add-appd-5,network_render_cpm_dfw2-4,network_render_cpc_dfw2-2,network_click_ams1-12,beacon_rr_ams1_cpm_render-4 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:02:07,038] INFO Truncating log beacon_rr_ams1_cpm_render-4 to offset 909598027. (kafka.log.Log) [2018-03-14 05:02:07,039] INFO Truncating log nonNwClickInvalidAms1-0 to offset 0. (kafka.log.Log) [2018-03-14 05:02:07,039] INFO Truncating log nested_activity_add-appd-5 to offset 0. (kafka.log.Log) [2018-03-14 05:02:07,039] INFO Truncating log sdkpubreq-7 to offset 2859656853. (kafka.log.Log) [2018-03-14 05:02:07,039] INFO Truncating log merge_network_render_cpc_ams1-5 to offset 47235036. (kafka.log.Log) [2018-03-14 05:02:07,039] INFO Truncating log ifc_activity_ams1_dfw1-1 to offset 0. (kafka.log.Log) [2018-03-14 05:02:07,039] INFO Truncating log network_render_cpm_dfw2-4 to offset 5135853. (kafka.log.Log) [2018-03-14 05:02:07,039] INFO Truncating log beaconDefaultAms1-5 to offset 1082591543. (kafka.log.Log) [2018-03-14 05:02:07,039] INFO Truncating log network_click_ams1-12 to offset 5414899. (kafka.log.Log) [2018-03-14 05:02:07,039] INFO Truncating log network_render_cpc_dfw2-2 to offset 8038450. (kafka.log.Log) [2018-03-14 05:02:07,060] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([beacon_rr_ams1_cpm_render-4, initOffset 909598027 to broker BrokerEndPoint(14,azkf4014.grid.ams1.inmobi.com,9093)] , [nonNwClickInvalidAms1-0, initOffset 0 to broker BrokerEndPoint(14,azkf4014.grid.ams1.inmobi.com,9093)] , [nested_activity_add-appd-5, initOffset 0 to broker BrokerEndPoint(14,azkf4014.grid.ams1.inmobi.com,9093)] , [sdkpubreq-7, initOffset 2859656853 to broker BrokerEndPoint(14,azkf4014.grid.ams1.inmobi.com,9093)] , [merge_network_render_cpc_ams1-5, initOffset 47235036 to broker BrokerEndPoint(14,azkf4014.grid.ams1.inmobi.com,9093)] , [ifc_activity_ams1_dfw1-1, initOffset 0 to broker BrokerEndPoint(14,azkf4014.grid.ams1.inmobi.com,9093)] , [network_render_cpm_dfw2-4, initOffset 5135853 to broker BrokerEndPoint(14,azkf4014.grid.ams1.inmobi.com,9093)] , [beaconDefaultAms1-5, initOffset 1082591543 to broker BrokerEndPoint(14,azkf4014.grid.ams1.inmobi.com,9093)] , [network_click_ams1-12, initOffset 5414899 to broker BrokerEndPoint(14,azkf4014.grid.ams1.inmobi.com,9093)] , [network_render_cpc_dfw2-2, initOffset 8038450 to broker BrokerEndPoint(14,azkf4014.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:02:07,060] INFO [ReplicaFetcherThread-0-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,374] INFO [ReplicaFetcherThread-0-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,374] INFO [ReplicaFetcherThread-0-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,383] INFO [ReplicaFetcherThread-3-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,383] INFO [ReplicaFetcherThread-3-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,383] INFO [ReplicaFetcherThread-3-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,389] INFO [ReplicaFetcherThread-2-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:14,088] INFO Partition [non_nw_click_cpm_ams1,0] on broker 15: Expanding ISR for partition non_nw_click_cpm_ams1-0 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,089] INFO Partition [load_test,2] on broker 15: Expanding ISR for partition load_test-2 from 15,3 to 15,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,089] INFO Partition [brand_attributes_ams1,1] on broker 15: Expanding ISR for partition brand_attributes_ams1-1 from 15,3 to 15,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,089] INFO Partition [brand_attributes_ams1_ams1,4] on broker 15: Expanding ISR for partition brand_attributes_ams1_ams1-4 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,102] INFO Partition [ifc_organic_activity_dfw1,2] on broker 15: Expanding ISR for partition ifc_organic_activity_dfw1-2 from 15,3 to 15,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,102] INFO Partition [network_conversion_ams1,1] on broker 15: Expanding ISR for partition network_conversion_ams1-1 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,102] INFO Partition [appd_attribute_dfw1,3] on broker 15: Expanding ISR for partition appd_attribute_dfw1-3 from 15,3 to 15,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,119] INFO Partition [network_render_cpm_ams1_global,0] on broker 15: Expanding ISR for partition network_render_cpm_ams1_global-0 from 15,3 to 15,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,121] INFO Partition [__consumer_offsets,39] on broker 15: Expanding ISR for partition __consumer_offsets-39 from 15,3 to 15,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,138] INFO Partition [__consumer_offsets,24] on broker 15: Expanding ISR for partition __consumer_offsets-24 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,165] INFO Partition [photon_appd_flat_activity_ams1,0] on broker 15: Expanding ISR for partition photon_appd_flat_activity_ams1-0 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,193] INFO Partition [renderCpmAms1,9] on broker 15: Expanding ISR for partition renderCpmAms1-9 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,213] INFO Partition [custom_type_record_update-ifcinorg,3] on broker 15: Expanding ISR for partition custom_type_record_update-ifcinorg-3 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,224] INFO Partition [network_activity_ams1,2] on broker 15: Expanding ISR for partition network_activity_ams1-2 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,226] INFO Partition [audience-attributes_lhr1,4] on broker 15: Expanding ISR for partition audience-attributes_lhr1-4 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,232] INFO Partition [network_click_lhr1,14] on broker 15: Expanding ISR for partition network_click_lhr1-14 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,262] INFO Partition [network_click_dfw2,0] on broker 15: Expanding ISR for partition network_click_dfw2-0 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,262] INFO Partition [ifc_organic_activity_ams1_dfw2,1] on broker 15: Expanding ISR for partition ifc_organic_activity_ams1_dfw2-1 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,262] INFO Partition [network_beacon_ams1_publisherfill,3] on broker 15: Expanding ISR for partition network_beacon_ams1_publisherfill-3 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,266] INFO Partition [network_attribute_ams1_dfw1,13] on broker 15: Expanding ISR for partition network_attribute_ams1_dfw1-13 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,267] INFO Partition [network_attribute_ams1_global,13] on broker 15: Expanding ISR for partition network_attribute_ams1_global-13 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,268] INFO Partition [network_attribute_ams1_pek1,10] on broker 15: Expanding ISR for partition network_attribute_ams1_pek1-10 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,271] INFO Partition [network_beacon_pek1_adunit,0] on broker 15: Expanding ISR for partition network_beacon_pek1_adunit-0 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,273] INFO Partition [wadogorr,1] on broker 15: Expanding ISR for partition wadogorr-1 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,278] INFO Partition [attribute_change-brand,2] on broker 15: Expanding ISR for partition attribute_change-brand-2 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,280] INFO Partition [photon_appd_flat_activity_dfw2,1] on broker 15: Expanding ISR for partition photon_appd_flat_activity_dfw2-1 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,287] INFO Partition [nonNwClickCpcAms1,2] on broker 15: Expanding ISR for partition nonNwClickCpcAms1-2 from 15,3 to 15,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,289] INFO Partition [network_activity_lhr1,5] on broker 15: Expanding ISR for partition network_activity_lhr1-5 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,290] INFO Partition [georrlite,0] on broker 15: Expanding ISR for partition georrlite-0 from 15,3 to 15,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,297] INFO Partition [network_activity_ams1_dfw2,7] on broker 15: Expanding ISR for partition network_activity_ams1_dfw2-7 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,314] INFO Partition [merge_ifc_ff_ams1,0] on broker 15: Expanding ISR for partition merge_ifc_ff_ams1-0 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,314] INFO Partition [network_activity_ams1_global,7] on broker 15: Expanding ISR for partition network_activity_ams1_global-7 from 15,3 to 15,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,316] INFO Partition [egret_lambda_NWClickCPC_ams1_enhanced,1] on broker 15: Expanding ISR for partition egret_lambda_NWClickCPC_ams1_enhanced-1 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,322] INFO Partition [supplyRR,29] on broker 15: Expanding ISR for partition supplyRR-29 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,331] INFO Partition [merge_network_click_cpm_ams1,0] on broker 15: Expanding ISR for partition merge_network_click_cpm_ams1-0 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,368] INFO Partition [network_render_cpm_ams1,13] on broker 15: Expanding ISR for partition network_render_cpm_ams1-13 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,370] INFO Partition [georrcore,16] on broker 15: Expanding ISR for partition georrcore-16 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,417] INFO Partition [rr,4] on broker 15: Expanding ISR for partition rr-4 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:16,541] INFO Rolled new log segment for 'egret_lambda_NWClickCPC_ams1_defer-0' in 5 ms. (kafka.log.Log) [2018-03-14 05:02:19,018] INFO Partition [beeswax_bid_logs,0] on broker 15: Expanding ISR for partition beeswax_bid_logs-0 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,031] INFO Partition [network_activity_ams1_pek1,6] on broker 15: Expanding ISR for partition network_activity_ams1_pek1-6 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,033] INFO Partition [appd-debug,14] on broker 15: Expanding ISR for partition appd-debug-14 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,038] INFO Partition [adhoc_network_click_ams1_ams1,5] on broker 15: Expanding ISR for partition adhoc_network_click_ams1_ams1-5 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,047] INFO Partition [attribute_change-core,2] on broker 15: Expanding ISR for partition attribute_change-core-2 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,048] INFO Partition [render_cpc_ams1,10] on broker 15: Expanding ISR for partition render_cpc_ams1-10 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,131] INFO Partition [sdk_health_monitoring,10] on broker 15: Expanding ISR for partition sdk_health_monitoring-10 from 15,16 to 15,16,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,208] INFO Partition [audience-attributes_ams1,6] on broker 15: Expanding ISR for partition audience-attributes_ams1-6 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,339] INFO Partition [network_render_cpc_ams1_pek1,2] on broker 15: Expanding ISR for partition network_render_cpc_ams1_pek1-2 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,425] INFO Partition [audience-attributes_ams1_ams1,11] on broker 15: Expanding ISR for partition audience-attributes_ams1_ams1-11 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,435] INFO Partition [network_render_cpc_ams1_global,4] on broker 15: Expanding ISR for partition network_render_cpc_ams1_global-4 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,440] INFO Partition [ifc_organic_activity_ams1_ams1,0] on broker 15: Expanding ISR for partition ifc_organic_activity_ams1_ams1-0 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,449] INFO Partition [network_click_pek1,11] on broker 15: Expanding ISR for partition network_click_pek1-11 from 15,1 to 15,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:24,172] INFO Rolled new log segment for 'network_click_ams1_global-14' in 4 ms. (kafka.log.Log) [2018-03-14 05:02:34,070] INFO [ReplicaFetcherThread-2-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,070] INFO [ReplicaFetcherThread-2-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,076] INFO [ReplicaFetcherThread-5-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,077] INFO [ReplicaFetcherThread-5-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,077] INFO [ReplicaFetcherThread-5-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,083] INFO [ReplicaFetcherThread-9-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,083] INFO [ReplicaFetcherThread-9-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,083] INFO [ReplicaFetcherThread-9-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,090] INFO [ReplicaFetcherThread-4-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,090] INFO [ReplicaFetcherThread-4-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,090] INFO [ReplicaFetcherThread-4-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,097] INFO [ReplicaFetcherThread-7-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,097] INFO [ReplicaFetcherThread-7-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,097] INFO [ReplicaFetcherThread-7-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,104] INFO [ReplicaFetcherThread-1-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,104] INFO [ReplicaFetcherThread-1-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,104] INFO [ReplicaFetcherThread-1-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,112] INFO [ReplicaFetcherThread-10-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,112] INFO [ReplicaFetcherThread-10-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,112] INFO [ReplicaFetcherThread-10-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,119] INFO [ReplicaFetcherThread-8-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,119] INFO [ReplicaFetcherThread-8-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,119] INFO [ReplicaFetcherThread-8-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,132] INFO [ReplicaFetcherThread-6-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,132] INFO [ReplicaFetcherThread-6-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:34,132] INFO [ReplicaFetcherThread-6-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:45,001] INFO Deleting segment 0 from log __consumer_offsets-9. (kafka.log.Log) [2018-03-14 05:02:45,001] INFO Deleting segment 90634 from log __consumer_offsets-9. (kafka.log.Log) [2018-03-14 05:02:45,004] INFO Deleting index /data/d1/kafka/__consumer_offsets-9/00000000000000000000.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:45,009] INFO Deleting index /data/d1/kafka/__consumer_offsets-9/00000000000000000000.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:45,007] INFO Deleting index /data/d1/kafka/__consumer_offsets-9/00000000000000090634.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:45,010] INFO Deleting index /data/d1/kafka/__consumer_offsets-9/00000000000000090634.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:03:20,428] INFO Rolled new log segment for 'ifcp_ams1-11' in 2 ms. (kafka.log.Log) [2018-03-14 05:03:25,076] INFO Rolled new log segment for 'sdk_metrics-0' in 4 ms. (kafka.log.Log) [2018-03-14 05:03:26,517] INFO [GroupCoordinator 15]: Preparing to restabilize group RenderCPM_ams1_deferSpout with old generation 253 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:03:51,492] INFO Rolled new log segment for 'merge_network_beacon_adunit_interaction_ams1-0' in 4 ms. (kafka.log.Log) [2018-03-14 05:04:11,922] INFO Rolled new log segment for 'ifcp_ams1-6' in 16 ms. (kafka.log.Log) [2018-03-14 05:04:12,465] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions sdk_health_monitoring-10 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:12,465] INFO Truncating log sdk_health_monitoring-10 to offset 7441292. (kafka.log.Log) [2018-03-14 05:04:12,491] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([sdk_health_monitoring-10, initOffset 7441292 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:12,492] INFO [ReplicaFetcherThread-4-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:12,520] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions network_activity_ams1_pek1-6 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:12,520] INFO Truncating log network_activity_ams1_pek1-6 to offset 0. (kafka.log.Log) [2018-03-14 05:04:12,541] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([network_activity_ams1_pek1-6, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:12,542] INFO [ReplicaFetcherThread-7-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,002] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions network_click_ams1-12 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,002] INFO Truncating log network_click_ams1-12 to offset 5415024. (kafka.log.Log) [2018-03-14 05:04:13,018] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([network_click_ams1-12, initOffset 5415024 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,019] INFO [ReplicaFetcherThread-6-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,055] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions network_render_cpm_dfw2-4 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,055] INFO Truncating log network_render_cpm_dfw2-4 to offset 5136083. (kafka.log.Log) [2018-03-14 05:04:13,089] INFO [ReplicaFetcherThread-0-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,089] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([network_render_cpm_dfw2-4, initOffset 5136083 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,195] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions adhoc_network_click_ams1_ams1-5 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,195] INFO Truncating log adhoc_network_click_ams1_ams1-5 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,214] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([adhoc_network_click_ams1_ams1-5, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,333] ERROR [ReplicaFetcherThread-7-14], Error for partition [ifc_activity_ams1_dfw1,1] to broker 14:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,335] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions ifc_organic_activity_ams1_ams1-0 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,335] INFO Truncating log ifc_organic_activity_ams1_ams1-0 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,362] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([ifc_organic_activity_ams1_ams1-0, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,363] INFO [ReplicaFetcherThread-8-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,378] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions ifc_activity_ams1_dfw1-1 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,378] INFO Truncating log ifc_activity_ams1_dfw1-1 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,396] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([ifc_activity_ams1_dfw1-1, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,485] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions render_cpc_ams1-10 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,485] INFO Truncating log render_cpc_ams1-10 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,539] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([render_cpc_ams1-10, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,541] INFO [ReplicaFetcherThread-10-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,593] ERROR [ReplicaFetcherThread-1-14], Error for partition [merge_network_render_cpc_ams1,5] to broker 14:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,676] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions merge_network_render_cpc_ams1-5 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,676] INFO Truncating log merge_network_render_cpc_ams1-5 to offset 47236296. (kafka.log.Log) [2018-03-14 05:04:13,692] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([merge_network_render_cpc_ams1-5, initOffset 47236296 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,693] INFO [ReplicaFetcherThread-1-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,714] ERROR [ReplicaFetcherThread-0-14], Error for partition [sdkpubreq,7] to broker 14:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,734] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions sdkpubreq-7 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,734] INFO Truncating log sdkpubreq-7 to offset 2859688120. (kafka.log.Log) [2018-03-14 05:04:13,755] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([sdkpubreq-7, initOffset 2859688120 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,763] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions network_click_pek1-11 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,763] INFO Truncating log network_click_pek1-11 to offset 48199. (kafka.log.Log) [2018-03-14 05:04:13,778] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([network_click_pek1-11, initOffset 48199 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,818] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions attribute_change-core-2 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,818] INFO Truncating log attribute_change-core-2 to offset 153074166. (kafka.log.Log) [2018-03-14 05:04:13,899] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([attribute_change-core-2, initOffset 153074166 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,900] INFO [ReplicaFetcherThread-3-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,913] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions audience-attributes_ams1_ams1-11 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,914] INFO Truncating log audience-attributes_ams1_ams1-11 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,947] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([audience-attributes_ams1_ams1-11, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,960] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions network_render_cpc_ams1_pek1-2 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,960] INFO Truncating log network_render_cpc_ams1_pek1-2 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,976] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([network_render_cpc_ams1_pek1-2, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,976] INFO [ReplicaFetcherThread-5-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:14,090] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions beaconDefaultAms1-5 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,090] INFO Truncating log beaconDefaultAms1-5 to offset 1082626542. (kafka.log.Log) [2018-03-14 05:04:14,231] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([beaconDefaultAms1-5, initOffset 1082626542 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,250] INFO [ReplicaFetcherThread-2-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:14,284] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions appd-debug-14 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,284] INFO Truncating log appd-debug-14 to offset 0. (kafka.log.Log) [2018-03-14 05:04:14,297] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([appd-debug-14, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,341] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions beacon_rr_ams1_cpm_render-4 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,341] INFO Truncating log beacon_rr_ams1_cpm_render-4 to offset 909631120. (kafka.log.Log) [2018-03-14 05:04:14,355] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([beacon_rr_ams1_cpm_render-4, initOffset 909631120 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,612] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions nested_activity_add-appd-5 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,612] INFO Truncating log nested_activity_add-appd-5 to offset 0. (kafka.log.Log) [2018-03-14 05:04:14,628] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([nested_activity_add-appd-5, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,631] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions beeswax_bid_logs-0 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,631] INFO Truncating log beeswax_bid_logs-0 to offset 0. (kafka.log.Log) [2018-03-14 05:04:14,645] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([beeswax_bid_logs-0, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,689] ERROR [ReplicaFetcherThread-0-14], Error for partition [network_render_cpc_dfw2,2] to broker 14:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:14,700] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions network_render_cpc_dfw2-2 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,700] INFO Truncating log network_render_cpc_dfw2-2 to offset 8038881. (kafka.log.Log) [2018-03-14 05:04:14,720] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([network_render_cpc_dfw2-2, initOffset 8038881 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,845] ERROR [ReplicaFetcherThread-2-2], Error for partition [nested_activity_add-appd,5] to broker 2:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:14,852] ERROR [ReplicaFetcherThread-0-2], Error for partition [network_render_cpc_dfw2,2] to broker 2:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:14,955] ERROR [ReplicaFetcherThread-9-14], Error for partition [nonNwClickInvalidAms1,0] to broker 14:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:15,080] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions nonNwClickInvalidAms1-0 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,080] INFO Truncating log nonNwClickInvalidAms1-0 to offset 0. (kafka.log.Log) [2018-03-14 05:04:15,115] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([nonNwClickInvalidAms1-0, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,115] INFO [ReplicaFetcherThread-9-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:15,120] ERROR [ReplicaFetcherThread-9-2], Error for partition [nonNwClickInvalidAms1,0] to broker 2:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:15,192] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions network_render_cpc_ams1_global-4 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,192] INFO Truncating log network_render_cpc_ams1_global-4 to offset 37382. (kafka.log.Log) [2018-03-14 05:04:15,212] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([network_render_cpc_ams1_global-4, initOffset 37382 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,249] INFO [ReplicaFetcherManager on broker 15] Removed fetcher for partitions audience-attributes_ams1-6 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,249] INFO Truncating log audience-attributes_ams1-6 to offset 1208372. (kafka.log.Log) [2018-03-14 05:04:15,267] INFO [ReplicaFetcherManager on broker 15] Added fetcher for partitions List([audience-attributes_ams1-6, initOffset 1208372 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:20,401] INFO Rolled new log segment for 'egret_lambda_AdUnitBeacon_ams1_enhanced-6' in 7 ms. (kafka.log.Log) [2018-03-14 05:04:34,673] INFO Rolled new log segment for 'egret_lambda_AdUnitBeacon_ams1_enhanced-0' in 6 ms. (kafka.log.Log) [2018-03-14 05:04:41,276] INFO Scheduling log segment 1008162178 for log egret_lambda_AdUnitPublisherFill_ams1_enhanced-3 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,280] INFO Scheduling log segment 1040677216 for log beaconDefaultAms1-5 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,281] INFO Scheduling log segment 1127553013 for log sdk_metrics-4 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,296] INFO Scheduling log segment 4195574881 for log supplyRR-7 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,321] INFO Scheduling log segment 4480006818 for log user_context-6 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,322] INFO Scheduling log segment 4803070013 for log cas_rr-14 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,328] INFO Scheduling log segment 825792635 for log egret_lambda_AdUnitBeacon_ams1_enhanced-0 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,329] INFO Scheduling log segment 825832337 for log egret_lambda_AdUnitBeacon_ams1_enhanced-1 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,333] INFO Scheduling log segment 3851691345 for log cas_rr-17 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,333] INFO Scheduling log segment 650132477 for log egret_lambda_BillingCPM_ams1_enhanced-3 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,339] INFO Scheduling log segment 386123 for log audit_consumer-4 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,340] INFO Scheduling log segment 4749717299 for log perfRR-10 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,341] INFO Scheduling log segment 4480111895 for log user_context-0 for deletion. (kafka.log.Log) [2018-03-14 05:04:41,346] INFO Scheduling log segment 1301213957 for log merge_beacon_rr_ams1_default-1 for deletion. (kafka.log.Log) [2018-03-14 05:04:45,302] INFO Rolled new log segment for 'egret_lambda_AdUnitBeacon_ams1_enhanced-1' in 5 ms. (kafka.log.Log) [2018-03-14 05:04:45,893] INFO Rolled new log segment for '__consumer_offsets-39' in 3 ms. (kafka.log.Log) [2018-03-14 05:04:50,083] INFO Rolled new log segment for 'network_click_ams1_global-4' in 5 ms. (kafka.log.Log) [2018-03-14 05:04:58,316] INFO Rolled new log segment for '__consumer_offsets-37' in 2 ms. (kafka.log.Log)