[2018-03-14 05:00:18,647] INFO Rolled new log segment for 'sdk_health_monitoring-12' in 170 ms. (kafka.log.Log) [2018-03-14 05:00:51,099] INFO Rolled new log segment for 'rr-15' in 52 ms. (kafka.log.Log) [2018-03-14 05:00:59,926] INFO Rolled new log segment for 'perfRR-4' in 26 ms. (kafka.log.Log) [2018-03-14 05:01:03,822] INFO Rolled new log segment for 'egret_lambda_AdUnitBeacon_ams1_enhanced-2' in 2 ms. (kafka.log.Log) [2018-03-14 05:01:32,140] INFO Scheduling log segment 4741033904 for log perfRR-19 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,140] INFO Scheduling log segment 1040639616 for log beaconDefaultAms1-7 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,174] INFO Scheduling log segment 1008163380 for log egret_lambda_AdUnitPublisherFill_ams1_enhanced-0 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,174] INFO Scheduling log segment 1127282161 for log sdk_metrics-2 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,241] INFO Scheduling log segment 3814698 for log sdk_health_monitoring-28 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,245] INFO Scheduling log segment 5965330010 for log cas_rr-1 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,301] INFO Scheduling log segment 21005 for log network_render_cpc_ams1_global-5 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,304] INFO Scheduling log segment 3977049510 for log ifcp_ams1-7 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,362] INFO Scheduling log segment 2732612944 for log rr-33 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,432] INFO Scheduling log segment 3872877 for log sdk_health_monitoring-12 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,433] INFO Scheduling log segment 4479837686 for log user_context-8 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,499] INFO Scheduling log segment 3662023592 for log nested_activity_add-network-1 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,499] INFO Scheduling log segment 383411 for log audit_consumer-7 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,547] INFO Scheduling log segment 912166394 for log egret_lambda_BillingCPM_ams1_enhanced-0 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,636] INFO Scheduling log segment 825832302 for log egret_lambda_AdUnitBeacon_ams1_enhanced-1 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,650] INFO Scheduling log segment 800262 for log network_beacon_lhr1_adunit-5 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,652] INFO Scheduling log segment 155248 for log nonNwClickCpcAms1-1 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,653] INFO Scheduling log segment 4297119959 for log rr-15 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,653] INFO Scheduling log segment 2568638713 for log napp-43 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,654] INFO Scheduling log segment 825695765 for log egret_lambda_AdUnitBeacon_ams1_enhanced-7 for deletion. (kafka.log.Log) [2018-03-14 05:01:32,835] INFO Rolled new log segment for '__consumer_offsets-9' in 0 ms. (kafka.log.Log) [2018-03-14 05:01:40,752] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-9. (kafka.log.LogCleaner) [2018-03-14 05:01:40,752] INFO Cleaner 0: Building offset map for __consumer_offsets-9... (kafka.log.LogCleaner) [2018-03-14 05:01:40,779] INFO Cleaner 0: Building offset map for log __consumer_offsets-9 for 1 segments in offset range [90634, 93034). (kafka.log.LogCleaner) [2018-03-14 05:01:40,781] INFO Cleaner 0: Offset map for log __consumer_offsets-9 complete. (kafka.log.LogCleaner) [2018-03-14 05:01:40,781] INFO Cleaner 0: Cleaning log __consumer_offsets-9 (cleaning prior to Wed Mar 14 05:01:30 UTC 2018, discarding tombstones prior to Tue Mar 13 04:01:29 UTC 2018)... (kafka.log.LogCleaner) [2018-03-14 05:01:40,781] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-9 (largest timestamp Wed Mar 14 04:01:29 UTC 2018) into 0, retaining deletes. (kafka.log.LogCleaner) [2018-03-14 05:01:40,803] INFO Cleaner 0: Cleaning segment 90634 in log __consumer_offsets-9 (largest timestamp Wed Mar 14 05:01:30 UTC 2018) into 0, retaining deletes. (kafka.log.LogCleaner) [2018-03-14 05:01:40,829] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0,90634 in log __consumer_offsets-9. (kafka.log.LogCleaner) [2018-03-14 05:01:40,830] INFO [kafka-log-cleaner-thread-0], [2018-03-14 05:01:53,192] INFO Partition [egret_lambda_AdUnitPublisherFill_ams1_enhanced,0] on broker 1: Shrinking ISR for partition [egret_lambda_AdUnitPublisherFill_ams1_enhanced,0] from 1,2,12 to 1,12 (kafka.cluster.Partition) [2018-03-14 05:01:53,201] INFO Partition [non_nw_click_cpm_ams1,1] on broker 1: Shrinking ISR for partition [non_nw_click_cpm_ams1,1] from 1,3,2 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,205] INFO Partition [supplyRR,9] on broker 1: Shrinking ISR for partition [supplyRR,9] from 1,12,2 to 1,12 (kafka.cluster.Partition) [2018-03-14 05:01:53,212] INFO Partition [adroit_report_obj_ams1,0] on broker 1: Shrinking ISR for partition [adroit_report_obj_ams1,0] from 1,2,15 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,226] INFO Partition [attribute_change-brand,3] on broker 1: Shrinking ISR for partition [attribute_change-brand,3] from 1,3,2 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,233] INFO Partition [ttd-beacon,10] on broker 1: Shrinking ISR for partition [ttd-beacon,10] from 1,2,15 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,238] INFO Partition [ifc_activity_low_freq,0] on broker 1: Shrinking ISR for partition [ifc_activity_low_freq,0] from 1,3,2 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,245] INFO Partition [merge_ifc_organic_activity_ams1,0] on broker 1: Shrinking ISR for partition [merge_ifc_organic_activity_ams1,0] from 1,15,2 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,252] INFO Partition [custom_type_record_update-appduserrenderhistory,1] on broker 1: Shrinking ISR for partition [custom_type_record_update-appduserrenderhistory,1] from 1,15,2 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,258] INFO Partition [beacon_rr_corp_default,0] on broker 1: Shrinking ISR for partition [beacon_rr_corp_default,0] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,264] INFO Partition [beacon_rr_dfw1_cpm_render,1] on broker 1: Shrinking ISR for partition [beacon_rr_dfw1_cpm_render,1] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,275] INFO Partition [ifcp_ams1,8] on broker 1: Shrinking ISR for partition [ifcp_ams1,8] from 1,2,12 to 1,12 (kafka.cluster.Partition) [2018-03-14 05:01:53,281] INFO Partition [brand_attributes_ams1_ams1,5] on broker 1: Shrinking ISR for partition [brand_attributes_ams1_ams1,5] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,286] INFO Partition [network_render_cpm_ams1_ams1,2] on broker 1: Shrinking ISR for partition [network_render_cpm_ams1_ams1,2] from 1,2,15 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,296] INFO Partition [network_attribute_ams1_pek1,11] on broker 1: Shrinking ISR for partition [network_attribute_ams1_pek1,11] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,303] INFO Partition [network_click_dfw2,1] on broker 1: Shrinking ISR for partition [network_click_dfw2,1] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,315] INFO Partition [audience-attributes_lhr1,5] on broker 1: Shrinking ISR for partition [audience-attributes_lhr1,5] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,321] INFO Partition [merge_ifc_ff_ams1,1] on broker 1: Shrinking ISR for partition [merge_ifc_ff_ams1,1] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,326] INFO Partition [cas_rr,8] on broker 1: Shrinking ISR for partition [cas_rr,8] from 1,2,8 to 1,8 (kafka.cluster.Partition) [2018-03-14 05:01:53,343] INFO Partition [network_activity_ams1_dfw2,8] on broker 1: Shrinking ISR for partition [network_activity_ams1_dfw2,8] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,355] INFO Partition [__consumer_offsets,10] on broker 1: Shrinking ISR for partition [__consumer_offsets,10] from 1,15,2 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,362] INFO Partition [network_activity_ams1,3] on broker 1: Shrinking ISR for partition [network_activity_ams1,3] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,367] INFO Partition [merge_fds_ams1,1] on broker 1: Shrinking ISR for partition [merge_fds_ams1,1] from 1,15,2 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,373] INFO Partition [network_attribute_ams1_global,14] on broker 1: Shrinking ISR for partition [network_attribute_ams1_global,14] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,378] INFO Partition [photon_appd_flat_activity_ams1,1] on broker 1: Shrinking ISR for partition [photon_appd_flat_activity_ams1,1] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,385] INFO Partition [network_activity_dfw1,9] on broker 1: Shrinking ISR for partition [network_activity_dfw1,9] from 1,15,2 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,393] INFO Partition [user_context,8] on broker 1: Shrinking ISR for partition [user_context,8] from 1,2,8 to 1,8 (kafka.cluster.Partition) [2018-03-14 05:01:53,402] INFO Partition [merge_network_click_invalid_ams1,0] on broker 1: Shrinking ISR for partition [merge_network_click_invalid_ams1,0] from 1,2,15 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,410] INFO Partition [ifcp_ams1,26] on broker 1: Shrinking ISR for partition [ifcp_ams1,26] from 1,13,2 to 1,13 (kafka.cluster.Partition) [2018-03-14 05:01:53,418] INFO Partition [georrcore,17] on broker 1: Shrinking ISR for partition [georrcore,17] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,426] INFO Partition [network_render_cpm_ams1,14] on broker 1: Shrinking ISR for partition [network_render_cpm_ams1,14] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,433] INFO Partition [photon_appd_flat_activity_dfw2,2] on broker 1: Shrinking ISR for partition [photon_appd_flat_activity_dfw2,2] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,449] INFO Partition [web_postbacks,4] on broker 1: Shrinking ISR for partition [web_postbacks,4] from 1,15,2 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,456] INFO Partition [renderCpmAms1,10] on broker 1: Shrinking ISR for partition [renderCpmAms1,10] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,464] INFO Partition [wadogorr,2] on broker 1: Shrinking ISR for partition [wadogorr,2] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,473] INFO Partition [network_attribute_ams1_dfw1,14] on broker 1: Shrinking ISR for partition [network_attribute_ams1_dfw1,14] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,490] INFO Partition [audit_consumer,6] on broker 1: Shrinking ISR for partition [audit_consumer,6] from 1,2,15 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,499] INFO Partition [network_render_cpc_lhr1,4] on broker 1: Shrinking ISR for partition [network_render_cpc_lhr1,4] from 1,15,2 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,511] INFO Partition [merge_network_beacon_ams1_adunit,0] on broker 1: Shrinking ISR for partition [merge_network_beacon_ams1_adunit,0] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,549] INFO Partition [ifc_organic_activity_ams1,0] on broker 1: Shrinking ISR for partition [ifc_organic_activity_ams1,0] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,562] INFO Partition [network_render_cpm_lhr1,9] on broker 1: Shrinking ISR for partition [network_render_cpm_lhr1,9] from 1,2,15 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,626] INFO Partition [merge_beacon_rr_ams1_default,2] on broker 1: Shrinking ISR for partition [merge_beacon_rr_ams1_default,2] from 2,1,13 to 1,13 (kafka.cluster.Partition) [2018-03-14 05:01:53,635] INFO Partition [network_click_lhr1,0] on broker 1: Shrinking ISR for partition [network_click_lhr1,0] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,645] INFO Partition [custom_type_record_update-ifc,8] on broker 1: Shrinking ISR for partition [custom_type_record_update-ifc,8] from 1,2,15 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,655] INFO Partition [custom_type_record_update-ifcinorg,4] on broker 1: Shrinking ISR for partition [custom_type_record_update-ifcinorg,4] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,676] INFO Partition [audit_producer,2] on broker 1: Shrinking ISR for partition [audit_producer,2] from 1,2,15 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,683] INFO Partition [audience-attributes_dfw2,2] on broker 1: Shrinking ISR for partition [audience-attributes_dfw2,2] from 1,15,2 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,699] INFO Partition [network_activity_lhr1,6] on broker 1: Shrinking ISR for partition [network_activity_lhr1,6] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,707] INFO Partition [profile_delete-ams1_ams1,4] on broker 1: Shrinking ISR for partition [profile_delete-ams1_ams1,4] from 1,15,2 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,715] INFO Partition [__consumer_offsets,25] on broker 1: Shrinking ISR for partition [__consumer_offsets,25] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,724] INFO Partition [napp,7] on broker 1: Shrinking ISR for partition [napp,7] from 1,15,2 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,733] INFO Partition [adhoc_network_attribute_ams1_ams1,10] on broker 1: Shrinking ISR for partition [adhoc_network_attribute_ams1_ams1,10] from 1,15,2 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,756] INFO Partition [merge_network_click_cpm_ams1,1] on broker 1: Shrinking ISR for partition [merge_network_click_cpm_ams1,1] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:53,761] INFO Partition [network_attribute_pek1,7] on broker 1: Shrinking ISR for partition [network_attribute_pek1,7] from 1,2,15 to 1,15 (kafka.cluster.Partition) [2018-03-14 05:01:53,772] INFO Partition [ifc_organic_activity_ams1_dfw2,2] on broker 1: Shrinking ISR for partition [ifc_organic_activity_ams1_dfw2,2] from 1,2,3 to 1,3 (kafka.cluster.Partition) [2018-03-14 05:01:58,110] INFO Creating /controller (is it secure? true) (kafka.utils.ZKCheckedEphemeral) [2018-03-14 05:01:58,155] INFO Result of znode creation is: NODEEXISTS (kafka.utils.ZKCheckedEphemeral) [2018-03-14 05:01:58,219] INFO New leader is 12 (kafka.server.ZookeeperLeaderElector$LeaderChangeListener) [2018-03-14 05:02:07,039] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions merge_fds_ams1-2,custom_type_record_update-appduserrenderhistory-2,merge_network_click_invalid_ams1-1,network_click_invalid_dfw2-0,audit_consumer_count-0,profile_delete-ams1_ams1-5,adhoc_network_attribute_ams1_ams1-11,audit_producer-3,network_render_cpc_lhr1-5,web_postbacks-5,network_attribute_pek1-8,audit_consumer-7,__consumer_offsets-11,napp-8,network_conversion_ams1_dfw2-0,merge_ifc_organic_activity_ams1-1,network_activity_dfw1-10,network_render_cpm_lhr1-10,ttd-beacon-11,custom_type_record_update-ifc-9,adroit_report_obj_ams1-1,network_render_cpm_ams1_ams1-3 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:02:07,040] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions adhoc_network_click_ams1_ams1-5,attribute_change-core-2,network_render_cpc_ams1_pek1-2,network_click_pek1-11,audience-attributes_ams1_ams1-11,appd-debug-14,network_render_cpc_ams1_global-4,network_activity_ams1_pek1-6,beeswax_bid_logs-0,audience-attributes_ams1-6,render_cpc_ams1-10,cas_rr-21,ifc_organic_activity_ams1_ams1-0 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:02:07,040] INFO Truncating log beeswax_bid_logs-0 to offset 0. (kafka.log.Log) [2018-03-14 05:02:07,040] INFO Truncating log ifc_organic_activity_ams1_ams1-0 to offset 0. (kafka.log.Log) [2018-03-14 05:02:07,040] INFO Truncating log network_click_pek1-11 to offset 48199. (kafka.log.Log) [2018-03-14 05:02:07,040] INFO Truncating log render_cpc_ams1-10 to offset 0. (kafka.log.Log) [2018-03-14 05:02:07,040] INFO Truncating log audience-attributes_ams1_ams1-11 to offset 0. (kafka.log.Log) [2018-03-14 05:02:07,040] INFO Truncating log network_render_cpc_ams1_global-4 to offset 37381. (kafka.log.Log) [2018-03-14 05:02:07,040] INFO Truncating log attribute_change-core-2 to offset 153063415. (kafka.log.Log) [2018-03-14 05:02:07,041] INFO Truncating log appd-debug-14 to offset 0. (kafka.log.Log) [2018-03-14 05:02:07,041] INFO Truncating log audience-attributes_ams1-6 to offset 1208348. (kafka.log.Log) [2018-03-14 05:02:07,041] INFO Truncating log cas_rr-21 to offset 1516504317. (kafka.log.Log) [2018-03-14 05:02:07,041] INFO Truncating log network_render_cpc_ams1_pek1-2 to offset 0. (kafka.log.Log) [2018-03-14 05:02:07,041] INFO Truncating log network_activity_ams1_pek1-6 to offset 0. (kafka.log.Log) [2018-03-14 05:02:07,041] INFO Truncating log adhoc_network_click_ams1_ams1-5 to offset 0. (kafka.log.Log) [2018-03-14 05:02:07,059] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([beeswax_bid_logs-0, initOffset 0 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] , [ifc_organic_activity_ams1_ams1-0, initOffset 0 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] , [network_click_pek1-11, initOffset 48199 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] , [render_cpc_ams1-10, initOffset 0 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] , [audience-attributes_ams1_ams1-11, initOffset 0 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] , [network_render_cpc_ams1_global-4, initOffset 37381 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] , [attribute_change-core-2, initOffset 153063415 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] , [appd-debug-14, initOffset 0 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] , [audience-attributes_ams1-6, initOffset 1208348 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] , [cas_rr-21, initOffset 1516504317 to broker BrokerEndPoint(17,azkf4017.grid.ams1.inmobi.com,9093)] , [network_render_cpc_ams1_pek1-2, initOffset 0 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] , [network_activity_ams1_pek1-6, initOffset 0 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] , [adhoc_network_click_ams1_ams1-5, initOffset 0 to broker BrokerEndPoint(15,azkf4015.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:02:07,059] INFO [ReplicaFetcherThread-0-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,152] INFO [ReplicaFetcherThread-0-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,152] INFO [ReplicaFetcherThread-0-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,161] INFO [ReplicaFetcherThread-3-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,376] INFO [ReplicaFetcherThread-3-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,376] INFO [ReplicaFetcherThread-3-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,382] INFO [ReplicaFetcherThread-2-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,383] INFO [ReplicaFetcherThread-2-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,383] INFO [ReplicaFetcherThread-2-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:08,388] INFO [ReplicaFetcherThread-5-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,626] INFO [ReplicaFetcherThread-5-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,626] INFO [ReplicaFetcherThread-5-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,633] INFO [ReplicaFetcherThread-9-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,633] INFO [ReplicaFetcherThread-9-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,633] INFO [ReplicaFetcherThread-9-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,638] INFO [ReplicaFetcherThread-7-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,638] INFO [ReplicaFetcherThread-7-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,638] INFO [ReplicaFetcherThread-7-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,644] INFO [ReplicaFetcherThread-1-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,644] INFO [ReplicaFetcherThread-1-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,644] INFO [ReplicaFetcherThread-1-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,649] INFO [ReplicaFetcherThread-10-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,649] INFO [ReplicaFetcherThread-10-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,649] INFO [ReplicaFetcherThread-10-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,654] INFO [ReplicaFetcherThread-8-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,654] INFO [ReplicaFetcherThread-8-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,654] INFO [ReplicaFetcherThread-8-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,664] INFO [ReplicaFetcherThread-11-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,664] INFO [ReplicaFetcherThread-11-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,664] INFO [ReplicaFetcherThread-11-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,668] INFO [ReplicaFetcherThread-6-2], Shutting down (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,668] INFO [ReplicaFetcherThread-6-2], Stopped (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,668] INFO [ReplicaFetcherThread-6-2], Shutdown completed (kafka.server.ReplicaFetcherThread) [2018-03-14 05:02:09,672] INFO [Group Metadata Manager on Broker 1]: Loading offsets and group metadata from __consumer_offsets-11 (kafka.coordinator.GroupMetadataManager) [2018-03-14 05:02:09,680] INFO [GroupCoordinator 1]: Loading group metadata for prod-m10n-event-processor-beaconams1 with generation 8 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:02:09,680] INFO [GroupCoordinator 1]: Loading group metadata for conversionAdaptor.ams1.adroit_conversion_enhanced_ams1 with generation 0 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:02:09,680] INFO [GroupCoordinator 1]: Loading group metadata for clickAdaptor.ams1.nonNwClickCpcAms1 with generation 0 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:02:09,680] INFO [Group Metadata Manager on Broker 1]: Finished loading offsets from __consumer_offsets-11 in 8 milliseconds. (kafka.coordinator.GroupMetadataManager) [2018-03-14 05:02:10,697] INFO Rolled new log segment for 'audit_consumer-7' in 0 ms. (kafka.log.Log) [2018-03-14 05:02:12,265] INFO [GroupCoordinator 1]: Preparing to restabilize group prod-m10n-event-processor-beaconams1 with old generation 8 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:02:14,070] INFO Partition [merge_fds_ams1,1] on broker 1: Expanding ISR for partition merge_fds_ams1-1 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,070] INFO Partition [ifc_organic_activity_ams1_dfw2,2] on broker 1: Expanding ISR for partition ifc_organic_activity_ams1_dfw2-2 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,071] INFO Partition [adhoc_network_attribute_ams1_ams1,10] on broker 1: Expanding ISR for partition adhoc_network_attribute_ams1_ams1-10 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,074] INFO Partition [adroit_report_obj_ams1,0] on broker 1: Expanding ISR for partition adroit_report_obj_ams1-0 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,074] INFO Partition [network_render_cpm_lhr1,9] on broker 1: Expanding ISR for partition network_render_cpm_lhr1-9 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,075] INFO Partition [network_click_dfw2,1] on broker 1: Expanding ISR for partition network_click_dfw2-1 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,084] INFO Partition [brand_attributes_ams1_ams1,5] on broker 1: Expanding ISR for partition brand_attributes_ams1_ams1-5 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,084] INFO Partition [ttd-beacon,10] on broker 1: Expanding ISR for partition ttd-beacon-10 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,084] INFO Partition [__consumer_offsets,10] on broker 1: Expanding ISR for partition __consumer_offsets-10 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,085] INFO Partition [photon_appd_flat_activity_dfw2,2] on broker 1: Expanding ISR for partition photon_appd_flat_activity_dfw2-2 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,089] INFO Partition [custom_type_record_update-ifc,8] on broker 1: Expanding ISR for partition custom_type_record_update-ifc-8 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,089] INFO Partition [non_nw_click_cpm_ams1,1] on broker 1: Expanding ISR for partition non_nw_click_cpm_ams1-1 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,089] INFO Partition [network_activity_lhr1,6] on broker 1: Expanding ISR for partition network_activity_lhr1-6 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,097] INFO Partition [web_postbacks,4] on broker 1: Expanding ISR for partition web_postbacks-4 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,097] INFO Partition [network_attribute_ams1_global,14] on broker 1: Expanding ISR for partition network_attribute_ams1_global-14 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,104] INFO Partition [beacon_rr_corp_default,0] on broker 1: Expanding ISR for partition beacon_rr_corp_default-0 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,106] INFO Partition [custom_type_record_update-ifcinorg,4] on broker 1: Expanding ISR for partition custom_type_record_update-ifcinorg-4 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,114] INFO Partition [network_attribute_ams1_dfw1,14] on broker 1: Expanding ISR for partition network_attribute_ams1_dfw1-14 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,114] INFO Partition [network_render_cpm_ams1_ams1,2] on broker 1: Expanding ISR for partition network_render_cpm_ams1_ams1-2 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,122] INFO Partition [merge_network_click_invalid_ams1,0] on broker 1: Expanding ISR for partition merge_network_click_invalid_ams1-0 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,122] INFO Partition [renderCpmAms1,10] on broker 1: Expanding ISR for partition renderCpmAms1-10 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,126] INFO Partition [photon_appd_flat_activity_ams1,1] on broker 1: Expanding ISR for partition photon_appd_flat_activity_ams1-1 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,133] INFO Partition [merge_network_beacon_ams1_adunit,0] on broker 1: Expanding ISR for partition merge_network_beacon_ams1_adunit-0 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,141] INFO Partition [__consumer_offsets,25] on broker 1: Expanding ISR for partition __consumer_offsets-25 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,142] INFO Partition [network_render_cpc_lhr1,4] on broker 1: Expanding ISR for partition network_render_cpc_lhr1-4 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,142] INFO Partition [merge_ifc_organic_activity_ams1,0] on broker 1: Expanding ISR for partition merge_ifc_organic_activity_ams1-0 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,147] INFO Partition [merge_beacon_rr_ams1_default,2] on broker 1: Expanding ISR for partition merge_beacon_rr_ams1_default-2 from 1,13 to 1,13,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,169] INFO Partition [ifc_activity_low_freq,0] on broker 1: Expanding ISR for partition ifc_activity_low_freq-0 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,192] INFO Partition [georrcore,17] on broker 1: Expanding ISR for partition georrcore-17 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,208] INFO Partition [merge_ifc_ff_ams1,1] on broker 1: Expanding ISR for partition merge_ifc_ff_ams1-1 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,209] INFO Partition [audit_consumer,6] on broker 1: Expanding ISR for partition audit_consumer-6 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,215] INFO Partition [attribute_change-brand,3] on broker 1: Expanding ISR for partition attribute_change-brand-3 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,216] INFO Partition [network_click_lhr1,0] on broker 1: Expanding ISR for partition network_click_lhr1-0 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,221] INFO Partition [network_attribute_pek1,7] on broker 1: Expanding ISR for partition network_attribute_pek1-7 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,229] INFO Partition [audience-attributes_dfw2,2] on broker 1: Expanding ISR for partition audience-attributes_dfw2-2 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,231] INFO Partition [ifcp_ams1,26] on broker 1: Expanding ISR for partition ifcp_ams1-26 from 1,13 to 1,13,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,236] INFO Partition [audience-attributes_lhr1,5] on broker 1: Expanding ISR for partition audience-attributes_lhr1-5 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,238] INFO Partition [audit_producer,2] on broker 1: Expanding ISR for partition audit_producer-2 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,243] INFO Partition [napp,7] on broker 1: Expanding ISR for partition napp-7 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,258] INFO Partition [network_attribute_ams1_pek1,11] on broker 1: Expanding ISR for partition network_attribute_ams1_pek1-11 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,263] INFO Partition [ifcp_ams1,8] on broker 1: Expanding ISR for partition ifcp_ams1-8 from 1,12 to 1,12,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,272] INFO Partition [ifc_organic_activity_ams1,0] on broker 1: Expanding ISR for partition ifc_organic_activity_ams1-0 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,289] INFO Partition [network_activity_ams1_dfw2,8] on broker 1: Expanding ISR for partition network_activity_ams1_dfw2-8 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,299] INFO Partition [profile_delete-ams1_ams1,4] on broker 1: Expanding ISR for partition profile_delete-ams1_ams1-4 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,315] INFO Partition [wadogorr,2] on broker 1: Expanding ISR for partition wadogorr-2 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,389] INFO Partition [merge_network_click_cpm_ams1,1] on broker 1: Expanding ISR for partition merge_network_click_cpm_ams1-1 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,414] INFO Partition [egret_lambda_AdUnitPublisherFill_ams1_enhanced,0] on broker 1: Expanding ISR for partition egret_lambda_AdUnitPublisherFill_ams1_enhanced-0 from 1,12 to 1,12,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,414] INFO Partition [network_render_cpm_ams1,14] on broker 1: Expanding ISR for partition network_render_cpm_ams1-14 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,428] INFO Partition [beacon_rr_dfw1_cpm_render,1] on broker 1: Expanding ISR for partition beacon_rr_dfw1_cpm_render-1 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,430] INFO Partition [custom_type_record_update-appduserrenderhistory,1] on broker 1: Expanding ISR for partition custom_type_record_update-appduserrenderhistory-1 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,460] INFO Partition [network_activity_dfw1,9] on broker 1: Expanding ISR for partition network_activity_dfw1-9 from 1,15 to 1,15,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,468] INFO Partition [network_activity_ams1,3] on broker 1: Expanding ISR for partition network_activity_ams1-3 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,479] INFO Partition [supplyRR,9] on broker 1: Expanding ISR for partition supplyRR-9 from 1,12 to 1,12,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,494] INFO Partition [cas_rr,8] on broker 1: Expanding ISR for partition cas_rr-8 from 1,8 to 1,8,2 (kafka.cluster.Partition) [2018-03-14 05:02:14,495] INFO Partition [user_context,8] on broker 1: Expanding ISR for partition user_context-8 from 1,8 to 1,8,2 (kafka.cluster.Partition) [2018-03-14 05:02:16,541] INFO Rolled new log segment for 'egret_lambda_NWClickCPC_ams1_defer-0' in 1 ms. (kafka.log.Log) [2018-03-14 05:02:19,027] INFO Partition [web_postbacks,5] on broker 1: Expanding ISR for partition web_postbacks-5 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,031] INFO Partition [network_conversion_ams1_dfw2,0] on broker 1: Expanding ISR for partition network_conversion_ams1_dfw2-0 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,036] INFO Partition [custom_type_record_update-ifc,9] on broker 1: Expanding ISR for partition custom_type_record_update-ifc-9 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,041] INFO Partition [audit_producer,3] on broker 1: Expanding ISR for partition audit_producer-3 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,042] INFO Partition [network_render_cpc_lhr1,5] on broker 1: Expanding ISR for partition network_render_cpc_lhr1-5 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,043] INFO Partition [ttd-beacon,11] on broker 1: Expanding ISR for partition ttd-beacon-11 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,044] INFO Partition [custom_type_record_update-appduserrenderhistory,2] on broker 1: Expanding ISR for partition custom_type_record_update-appduserrenderhistory-2 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,047] INFO Partition [adroit_report_obj_ams1,1] on broker 1: Expanding ISR for partition adroit_report_obj_ams1-1 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,048] INFO Partition [merge_fds_ams1,2] on broker 1: Expanding ISR for partition merge_fds_ams1-2 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,051] INFO Partition [network_attribute_pek1,8] on broker 1: Expanding ISR for partition network_attribute_pek1-8 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,130] INFO Partition [network_render_cpm_ams1_ams1,3] on broker 1: Expanding ISR for partition network_render_cpm_ams1_ams1-3 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,138] INFO Partition [__consumer_offsets,11] on broker 1: Expanding ISR for partition __consumer_offsets-11 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,154] INFO Partition [merge_network_click_invalid_ams1,1] on broker 1: Expanding ISR for partition merge_network_click_invalid_ams1-1 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,166] INFO Partition [network_activity_dfw1,10] on broker 1: Expanding ISR for partition network_activity_dfw1-10 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,211] INFO Partition [network_click_invalid_dfw2,0] on broker 1: Expanding ISR for partition network_click_invalid_dfw2-0 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,223] INFO Partition [napp,8] on broker 1: Expanding ISR for partition napp-8 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,231] INFO Partition [merge_ifc_organic_activity_ams1,1] on broker 1: Expanding ISR for partition merge_ifc_organic_activity_ams1-1 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,284] INFO Partition [audit_consumer_count,0] on broker 1: Expanding ISR for partition audit_consumer_count-0 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,294] INFO Partition [profile_delete-ams1_ams1,5] on broker 1: Expanding ISR for partition profile_delete-ams1_ams1-5 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,305] INFO Partition [adhoc_network_attribute_ams1_ams1,11] on broker 1: Expanding ISR for partition adhoc_network_attribute_ams1_ams1-11 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,333] INFO Partition [network_render_cpm_lhr1,10] on broker 1: Expanding ISR for partition network_render_cpm_lhr1-10 from 1,3 to 1,3,2 (kafka.cluster.Partition) [2018-03-14 05:02:19,335] INFO Partition [audit_consumer,7] on broker 1: Expanding ISR for partition audit_consumer-7 from 3,1 to 3,1,2 (kafka.cluster.Partition) [2018-03-14 05:02:24,199] INFO Rolled new log segment for 'network_click_ams1_global-14' in 28 ms. (kafka.log.Log) [2018-03-14 05:02:25,948] INFO Rolled new log segment for 'egret_lambda_NonNWClickCPM_ams1_defer-0' in 47 ms. (kafka.log.Log) [2018-03-14 05:02:32,140] INFO Deleting segment 4741033904 from log perfRR-19. (kafka.log.Log) [2018-03-14 05:02:32,174] INFO Deleting segment 1040639616 from log beaconDefaultAms1-7. (kafka.log.Log) [2018-03-14 05:02:32,174] INFO Deleting segment 1008163380 from log egret_lambda_AdUnitPublisherFill_ams1_enhanced-0. (kafka.log.Log) [2018-03-14 05:02:32,241] INFO Deleting segment 1127282161 from log sdk_metrics-2. (kafka.log.Log) [2018-03-14 05:02:32,241] INFO Deleting segment 3814698 from log sdk_health_monitoring-28. (kafka.log.Log) [2018-03-14 05:02:32,300] INFO Deleting segment 5965330010 from log cas_rr-1. (kafka.log.Log) [2018-03-14 05:02:32,301] INFO Deleting segment 21005 from log network_render_cpc_ams1_global-5. (kafka.log.Log) [2018-03-14 05:02:32,362] INFO Deleting segment 3977049510 from log ifcp_ams1-7. (kafka.log.Log) [2018-03-14 05:02:32,431] INFO Deleting segment 2732612944 from log rr-33. (kafka.log.Log) [2018-03-14 05:02:32,991] INFO Deleting index /data/d1/kafka/network_render_cpc_ams1_global-5/00000000000000021005.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:32,991] INFO Deleting index /data/d1/kafka/sdk_health_monitoring-28/00000000000003814698.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:32,991] INFO Deleting index /data/d1/kafka/sdk_health_monitoring-28/00000000000003814698.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:32,991] INFO Deleting segment 3872877 from log sdk_health_monitoring-12. (kafka.log.Log) [2018-03-14 05:02:32,991] INFO Deleting index /data/d1/kafka/sdk_health_monitoring-12/00000000000003872877.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:32,991] INFO Deleting index /data/d1/kafka/sdk_health_monitoring-12/00000000000003872877.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:32,991] INFO Deleting segment 4479837686 from log user_context-8. (kafka.log.Log) [2018-03-14 05:02:33,002] INFO Deleting index /data/d1/kafka/network_render_cpc_ams1_global-5/00000000000000021005.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:33,002] INFO Deleting segment 3662023592 from log nested_activity_add-network-1. (kafka.log.Log) [2018-03-14 05:02:33,007] INFO Deleting segment 383411 from log audit_consumer-7. (kafka.log.Log) [2018-03-14 05:02:33,007] INFO Deleting index /data/d1/kafka/audit_consumer-7/00000000000000383411.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:33,054] INFO Deleting index /data/d1/kafka/audit_consumer-7/00000000000000383411.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:33,054] INFO Deleting segment 912166394 from log egret_lambda_BillingCPM_ams1_enhanced-0. (kafka.log.Log) [2018-03-14 05:02:33,104] INFO Deleting index /data/d1/kafka/perfRR-19/00000000004741033904.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:33,104] INFO Deleting index /data/d1/kafka/perfRR-19/00000000004741033904.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:33,104] INFO Deleting segment 825832302 from log egret_lambda_AdUnitBeacon_ams1_enhanced-1. (kafka.log.Log) [2018-03-14 05:02:33,290] INFO Deleting index /data/d1/kafka/egret_lambda_BillingCPM_ams1_enhanced-0/00000000000912166394.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:33,290] INFO Deleting index /data/d1/kafka/egret_lambda_BillingCPM_ams1_enhanced-0/00000000000912166394.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:33,291] INFO Deleting segment 800262 from log network_beacon_lhr1_adunit-5. (kafka.log.Log) [2018-03-14 05:02:33,349] INFO Deleting index /data/d1/kafka/network_beacon_lhr1_adunit-5/00000000000000800262.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:33,349] INFO Deleting index /data/d1/kafka/network_beacon_lhr1_adunit-5/00000000000000800262.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:33,350] INFO Deleting segment 155248 from log nonNwClickCpcAms1-1. (kafka.log.Log) [2018-03-14 05:02:33,410] INFO Deleting index /data/d1/kafka/nonNwClickCpcAms1-1/00000000000000155248.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:33,410] INFO Deleting index /data/d1/kafka/nonNwClickCpcAms1-1/00000000000000155248.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:33,410] INFO Deleting segment 4297119959 from log rr-15. (kafka.log.Log) [2018-03-14 05:02:33,419] INFO Deleting index /data/d1/kafka/nested_activity_add-network-1/00000000003662023592.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:33,419] INFO Deleting index /data/d1/kafka/nested_activity_add-network-1/00000000003662023592.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:33,419] INFO Deleting segment 2568638713 from log napp-43. (kafka.log.Log) [2018-03-14 05:02:33,641] INFO Deleting index /data/d1/kafka/beaconDefaultAms1-7/00000000001040639616.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:33,641] INFO Deleting index /data/d1/kafka/beaconDefaultAms1-7/00000000001040639616.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:33,641] INFO Deleting segment 825695765 from log egret_lambda_AdUnitBeacon_ams1_enhanced-7. (kafka.log.Log) [2018-03-14 05:02:33,652] INFO Deleting index /data/d1/kafka/egret_lambda_AdUnitBeacon_ams1_enhanced-1/00000000000825832302.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:33,652] INFO Deleting index /data/d1/kafka/egret_lambda_AdUnitBeacon_ams1_enhanced-1/00000000000825832302.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:33,675] INFO Deleting index /data/d1/kafka/rr-33/00000000002732612944.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:33,675] INFO Deleting index /data/d1/kafka/rr-33/00000000002732612944.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:33,721] INFO Deleting index /data/d1/kafka/napp-43/00000000002568638713.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:33,721] INFO Deleting index /data/d1/kafka/napp-43/00000000002568638713.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:33,722] INFO Deleting index /data/d1/kafka/rr-15/00000000004297119959.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:33,722] INFO Deleting index /data/d1/kafka/rr-15/00000000004297119959.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:34,004] INFO Deleting index /data/d1/kafka/egret_lambda_AdUnitBeacon_ams1_enhanced-7/00000000000825695765.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:34,027] INFO Deleting index /data/d1/kafka/egret_lambda_AdUnitPublisherFill_ams1_enhanced-0/00000000001008163380.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:34,298] INFO Deleting index /data/d1/kafka/sdk_metrics-2/00000000001127282161.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:34,531] INFO Deleting index /data/d1/kafka/ifcp_ams1-7/00000000003977049510.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:34,871] INFO Deleting index /data/d1/kafka/user_context-8/00000000004479837686.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:34,872] INFO Deleting index /data/d1/kafka/user_context-8/00000000004479837686.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:34,872] INFO Deleting index /data/d1/kafka/ifcp_ams1-7/00000000003977049510.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:34,872] INFO Deleting index /data/d1/kafka/sdk_metrics-2/00000000001127282161.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:34,893] INFO Deleting index /data/d1/kafka/egret_lambda_AdUnitPublisherFill_ams1_enhanced-0/00000000001008163380.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:34,897] INFO Deleting index /data/d1/kafka/egret_lambda_AdUnitBeacon_ams1_enhanced-7/00000000000825695765.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:35,045] INFO Deleting index /data/d1/kafka/cas_rr-1/00000000005965330010.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:35,045] INFO Deleting index /data/d1/kafka/cas_rr-1/00000000005965330010.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:39,685] INFO [GroupCoordinator 1]: Stabilized group prod-m10n-event-processor-beaconams1 generation 9 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:02:39,793] INFO [GroupCoordinator 1]: Preparing to restabilize group prod-m10n-event-processor-beaconams1 with old generation 9 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:02:40,830] INFO Deleting segment 0 from log __consumer_offsets-9. (kafka.log.Log) [2018-03-14 05:02:40,830] INFO Deleting segment 90634 from log __consumer_offsets-9. (kafka.log.Log) [2018-03-14 05:02:40,833] INFO Deleting index /data/d1/kafka/__consumer_offsets-9/00000000000000000000.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:40,833] INFO Deleting index /data/d1/kafka/__consumer_offsets-9/00000000000000000000.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:40,833] INFO Deleting index /data/d1/kafka/__consumer_offsets-9/00000000000000090634.index.deleted (kafka.log.OffsetIndex) [2018-03-14 05:02:40,833] INFO Deleting index /data/d1/kafka/__consumer_offsets-9/00000000000000090634.timeindex.deleted (kafka.log.TimeIndex) [2018-03-14 05:02:52,645] INFO Rolled new log segment for 'adroit_conversion_enhanced_ams1-0' in 1 ms. (kafka.log.Log) [2018-03-14 05:03:09,692] INFO [GroupCoordinator 1]: Stabilized group prod-m10n-event-processor-beaconams1 generation 10 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:03:09,697] INFO [GroupCoordinator 1]: Assignment received from leader for group prod-m10n-event-processor-beaconams1 for generation 10 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:03:33,216] INFO Rolled new log segment for 'beacon_rr_dfw1_cpm_render-1' in 1 ms. (kafka.log.Log) [2018-03-14 05:04:08,934] INFO Rolled new log segment for 'egret_lambda_RenderCPM_ams1_enhanced-0' in 63 ms. (kafka.log.Log) [2018-03-14 05:04:12,520] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions network_activity_ams1_pek1-6 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:12,520] INFO Truncating log network_activity_ams1_pek1-6 to offset 0. (kafka.log.Log) [2018-03-14 05:04:12,542] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([network_activity_ams1_pek1-6, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:12,544] INFO [ReplicaFetcherThread-7-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:12,712] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions audit_producer-3 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:12,712] INFO Truncating log audit_producer-3 to offset 1120428. (kafka.log.Log) [2018-03-14 05:04:12,738] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([audit_producer-3, initOffset 1120428 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:12,738] INFO [ReplicaFetcherThread-9-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:12,750] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions merge_ifc_organic_activity_ams1-1 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:12,750] INFO Truncating log merge_ifc_organic_activity_ams1-1 to offset 287301860. (kafka.log.Log) [2018-03-14 05:04:12,790] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([merge_ifc_organic_activity_ams1-1, initOffset 287301860 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:12,790] INFO [ReplicaFetcherThread-1-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:12,847] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions merge_fds_ams1-2 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:12,847] INFO Truncating log merge_fds_ams1-2 to offset 0. (kafka.log.Log) [2018-03-14 05:04:12,892] INFO [ReplicaFetcherThread-11-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:12,892] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([merge_fds_ams1-2, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,013] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions network_click_invalid_dfw2-0 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,013] INFO Truncating log network_click_invalid_dfw2-0 to offset 1460638. (kafka.log.Log) [2018-03-14 05:04:13,032] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([network_click_invalid_dfw2-0, initOffset 1460638 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,145] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions network_render_cpm_ams1_ams1-3 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,145] INFO Truncating log network_render_cpm_ams1_ams1-3 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,227] WARN Attempting to send response via channel for which there is no open connection, connection id 18 (kafka.network.Processor) [2018-03-14 05:04:13,229] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([network_render_cpm_ams1_ams1-3, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,229] INFO [ReplicaFetcherThread-3-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,231] ERROR [ReplicaFetcherThread-0-15], Error for partition [adhoc_network_click_ams1_ams1,5] to broker 15:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,233] ERROR [ReplicaFetcherThread-7-17], Error for partition [cas_rr,21] to broker 17:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,253] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions network_render_cpm_lhr1-10 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,253] INFO Truncating log network_render_cpm_lhr1-10 to offset 1949192. (kafka.log.Log) [2018-03-14 05:04:13,296] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([network_render_cpm_lhr1-10, initOffset 1949192 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,296] INFO [ReplicaFetcherThread-8-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,300] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions adhoc_network_click_ams1_ams1-5 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,300] INFO Truncating log adhoc_network_click_ams1_ams1-5 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,356] ERROR [ReplicaFetcherThread-8-15], Error for partition [ifc_organic_activity_ams1_ams1,0] to broker 15:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,381] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([adhoc_network_click_ams1_ams1-5, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,381] INFO [ReplicaFetcherThread-0-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,391] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions cas_rr-21 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,391] INFO Truncating log cas_rr-21 to offset 1516619388. (kafka.log.Log) [2018-03-14 05:04:13,417] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([cas_rr-21, initOffset 1516619388 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,432] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions adroit_report_obj_ams1-1 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,432] INFO Truncating log adroit_report_obj_ams1-1 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,450] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([adroit_report_obj_ams1-1, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,454] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions ifc_organic_activity_ams1_ams1-0 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,454] INFO Truncating log ifc_organic_activity_ams1_ams1-0 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,473] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([ifc_organic_activity_ams1_ams1-0, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,478] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions napp-8 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,478] INFO Truncating log napp-8 to offset 3863664136. (kafka.log.Log) [2018-03-14 05:04:13,513] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([napp-8, initOffset 3863664136 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,519] ERROR [ReplicaFetcherThread-10-15], Error for partition [render_cpc_ams1,10] to broker 15:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,530] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions render_cpc_ams1-10 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,530] INFO Truncating log render_cpc_ams1-10 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,557] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([render_cpc_ams1-10, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,558] INFO [ReplicaFetcherThread-10-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,570] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions adhoc_network_attribute_ams1_ams1-11 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,570] INFO Truncating log adhoc_network_attribute_ams1_ams1-11 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,592] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([adhoc_network_attribute_ams1_ams1-11, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,593] INFO [ReplicaFetcherThread-2-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,602] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions network_attribute_pek1-8 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,602] INFO Truncating log network_attribute_pek1-8 to offset 143385. (kafka.log.Log) [2018-03-14 05:04:13,765] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([network_attribute_pek1-8, initOffset 143385 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,772] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions network_click_pek1-11 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,772] INFO Truncating log network_click_pek1-11 to offset 48199. (kafka.log.Log) [2018-03-14 05:04:13,786] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([network_click_pek1-11, initOffset 48199 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,802] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions custom_type_record_update-ifc-9 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,802] INFO Truncating log custom_type_record_update-ifc-9 to offset 45617120. (kafka.log.Log) [2018-03-14 05:04:13,824] ERROR [ReplicaFetcherThread-3-15], Error for partition [attribute_change-core,2] to broker 15:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:13,853] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([custom_type_record_update-ifc-9, initOffset 45617120 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,856] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions attribute_change-core-2 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,856] INFO Truncating log attribute_change-core-2 to offset 153074165. (kafka.log.Log) [2018-03-14 05:04:13,872] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([attribute_change-core-2, initOffset 153074165 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,907] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions audience-attributes_ams1_ams1-11 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,907] INFO Truncating log audience-attributes_ams1_ams1-11 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,925] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([audience-attributes_ams1_ams1-11, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,944] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions network_render_cpc_ams1_pek1-2 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,944] INFO Truncating log network_render_cpc_ams1_pek1-2 to offset 0. (kafka.log.Log) [2018-03-14 05:04:13,975] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([network_render_cpc_ams1_pek1-2, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:13,975] INFO [ReplicaFetcherThread-5-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:14,058] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions __consumer_offsets-11 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,058] INFO Truncating log __consumer_offsets-11 to offset 15000. (kafka.log.Log) [2018-03-14 05:04:14,074] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([__consumer_offsets-11, initOffset 15000 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,074] INFO [GroupCoordinator 1]: Unloading group metadata for clickAdaptor.ams1.nonNwClickCpcAms1 with generation 0 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:04:14,074] INFO [GroupCoordinator 1]: Unloading group metadata for conversionAdaptor.ams1.adroit_conversion_enhanced_ams1 with generation 0 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:04:14,074] INFO [GroupCoordinator 1]: Unloading group metadata for prod-m10n-event-processor-beaconams1 with generation 10 (kafka.coordinator.GroupCoordinator) [2018-03-14 05:04:14,076] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions network_render_cpc_lhr1-5 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,076] INFO Truncating log network_render_cpc_lhr1-5 to offset 1785152. (kafka.log.Log) [2018-03-14 05:04:14,076] INFO [Group Metadata Manager on Broker 1]: Removed 8 cached offsets for __consumer_offsets-11 on follower transition. (kafka.coordinator.GroupMetadataManager) [2018-03-14 05:04:14,076] INFO [Group Metadata Manager on Broker 1]: Removed 3 cached groups for __consumer_offsets-11 on follower transition. (kafka.coordinator.GroupMetadataManager) [2018-03-14 05:04:14,093] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([network_render_cpc_lhr1-5, initOffset 1785152 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,095] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions web_postbacks-5 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,095] INFO Truncating log web_postbacks-5 to offset 0. (kafka.log.Log) [2018-03-14 05:04:14,110] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([web_postbacks-5, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,159] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions ttd-beacon-11 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,159] INFO Truncating log ttd-beacon-11 to offset 0. (kafka.log.Log) [2018-03-14 05:04:14,174] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([ttd-beacon-11, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,174] INFO [ReplicaFetcherThread-6-2], Starting (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:14,195] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions merge_network_click_invalid_ams1-1 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,195] INFO Truncating log merge_network_click_invalid_ams1-1 to offset 17475392. (kafka.log.Log) [2018-03-14 05:04:14,208] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([merge_network_click_invalid_ams1-1, initOffset 17475392 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,214] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions audit_consumer_count-0 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,214] INFO Truncating log audit_consumer_count-0 to offset 686995. (kafka.log.Log) [2018-03-14 05:04:14,225] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([audit_consumer_count-0, initOffset 686995 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,260] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions appd-debug-14 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,260] INFO Truncating log appd-debug-14 to offset 0. (kafka.log.Log) [2018-03-14 05:04:14,282] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([appd-debug-14, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,429] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions profile_delete-ams1_ams1-5 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,429] INFO Truncating log profile_delete-ams1_ams1-5 to offset 427732892. (kafka.log.Log) [2018-03-14 05:04:14,649] ERROR [ReplicaFetcherThread-7-15], Error for partition [beeswax_bid_logs,0] to broker 15:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:14,784] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([profile_delete-ams1_ams1-5, initOffset 427732892 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,791] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions audit_consumer-7 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,791] INFO Truncating log audit_consumer-7 to offset 383679. (kafka.log.Log) [2018-03-14 05:04:14,813] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([audit_consumer-7, initOffset 383679 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,823] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions beeswax_bid_logs-0 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,823] INFO Truncating log beeswax_bid_logs-0 to offset 0. (kafka.log.Log) [2018-03-14 05:04:14,851] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([beeswax_bid_logs-0, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,856] ERROR [ReplicaFetcherThread-7-2], Error for partition [beeswax_bid_logs,0] to broker 2:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:14,998] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions custom_type_record_update-appduserrenderhistory-2 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:14,998] INFO Truncating log custom_type_record_update-appduserrenderhistory-2 to offset 228924284. (kafka.log.Log) [2018-03-14 05:04:15,023] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([custom_type_record_update-appduserrenderhistory-2, initOffset 228924284 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,074] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions network_activity_dfw1-10 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,075] INFO Truncating log network_activity_dfw1-10 to offset 2127793697. (kafka.log.Log) [2018-03-14 05:04:15,102] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([network_activity_dfw1-10, initOffset 2127793697 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,114] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions network_conversion_ams1_dfw2-0 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,114] INFO Truncating log network_conversion_ams1_dfw2-0 to offset 0. (kafka.log.Log) [2018-03-14 05:04:15,136] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([network_conversion_ams1_dfw2-0, initOffset 0 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,143] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions network_render_cpc_ams1_global-4 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,144] INFO Truncating log network_render_cpc_ams1_global-4 to offset 37382. (kafka.log.Log) [2018-03-14 05:04:15,164] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([network_render_cpc_ams1_global-4, initOffset 37382 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,177] INFO [ReplicaFetcherManager on broker 1] Removed fetcher for partitions audience-attributes_ams1-6 (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:15,177] INFO Truncating log audience-attributes_ams1-6 to offset 1208372. (kafka.log.Log) [2018-03-14 05:04:15,181] ERROR [ReplicaFetcherThread-6-2], Error for partition [network_conversion_ams1_dfw2,0] to broker 2:org.apache.kafka.common.errors.NotLeaderForPartitionException: This server is not the leader for that topic-partition. (kafka.server.ReplicaFetcherThread) [2018-03-14 05:04:15,194] INFO [ReplicaFetcherManager on broker 1] Added fetcher for partitions List([audience-attributes_ams1-6, initOffset 1208372 to broker BrokerEndPoint(2,azkf4002.grid.ams1.inmobi.com,9093)] ) (kafka.server.ReplicaFetcherManager) [2018-03-14 05:04:19,831] INFO Rolled new log segment for 'egret_lambda_AdUnitBeacon_ams1_enhanced-7' in 3 ms. (kafka.log.Log) [2018-03-14 05:04:25,683] INFO Rolled new log segment for 'rr-34' in 21 ms. (kafka.log.Log) [2018-03-14 05:04:45,301] INFO Rolled new log segment for 'egret_lambda_AdUnitBeacon_ams1_enhanced-1' in 2 ms. (kafka.log.Log) [2018-03-14 05:04:58,364] INFO Rolled new log segment for '__consumer_offsets-37' in 49 ms. (kafka.log.Log)