Screen reader users, click here to skip the navigation bar splunk> App: Dealing Michael Pearce Messages Settings Activity Help Wrap results 1000 per page Dropdown [2017-01-04 13:22:11,401] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:11,401] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 13:22:11,420] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21683204574, 21683814206). (kafka.log.LogCleaner) [2017-01-04 13:22:11,961] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 13:22:11,961] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 13:21:58 GMT 2017, discarding tombstones prior to Tue Jan 03 13:16:04 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 13:22:11,961] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:11,963] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:11,964] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:11,966] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:11,966] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:11,970] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:11,971] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:11,972] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:11,973] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:11,974] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:11,975] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:11,976] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:11,977] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:11,978] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:11,979] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:11,980] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:11,980] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:11,982] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:11,983] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:07:04 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:11,983] INFO Cleaner 0: Cleaning segment 21682594942 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:16:04 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:11,991] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21682594942 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:11,992] INFO Cleaner 0: Cleaning segment 21683204574 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:21:58 GMT 2017) into 21683204574, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:22:12,536] INFO Cleaner 0: Swapping in cleaned segment 21683204574 for segment(s) 21683204574 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:22:12,537] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21683204574, 21683814206]) 100.0 MB of log processed in 1.1 seconds (88.1 MB/sec). Indexed 100.0 MB in 0.6 seconds (178.6 Mb/sec, 49.3% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (173.9 Mb/sec, 50.7% of total time) Start size: 100.0 MB (609,716 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 13:27:57,561] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:57,561] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 13:27:57,581] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21683814206, 21684424699). (kafka.log.LogCleaner) [2017-01-04 13:27:58,123] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 13:27:58,124] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 13:27:49 GMT 2017, discarding tombstones prior to Tue Jan 03 13:21:58 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 13:27:58,124] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,126] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:58,127] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,128] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:58,129] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,130] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:58,131] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,132] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:58,133] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,134] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:58,134] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,136] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:58,136] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,138] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:58,138] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,139] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:58,140] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,141] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:58,142] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:07:04 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,142] INFO Cleaner 0: Cleaning segment 21683204574 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:21:58 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,148] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21683204574 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:58,149] INFO Cleaner 0: Cleaning segment 21683814206 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:27:49 GMT 2017) into 21683814206, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:27:58,690] INFO Cleaner 0: Swapping in cleaned segment 21683814206 for segment(s) 21683814206 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:27:58,691] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21683814206, 21684424699]) 100.0 MB of log processed in 1.1 seconds (88.5 MB/sec). Indexed 100.0 MB in 0.6 seconds (177.9 Mb/sec, 49.7% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (176.1 Mb/sec, 50.3% of total time) Start size: 100.0 MB (610,577 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 13:37:43,733] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:43,733] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 13:37:43,753] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21684424699, 21685038838). (kafka.log.LogCleaner) [2017-01-04 13:37:44,374] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 13:37:44,374] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 13:37:36 GMT 2017, discarding tombstones prior to Tue Jan 03 13:27:49 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 13:37:44,374] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,376] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:44,377] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,379] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:44,379] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,381] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:44,381] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,382] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:44,383] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,384] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:44,385] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,386] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:44,387] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,389] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:44,389] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,391] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:44,391] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,393] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:44,394] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:06:32 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,394] INFO Cleaner 0: Cleaning segment 21683814206 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:27:49 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,406] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21683814206 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:44,406] INFO Cleaner 0: Cleaning segment 21684424699 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:37:36 GMT 2017) into 21684424699, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:37:44,962] INFO Cleaner 0: Swapping in cleaned segment 21684424699 for segment(s) 21684424699 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:37:44,963] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21684424699, 21685038838]) 100.0 MB of log processed in 1.2 seconds (81.4 MB/sec). Indexed 100.0 MB in 0.6 seconds (156.0 Mb/sec, 52.2% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (170.1 Mb/sec, 47.8% of total time) Start size: 100.0 MB (614,223 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 13:42:59,990] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:42:59,990] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 13:43:00,011] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21685038838, 21685650278). (kafka.log.LogCleaner) [2017-01-04 13:43:00,527] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 13:43:00,528] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 13:42:55 GMT 2017, discarding tombstones prior to Tue Jan 03 13:37:36 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 13:43:00,528] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:00,530] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:43:00,530] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:00,532] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:43:00,532] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:00,533] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:43:00,534] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:00,535] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:43:00,536] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:00,537] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:43:00,537] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:00,538] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:43:00,539] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:00,540] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:43:00,541] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:00,542] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:43:00,543] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:00,544] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:43:00,544] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:25:26 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:00,545] INFO Cleaner 0: Cleaning segment 21684424699 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:37:36 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:00,557] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21684424699 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:43:00,558] INFO Cleaner 0: Cleaning segment 21685038838 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:42:55 GMT 2017) into 21685038838, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:43:01,149] INFO Cleaner 0: Swapping in cleaned segment 21685038838 for segment(s) 21685038838 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:43:01,149] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21685038838, 21685650278]) 100.0 MB of log processed in 1.2 seconds (86.3 MB/sec). Indexed 100.0 MB in 0.5 seconds (186.2 Mb/sec, 46.3% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (160.8 Mb/sec, 53.7% of total time) Start size: 100.0 MB (611,524 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 13:48:31,175] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:31,175] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 13:48:31,194] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21685650278, 21686261718). (kafka.log.LogCleaner) [2017-01-04 13:48:31,760] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 13:48:31,761] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 13:48:16 GMT 2017, discarding tombstones prior to Tue Jan 03 13:42:55 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 13:48:31,761] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:31,764] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:31,764] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:31,766] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:31,767] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:31,768] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:31,769] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:31,771] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:31,771] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:31,773] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:31,773] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:31,775] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:31,775] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:31,777] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:31,777] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:31,779] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:31,779] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:31,781] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:31,782] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:37:34 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:31,782] INFO Cleaner 0: Cleaning segment 21685038838 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:42:55 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:31,791] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21685038838 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:31,791] INFO Cleaner 0: Cleaning segment 21685650278 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:48:16 GMT 2017) into 21685650278, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:48:32,347] INFO Cleaner 0: Swapping in cleaned segment 21685650278 for segment(s) 21685650278 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:48:32,347] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21685650278, 21686261718]) 100.0 MB of log processed in 1.2 seconds (85.3 MB/sec). Indexed 100.0 MB in 0.6 seconds (170.9 Mb/sec, 49.9% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (170.4 Mb/sec, 50.1% of total time) Start size: 100.0 MB (611,524 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 13:53:47,450] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:47,450] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 13:53:47,470] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21686261718, 21686872806). (kafka.log.LogCleaner) [2017-01-04 13:53:48,053] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 13:53:48,053] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 13:53:37 GMT 2017, discarding tombstones prior to Tue Jan 03 13:48:16 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 13:53:48,053] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,056] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:48,057] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,060] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:48,061] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,062] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:48,063] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,064] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:48,065] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,066] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:48,067] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,068] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:48,068] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,070] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:48,070] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,072] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:48,072] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,074] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:48,075] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:37:34 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,075] INFO Cleaner 0: Cleaning segment 21685650278 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:48:16 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,083] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21685650278 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:48,084] INFO Cleaner 0: Cleaning segment 21686261718 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:53:37 GMT 2017) into 21686261718, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:53:48,675] INFO Cleaner 0: Swapping in cleaned segment 21686261718 for segment(s) 21686261718 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:53:48,676] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21686261718, 21686872806]) 100.0 MB of log processed in 1.2 seconds (81.6 MB/sec). Indexed 100.0 MB in 0.6 seconds (165.8 Mb/sec, 49.2% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (160.8 Mb/sec, 50.8% of total time) Start size: 100.0 MB (611,172 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 13:59:03,700] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:03,701] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 13:59:03,720] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21686872806, 21687483862). (kafka.log.LogCleaner) [2017-01-04 13:59:04,473] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 13:59:04,473] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 13:58:59 GMT 2017, discarding tombstones prior to Tue Jan 03 13:53:37 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 13:59:04,474] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:04,475] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:04,476] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:04,477] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:04,478] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:04,480] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:04,480] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:04,482] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:04,482] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:04,484] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:04,485] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:04,486] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:04,487] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:04,488] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:04,489] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:04,490] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:04,491] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:04,492] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:04,493] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:37:34 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:04,493] INFO Cleaner 0: Cleaning segment 21686261718 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:53:37 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:04,506] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21686261718 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:04,507] INFO Cleaner 0: Cleaning segment 21686872806 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:58:59 GMT 2017) into 21686872806, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 13:59:05,085] INFO Cleaner 0: Swapping in cleaned segment 21686872806 for segment(s) 21686872806 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 13:59:05,085] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21686872806, 21687483862]) 100.0 MB of log processed in 1.4 seconds (72.2 MB/sec). Indexed 100.0 MB in 0.8 seconds (129.4 Mb/sec, 55.8% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (163.4 Mb/sec, 44.2% of total time) Start size: 100.0 MB (611,140 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 14:07:35,143] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:35,143] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 14:07:35,163] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21687483862, 21688096282). (kafka.log.LogCleaner) [2017-01-04 14:07:35,735] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 14:07:35,735] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 14:07:21 GMT 2017, discarding tombstones prior to Tue Jan 03 13:58:59 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 14:07:35,736] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:35,738] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:35,738] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:35,740] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:35,740] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:35,741] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:35,742] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:35,743] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:35,744] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:35,745] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:35,746] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:35,747] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:35,748] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:35,749] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:35,750] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:35,752] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:35,752] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:35,753] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:35,754] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:52:59 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:35,754] INFO Cleaner 0: Cleaning segment 21686872806 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:58:59 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:35,761] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21686872806 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:35,762] INFO Cleaner 0: Cleaning segment 21687483862 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:07:21 GMT 2017) into 21687483862, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:07:36,305] INFO Cleaner 0: Swapping in cleaned segment 21687483862 for segment(s) 21687483862 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:07:36,306] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21687483862, 21688096282]) 100.0 MB of log processed in 1.2 seconds (86.0 MB/sec). Indexed 100.0 MB in 0.6 seconds (168.9 Mb/sec, 50.9% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (175.2 Mb/sec, 49.1% of total time) Start size: 100.0 MB (612,504 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 14:12:21,374] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:21,375] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 14:12:21,394] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21688096282, 21688708602). (kafka.log.LogCleaner) [2017-01-04 14:12:21,974] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 14:12:21,974] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 14:12:18 GMT 2017, discarding tombstones prior to Tue Jan 03 14:07:21 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 14:12:21,975] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:21,977] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:21,978] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:21,979] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:21,980] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:21,981] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:21,982] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:21,983] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:21,984] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:21,985] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:21,985] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:21,987] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:21,987] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:21,989] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:21,989] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:21,990] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:21,991] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:21,992] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:21,993] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 13:52:59 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:21,993] INFO Cleaner 0: Cleaning segment 21687483862 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:07:21 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:22,005] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21687483862 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:22,006] INFO Cleaner 0: Cleaning segment 21688096282 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:12:18 GMT 2017) into 21688096282, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:12:22,550] INFO Cleaner 0: Swapping in cleaned segment 21688096282 for segment(s) 21688096282 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:12:22,550] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21688096282, 21688708602]) 100.0 MB of log processed in 1.2 seconds (85.0 MB/sec). Indexed 100.0 MB in 0.6 seconds (166.7 Mb/sec, 51.0% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (173.6 Mb/sec, 49.0% of total time) Start size: 100.0 MB (612,404 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 14:17:22,572] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:22,572] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 14:17:22,591] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21688708602, 21689320208). (kafka.log.LogCleaner) [2017-01-04 14:17:23,188] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 14:17:23,188] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 14:17:17 GMT 2017, discarding tombstones prior to Tue Jan 03 14:12:18 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 14:17:23,189] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,191] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:23,191] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,193] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:23,193] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,195] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:23,195] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,197] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:23,197] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,198] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:23,199] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,200] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:23,201] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,202] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:23,203] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,204] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:23,204] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,206] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:23,207] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:07:12 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,207] INFO Cleaner 0: Cleaning segment 21688096282 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:12:18 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,214] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21688096282 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:23,215] INFO Cleaner 0: Cleaning segment 21688708602 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:17:17 GMT 2017) into 21688708602, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:17:23,750] INFO Cleaner 0: Swapping in cleaned segment 21688708602 for segment(s) 21688708602 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:17:23,752] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21688708602, 21689320208]) 100.0 MB of log processed in 1.2 seconds (84.8 MB/sec). Indexed 100.0 MB in 0.6 seconds (162.3 Mb/sec, 52.2% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (177.6 Mb/sec, 47.8% of total time) Start size: 100.0 MB (611,690 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 14:22:23,775] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:23,775] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 14:22:23,796] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21689320208, 21689931998). (kafka.log.LogCleaner) [2017-01-04 14:22:24,351] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 14:22:24,351] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 14:22:16 GMT 2017, discarding tombstones prior to Tue Jan 03 14:17:17 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 14:22:24,352] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,353] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:24,354] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,355] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:24,356] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,357] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:24,358] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,359] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:24,359] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,361] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:24,361] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,362] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:24,363] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,364] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:24,364] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,365] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:24,366] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,367] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:24,368] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:07:12 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,368] INFO Cleaner 0: Cleaning segment 21688708602 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:17:17 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,379] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21688708602 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:24,380] INFO Cleaner 0: Cleaning segment 21689320208 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:22:16 GMT 2017) into 21689320208, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:22:24,917] INFO Cleaner 0: Swapping in cleaned segment 21689320208 for segment(s) 21689320208 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:22:24,917] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21689320208, 21689931998]) 100.0 MB of log processed in 1.1 seconds (87.5 MB/sec). Indexed 100.0 MB in 0.6 seconds (173.3 Mb/sec, 50.5% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (176.7 Mb/sec, 49.5% of total time) Start size: 100.0 MB (611,874 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 14:27:24,940] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:24,940] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 14:27:24,959] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21689931998, 21690541922). (kafka.log.LogCleaner) [2017-01-04 14:27:25,544] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 14:27:25,544] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 14:27:22 GMT 2017, discarding tombstones prior to Tue Jan 03 14:22:16 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 14:27:25,545] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:25,549] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:25,550] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:25,551] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:25,552] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:25,553] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:25,553] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:25,555] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:25,555] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:25,556] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:25,557] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:25,558] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:25,559] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:25,560] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:25,561] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:25,562] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:25,562] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:25,564] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:25,564] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:16:37 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:25,564] INFO Cleaner 0: Cleaning segment 21689320208 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:22:16 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:25,575] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21689320208 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:25,576] INFO Cleaner 0: Cleaning segment 21689931998 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:27:22 GMT 2017) into 21689931998, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:27:26,093] INFO Cleaner 0: Swapping in cleaned segment 21689931998 for segment(s) 21689931998 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:27:26,093] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21689931998, 21690541922]) 100.0 MB of log processed in 1.2 seconds (86.7 MB/sec). Indexed 100.0 MB in 0.6 seconds (165.6 Mb/sec, 52.4% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.5 seconds (182.2 Mb/sec, 47.6% of total time) Start size: 100.0 MB (610,008 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 14:32:41,115] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:41,115] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 14:32:41,134] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21690541922, 21691151556). (kafka.log.LogCleaner) [2017-01-04 14:32:41,653] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 14:32:41,654] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 14:32:31 GMT 2017, discarding tombstones prior to Tue Jan 03 14:27:22 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 14:32:41,654] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:41,657] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:41,658] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:41,660] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:41,660] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:41,665] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:41,665] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:41,672] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:41,673] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:41,678] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:41,679] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:41,684] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:41,685] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:41,686] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:41,687] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:41,689] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:41,690] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:41,697] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:41,698] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:22:08 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:41,698] INFO Cleaner 0: Cleaning segment 21689931998 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:27:22 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:41,719] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21689931998 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:41,719] INFO Cleaner 0: Cleaning segment 21690541922 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:32:31 GMT 2017) into 21690541922, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:32:42,251] INFO Cleaner 0: Swapping in cleaned segment 21690541922 for segment(s) 21690541922 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:32:42,252] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21690541922, 21691151556]) 100.0 MB of log processed in 1.1 seconds (88.0 MB/sec). Indexed 100.0 MB in 0.5 seconds (185.5 Mb/sec, 47.4% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (167.2 Mb/sec, 52.6% of total time) Start size: 100.0 MB (609,718 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 14:41:42,287] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:42,287] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 14:41:42,306] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21691151556, 21691761056). (kafka.log.LogCleaner) [2017-01-04 14:41:42,835] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 14:41:42,835] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 14:41:36 GMT 2017, discarding tombstones prior to Tue Jan 03 14:32:31 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 14:41:42,836] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:42,837] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:42,838] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:42,839] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:42,840] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:42,842] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:42,842] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:42,844] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:42,845] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:42,847] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:42,848] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:42,850] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:42,851] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:42,855] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:42,856] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:42,865] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:42,866] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:42,867] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:42,868] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:24:34 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:42,868] INFO Cleaner 0: Cleaning segment 21690541922 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:32:31 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:42,891] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21690541922 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:42,892] INFO Cleaner 0: Cleaning segment 21691151556 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:41:36 GMT 2017) into 21691151556, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:41:43,447] INFO Cleaner 0: Swapping in cleaned segment 21691151556 for segment(s) 21691151556 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:41:43,448] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21691151556, 21691761056]) 100.0 MB of log processed in 1.2 seconds (86.1 MB/sec). Indexed 100.0 MB in 0.5 seconds (182.1 Mb/sec, 47.3% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (163.4 Mb/sec, 52.7% of total time) Start size: 100.0 MB (609,584 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 14:46:28,468] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:28,468] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 14:46:28,487] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21691761056, 21692370678). (kafka.log.LogCleaner) [2017-01-04 14:46:29,033] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 14:46:29,033] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 14:46:24 GMT 2017, discarding tombstones prior to Tue Jan 03 14:41:36 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 14:46:29,034] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,035] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:29,035] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,037] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:29,037] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,039] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:29,039] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,040] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:29,041] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,042] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:29,042] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,043] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:29,044] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,045] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:29,045] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,047] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:29,047] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,048] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:29,049] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:30:05 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,049] INFO Cleaner 0: Cleaning segment 21691151556 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:41:36 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,062] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21691151556 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:29,063] INFO Cleaner 0: Cleaning segment 21691761056 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:46:24 GMT 2017) into 21691761056, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:46:29,582] INFO Cleaner 0: Swapping in cleaned segment 21691761056 for segment(s) 21691761056 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:46:29,583] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21691761056, 21692370678]) 100.0 MB of log processed in 1.1 seconds (89.7 MB/sec). Indexed 100.0 MB in 0.6 seconds (177.0 Mb/sec, 50.7% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (181.8 Mb/sec, 49.3% of total time) Start size: 100.0 MB (609,706 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 14:51:14,603] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:14,603] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 14:51:14,621] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21692370678, 21692980314). (kafka.log.LogCleaner) [2017-01-04 14:51:15,145] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 14:51:15,145] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 14:51:12 GMT 2017, discarding tombstones prior to Tue Jan 03 14:46:24 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 14:51:15,146] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,148] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:15,148] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,149] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:15,150] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,151] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:15,152] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,153] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:15,153] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,154] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:15,155] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,156] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:15,157] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,158] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:15,158] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,160] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:15,160] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,161] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:15,162] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:40:24 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,162] INFO Cleaner 0: Cleaning segment 21691761056 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:46:24 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,172] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21691761056 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:15,173] INFO Cleaner 0: Cleaning segment 21692370678 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:51:12 GMT 2017) into 21692370678, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:51:15,705] INFO Cleaner 0: Swapping in cleaned segment 21692370678 for segment(s) 21692370678 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:51:15,706] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21692370678, 21692980314]) 100.0 MB of log processed in 1.1 seconds (90.8 MB/sec). Indexed 100.0 MB in 0.5 seconds (184.5 Mb/sec, 49.2% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (178.6 Mb/sec, 50.8% of total time) Start size: 100.0 MB (609,720 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 14:56:00,731] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:00,731] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 14:56:00,752] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21692980314, 21693589950). (kafka.log.LogCleaner) [2017-01-04 14:56:01,390] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 14:56:01,390] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 14:55:59 GMT 2017, discarding tombstones prior to Tue Jan 03 14:51:12 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 14:56:01,391] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:01,396] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:01,397] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:01,399] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:01,399] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:01,406] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:01,407] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:01,410] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:01,411] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:01,412] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:01,413] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:01,414] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:01,415] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:01,416] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:01,417] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:01,419] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:01,419] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:01,422] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:01,423] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:43:30 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:01,423] INFO Cleaner 0: Cleaning segment 21692370678 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:51:12 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:01,436] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21692370678 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:01,437] INFO Cleaner 0: Cleaning segment 21692980314 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:55:59 GMT 2017) into 21692980314, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 14:56:02,195] INFO Cleaner 0: Swapping in cleaned segment 21692980314 for segment(s) 21692980314 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 14:56:02,196] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21692980314, 21693589950]) 100.0 MB of log processed in 1.5 seconds (68.3 MB/sec). Indexed 100.0 MB in 0.7 seconds (151.7 Mb/sec, 45.0% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.8 seconds (124.1 Mb/sec, 55.0% of total time) Start size: 100.0 MB (609,720 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:01:02,238] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:02,238] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 15:01:02,260] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21693589950, 21694199582). (kafka.log.LogCleaner) [2017-01-04 15:01:02,860] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 15:01:02,860] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 15:00:48 GMT 2017, discarding tombstones prior to Tue Jan 03 14:55:59 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 15:01:02,860] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:02,864] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:02,865] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:02,867] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:02,867] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:02,869] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:02,869] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:02,871] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:02,872] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:02,884] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:02,884] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:02,886] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:02,887] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:02,889] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:02,890] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:02,892] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:02,893] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:02,894] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:02,895] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:50:31 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:02,895] INFO Cleaner 0: Cleaning segment 21692980314 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:55:59 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:02,918] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21692980314 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:02,919] INFO Cleaner 0: Cleaning segment 21693589950 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:00:48 GMT 2017) into 21693589950, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:01:03,488] INFO Cleaner 0: Swapping in cleaned segment 21693589950 for segment(s) 21693589950 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:01:03,489] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21693589950, 21694199582]) 100.0 MB of log processed in 1.3 seconds (80.0 MB/sec). Indexed 100.0 MB in 0.6 seconds (160.8 Mb/sec, 49.8% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (159.3 Mb/sec, 50.2% of total time) Start size: 100.0 MB (609,716 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:08:18,518] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:18,518] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 15:08:18,538] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21694199582, 21694809097). (kafka.log.LogCleaner) [2017-01-04 15:08:19,115] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 15:08:19,115] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 15:08:06 GMT 2017, discarding tombstones prior to Tue Jan 03 15:00:48 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 15:08:19,115] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,118] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:19,118] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,120] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:19,120] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,122] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:19,122] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,124] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:19,124] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,125] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:19,126] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,127] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:19,128] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,129] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:19,129] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,131] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:19,131] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,133] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:19,133] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:55:52 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,133] INFO Cleaner 0: Cleaning segment 21693589950 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:00:48 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,141] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21693589950 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:19,142] INFO Cleaner 0: Cleaning segment 21694199582 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:08:06 GMT 2017) into 21694199582, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:08:19,706] INFO Cleaner 0: Swapping in cleaned segment 21694199582 for segment(s) 21694199582 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:08:19,707] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21694199582, 21694809097]) 100.0 MB of log processed in 1.2 seconds (84.2 MB/sec). Indexed 100.0 MB in 0.6 seconds (167.5 Mb/sec, 50.3% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (169.2 Mb/sec, 49.7% of total time) Start size: 100.0 MB (609,599 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:12:49,727] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:49,727] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 15:12:49,746] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21694809097, 21695418729). (kafka.log.LogCleaner) [2017-01-04 15:12:50,294] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 15:12:50,294] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 15:12:38 GMT 2017, discarding tombstones prior to Tue Jan 03 15:08:06 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 15:12:50,295] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,297] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:50,298] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,299] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:50,300] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,302] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:50,302] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,304] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:50,304] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,306] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:50,307] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,308] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:50,309] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,310] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:50,310] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,312] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:50,312] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,314] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:50,314] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 14:55:52 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,315] INFO Cleaner 0: Cleaning segment 21694199582 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:08:06 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,328] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21694199582 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:50,329] INFO Cleaner 0: Cleaning segment 21694809097 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:12:38 GMT 2017) into 21694809097, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:12:50,884] INFO Cleaner 0: Swapping in cleaned segment 21694809097 for segment(s) 21694809097 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:12:50,885] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21694809097, 21695418729]) 100.0 MB of log processed in 1.2 seconds (86.4 MB/sec). Indexed 100.0 MB in 0.6 seconds (176.4 Mb/sec, 49.0% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (169.2 Mb/sec, 51.0% of total time) Start size: 100.0 MB (609,716 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:17:20,906] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:20,906] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 15:17:20,926] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21695418729, 21696028361). (kafka.log.LogCleaner) [2017-01-04 15:17:21,468] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 15:17:21,468] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 15:17:11 GMT 2017, discarding tombstones prior to Tue Jan 03 15:12:38 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 15:17:21,469] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:21,470] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:21,471] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:21,472] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:21,472] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:21,473] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:21,474] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:21,476] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:21,476] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:21,477] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:21,478] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:21,479] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:21,480] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:21,481] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:21,481] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:21,483] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:21,483] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:21,488] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:21,489] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:07:18 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:21,489] INFO Cleaner 0: Cleaning segment 21694809097 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:12:38 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:21,497] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21694809097 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:21,498] INFO Cleaner 0: Cleaning segment 21695418729 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:17:11 GMT 2017) into 21695418729, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:17:22,035] INFO Cleaner 0: Swapping in cleaned segment 21695418729 for segment(s) 21695418729 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:17:22,036] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21695418729, 21696028361]) 100.0 MB of log processed in 1.1 seconds (88.5 MB/sec). Indexed 100.0 MB in 0.6 seconds (177.9 Mb/sec, 49.7% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (176.1 Mb/sec, 50.3% of total time) Start size: 100.0 MB (609,716 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:21:52,062] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:52,062] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 15:21:52,081] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21696028361, 21696637997). (kafka.log.LogCleaner) [2017-01-04 15:21:52,622] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 15:21:52,622] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 15:21:42 GMT 2017, discarding tombstones prior to Tue Jan 03 15:17:11 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 15:21:52,622] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:52,624] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:52,625] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:52,626] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:52,626] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:52,628] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:52,628] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:52,630] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:52,630] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:52,631] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:52,632] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:52,633] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:52,633] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:52,635] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:52,636] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:52,639] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:52,640] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:52,685] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:52,686] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:07:18 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:52,687] INFO Cleaner 0: Cleaning segment 21695418729 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:17:11 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:52,703] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21695418729 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:52,703] INFO Cleaner 0: Cleaning segment 21696028361 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:21:42 GMT 2017) into 21696028361, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:21:53,235] INFO Cleaner 0: Swapping in cleaned segment 21696028361 for segment(s) 21696028361 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:21:53,236] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21696028361, 21696637997]) 100.0 MB of log processed in 1.2 seconds (85.2 MB/sec). Indexed 100.0 MB in 0.6 seconds (178.6 Mb/sec, 47.7% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (162.9 Mb/sec, 52.3% of total time) Start size: 100.0 MB (609,720 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:26:23,278] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:23,278] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 15:26:23,298] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21696637997, 21697247620). (kafka.log.LogCleaner) [2017-01-04 15:26:23,902] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 15:26:23,902] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 15:26:14 GMT 2017, discarding tombstones prior to Tue Jan 03 15:21:42 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 15:26:23,903] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:23,905] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:23,906] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:23,907] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:23,907] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:23,909] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:23,909] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:23,910] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:23,911] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:23,912] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:23,912] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:23,913] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:23,914] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:23,915] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:23,916] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:23,917] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:23,917] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:23,919] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:23,919] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:07:18 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:23,919] INFO Cleaner 0: Cleaning segment 21696028361 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:21:42 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:23,931] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21696028361 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:23,932] INFO Cleaner 0: Cleaning segment 21696637997 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:26:14 GMT 2017) into 21696637997, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:26:24,477] INFO Cleaner 0: Swapping in cleaned segment 21696637997 for segment(s) 21696637997 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:26:24,477] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21696637997, 21697247620]) 100.0 MB of log processed in 1.2 seconds (83.4 MB/sec). Indexed 100.0 MB in 0.6 seconds (160.3 Mb/sec, 52.0% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (173.9 Mb/sec, 48.0% of total time) Start size: 100.0 MB (609,707 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:30:54,496] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:54,496] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 15:30:54,516] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21697247620, 21697857252). (kafka.log.LogCleaner) [2017-01-04 15:30:55,039] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 15:30:55,039] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 15:30:46 GMT 2017, discarding tombstones prior to Tue Jan 03 15:26:14 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 15:30:55,040] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,041] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:55,042] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,043] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:55,043] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,045] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:55,045] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,046] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:55,047] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,048] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:55,049] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,050] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:55,051] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,052] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:55,052] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,053] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:55,054] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,055] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:55,056] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:20:51 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,056] INFO Cleaner 0: Cleaning segment 21696637997 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:26:14 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,069] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21696637997 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:55,070] INFO Cleaner 0: Cleaning segment 21697247620 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:30:46 GMT 2017) into 21697247620, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:30:55,607] INFO Cleaner 0: Swapping in cleaned segment 21697247620 for segment(s) 21697247620 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:30:55,607] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21697247620, 21697857252]) 100.0 MB of log processed in 1.1 seconds (90.0 MB/sec). Indexed 100.0 MB in 0.5 seconds (184.2 Mb/sec, 48.9% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (176.1 Mb/sec, 51.1% of total time) Start size: 100.0 MB (609,716 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:38:25,639] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:25,639] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 15:38:25,659] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21697857252, 21698466772). (kafka.log.LogCleaner) [2017-01-04 15:38:26,229] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 15:38:26,229] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 15:38:24 GMT 2017, discarding tombstones prior to Tue Jan 03 15:30:46 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 15:38:26,229] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,231] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:26,232] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,233] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:26,234] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,235] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:26,236] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,237] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:26,238] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,239] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:26,240] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,241] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:26,241] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,243] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:26,243] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,244] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:26,245] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,246] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:26,247] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:22:28 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,247] INFO Cleaner 0: Cleaning segment 21697247620 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:30:46 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,255] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21697247620 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:26,255] INFO Cleaner 0: Cleaning segment 21697857252 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:38:24 GMT 2017) into 21697857252, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:38:26,779] INFO Cleaner 0: Swapping in cleaned segment 21697857252 for segment(s) 21697857252 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:38:26,779] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21697857252, 21698466772]) 100.0 MB of log processed in 1.1 seconds (87.7 MB/sec). Indexed 100.0 MB in 0.6 seconds (169.5 Mb/sec, 51.8% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.5 seconds (181.8 Mb/sec, 48.2% of total time) Start size: 100.0 MB (609,604 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:42:56,799] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:56,799] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 15:42:56,818] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21698466772, 21699076405). (kafka.log.LogCleaner) [2017-01-04 15:42:57,438] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 15:42:57,439] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 15:42:43 GMT 2017, discarding tombstones prior to Tue Jan 03 15:38:24 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 15:42:57,439] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,440] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:57,441] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,442] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:57,443] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,444] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:57,444] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,446] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:57,446] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,447] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:57,447] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,448] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:57,449] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,450] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:57,451] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,452] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:57,452] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,453] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:57,454] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:20:51 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,454] INFO Cleaner 0: Cleaning segment 21697857252 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:38:24 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,465] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21697857252 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:57,466] INFO Cleaner 0: Cleaning segment 21698466772 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:42:43 GMT 2017) into 21698466772, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:42:57,997] INFO Cleaner 0: Swapping in cleaned segment 21698466772 for segment(s) 21698466772 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:42:57,997] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21698466772, 21699076405]) 100.0 MB of log processed in 1.2 seconds (83.5 MB/sec). Indexed 100.0 MB in 0.6 seconds (156.5 Mb/sec, 53.3% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (178.9 Mb/sec, 46.7% of total time) Start size: 100.0 MB (609,717 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:47:13,016] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:13,016] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 15:47:13,036] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21699076405, 21699686037). (kafka.log.LogCleaner) [2017-01-04 15:47:13,559] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 15:47:13,559] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 15:47:00 GMT 2017, discarding tombstones prior to Tue Jan 03 15:42:43 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 15:47:13,560] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:13,561] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:13,562] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:13,563] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:13,564] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:13,565] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:13,566] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:13,567] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:13,567] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:13,569] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:13,569] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:13,570] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:13,571] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:13,572] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:13,573] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:13,574] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:13,575] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:13,576] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:13,577] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:37:07 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:13,577] INFO Cleaner 0: Cleaning segment 21698466772 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:42:43 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:13,590] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21698466772 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:13,591] INFO Cleaner 0: Cleaning segment 21699076405 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:47:00 GMT 2017) into 21699076405, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:47:14,152] INFO Cleaner 0: Swapping in cleaned segment 21699076405 for segment(s) 21699076405 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:47:14,152] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21699076405, 21699686037]) 100.0 MB of log processed in 1.1 seconds (88.0 MB/sec). Indexed 100.0 MB in 0.5 seconds (184.2 Mb/sec, 47.8% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (168.7 Mb/sec, 52.2% of total time) Start size: 100.0 MB (609,716 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:51:29,180] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:29,180] INFO Cleaner 0: Building offset map for __consumer_offsets-32... (kafka.log.LogCleaner) [2017-01-04 15:51:29,199] INFO Cleaner 0: Building offset map for log __consumer_offsets-32 for 1 segments in offset range [21699686037, 21700295671). (kafka.log.LogCleaner) [2017-01-04 15:51:29,719] INFO Cleaner 0: Offset map for log __consumer_offsets-32 complete. (kafka.log.LogCleaner) [2017-01-04 15:51:29,719] INFO Cleaner 0: Cleaning log __consumer_offsets-32 (cleaning prior to Wed Jan 04 15:51:15 GMT 2017, discarding tombstones prior to Tue Jan 03 15:47:00 GMT 2017)... (kafka.log.LogCleaner) [2017-01-04 15:51:29,720] INFO Cleaner 0: Cleaning segment 0 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 15:51:14 GMT 2016) into 0, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:29,721] INFO Cleaner 0: Swapping in cleaned segment 0 for segment(s) 0 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:29,722] INFO Cleaner 0: Cleaning segment 3253529216 in log __consumer_offsets-32 (largest timestamp Tue Nov 22 16:36:27 GMT 2016) into 3253529216, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:29,723] INFO Cleaner 0: Swapping in cleaned segment 3253529216 for segment(s) 3253529216 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:29,724] INFO Cleaner 0: Cleaning segment 6554537896 in log __consumer_offsets-32 (largest timestamp Wed Nov 30 03:00:14 GMT 2016) into 6554537896, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:29,725] INFO Cleaner 0: Swapping in cleaned segment 6554537896 for segment(s) 6554537896 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:29,726] INFO Cleaner 0: Cleaning segment 8702156714 in log __consumer_offsets-32 (largest timestamp Tue Dec 06 22:00:53 GMT 2016) into 8702156714, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:29,727] INFO Cleaner 0: Swapping in cleaned segment 8702156714 for segment(s) 8702156714 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:29,728] INFO Cleaner 0: Cleaning segment 10850133222 in log __consumer_offsets-32 (largest timestamp Tue Dec 13 06:12:11 GMT 2016) into 10850133222, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:29,729] INFO Cleaner 0: Swapping in cleaned segment 10850133222 for segment(s) 10850133222 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:29,730] INFO Cleaner 0: Cleaning segment 12997718681 in log __consumer_offsets-32 (largest timestamp Mon Dec 19 23:52:39 GMT 2016) into 12997718681, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:29,731] INFO Cleaner 0: Swapping in cleaned segment 12997718681 for segment(s) 12997718681 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:29,732] INFO Cleaner 0: Cleaning segment 15145390296 in log __consumer_offsets-32 (largest timestamp Mon Dec 26 17:14:51 GMT 2016) into 15145390296, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:29,733] INFO Cleaner 0: Swapping in cleaned segment 15145390296 for segment(s) 15145390296 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:29,734] INFO Cleaner 0: Cleaning segment 17292884629 in log __consumer_offsets-32 (largest timestamp Sat Dec 31 19:08:45 GMT 2016) into 17292884629, discarding deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:29,735] INFO Cleaner 0: Swapping in cleaned segment 17292884629 for segment(s) 17292884629 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:29,735] INFO Cleaner 0: Cleaning segment 19440608200 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 03:14:27 GMT 2017) into 19440608200, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:29,737] INFO Cleaner 0: Swapping in cleaned segment 19440608200 for segment(s) 19440608200 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:29,737] INFO Cleaner 0: Cleaning segment 21588483763 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:41:06 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:29,737] INFO Cleaner 0: Cleaning segment 21699076405 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:47:00 GMT 2017) into 21588483763, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:29,745] INFO Cleaner 0: Swapping in cleaned segment 21588483763 for segment(s) 21588483763,21699076405 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:29,746] INFO Cleaner 0: Cleaning segment 21699686037 in log __consumer_offsets-32 (largest timestamp Wed Jan 04 15:51:15 GMT 2017) into 21699686037, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:51:30,298] INFO Cleaner 0: Swapping in cleaned segment 21699686037 for segment(s) 21699686037 in log __consumer_offsets-32. (kafka.log.LogCleaner) [2017-01-04 15:51:30,299] INFO [kafka-log-cleaner-thread-0], Log cleaner thread 0 cleaned log __consumer_offsets-32 (dirty section = [21699686037, 21700295671]) 100.0 MB of log processed in 1.1 seconds (89.4 MB/sec). Indexed 100.0 MB in 0.5 seconds (185.5 Mb/sec, 48.2% of total time) Buffer utilization: 0.0% Cleaned 100.0 MB in 0.6 seconds (172.4 Mb/sec, 51.8% of total time) Start size: 100.0 MB (609,718 messages) End size: 0.0 MB (84 messages) 100.0% size reduction (100.0% fewer messages) (kafka.log.LogCleaner) [2017-01-04 15:52:45,307] INFO Cleaner 0: Beginning cleaning of log com_ig_trade_v1_order_event--demo--compacted-7. (kafka.log.LogCleaner) [2017-01-04 15:52:45,308] INFO Cleaner 0: Building offset map for com_ig_trade_v1_order_event--demo--compacted-7... (kafka.log.LogCleaner) [2017-01-04 15:52:45,326] INFO Cleaner 0: Building offset map for log com_ig_trade_v1_order_event--demo--compacted-7 for 2 segments in offset range [3374, 4961). (kafka.log.LogCleaner) [2017-01-04 15:52:45,360] INFO Cleaner 0: Offset map for log com_ig_trade_v1_order_event--demo--compacted-7 complete. (kafka.log.LogCleaner) [2017-01-04 15:52:45,360] INFO Cleaner 0: Cleaning log com_ig_trade_v1_order_event--demo--compacted-7 (cleaning prior to Wed Jan 04 15:37:48 GMT 2017, discarding tombstones prior to Tue Dec 20 12:37:54 GMT 2016)... (kafka.log.LogCleaner) [2017-01-04 15:52:45,361] INFO Cleaner 0: Cleaning segment 0 in log com_ig_trade_v1_order_event--demo--compacted-7 (largest timestamp Wed Dec 21 12:37:54 GMT 2016) into 0, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:52:45,366] INFO Cleaner 0: Cleaning segment 3374 in log com_ig_trade_v1_order_event--demo--compacted-7 (largest timestamp Wed Dec 28 15:22:50 GMT 2016) into 0, retaining deletes. (kafka.log.LogCleaner) [2017-01-04 15:52:45,378] ERROR [kafka-log-cleaner-thread-0], Error due to (kafka.log.LogCleaner) kafka.common.InvalidOffsetException: Attempt to append an offset (-1) to slot 1 no larger than the last offset appended (3373) to /var/kafka/logs/com_ig_trade_v1_order_event--demo--compacted-7/00000000000000000000.timeindex.cleaned. at kafka.log.TimeIndex$$anonfun$maybeAppend$1.apply$mcV$sp(TimeIndex.scala:117) at kafka.log.TimeIndex$$anonfun$maybeAppend$1.apply(TimeIndex.scala:107) at kafka.log.TimeIndex$$anonfun$maybeAppend$1.apply(TimeIndex.scala:107) at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:234) at kafka.log.TimeIndex.maybeAppend(TimeIndex.scala:107) at kafka.log.LogSegment.append(LogSegment.scala:106) at kafka.log.Cleaner.cleanInto(LogCleaner.scala:518) at kafka.log.Cleaner$$anonfun$cleanSegments$1.apply(LogCleaner.scala:404) at kafka.log.Cleaner$$anonfun$cleanSegments$1.apply(LogCleaner.scala:400) at scala.collection.immutable.List.foreach(List.scala:381) at kafka.log.Cleaner.cleanSegments(LogCleaner.scala:400) at kafka.log.Cleaner$$anonfun$clean$4.apply(LogCleaner.scala:364) at kafka.log.Cleaner$$anonfun$clean$4.apply(LogCleaner.scala:363) at scala.collection.immutable.List.foreach(List.scala:381) at kafka.log.Cleaner.clean(LogCleaner.scala:363) at kafka.log.LogCleaner$CleanerThread.cleanOrSleep(LogCleaner.scala:239) at kafka.log.LogCleaner$CleanerThread.doWork(LogCleaner.scala:218) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63) [2017-01-04 15:52:45,379] INFO [kafka-log-cleaner-thread-0], Stopped (kafka.log.LogCleaner)