2019-11-19 05:50:37.286|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#0-0-C-1|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=consumer-32, groupId=xmc-user-share-group] Node 0 was unable to process the fetch request with (sessionId=2007177625, epoch=19772): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:37.333|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#10-0-C-1|o.a.k.c.c.i.AbstractCoordinator|450|[Consumer clientId=consumer-36, groupId=center_user_share_monitoring_group] Successfully joined group with generation 475 2019-11-19 05:50:37.334|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#10-0-C-1|o.a.k.c.c.i.ConsumerCoordinator|289|[Consumer clientId=consumer-36, groupId=center_user_share_monitoring_group] Setting newly assigned partitions [xmc-share-0] 2019-11-19 05:50:37.334|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#10-2-C-1|o.a.k.c.c.i.AbstractCoordinator|450|[Consumer clientId=consumer-38, groupId=center_user_share_monitoring_group] Successfully joined group with generation 475 2019-11-19 05:50:37.334|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#10-2-C-1|o.a.k.c.c.i.ConsumerCoordinator|289|[Consumer clientId=consumer-38, groupId=center_user_share_monitoring_group] Setting newly assigned partitions [xmc-share-2] 2019-11-19 05:50:37.334|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#10-1-C-1|o.a.k.c.c.i.AbstractCoordinator|450|[Consumer clientId=consumer-37, groupId=center_user_share_monitoring_group] Successfully joined group with generation 475 2019-11-19 05:50:37.335|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#10-1-C-1|o.a.k.c.c.i.ConsumerCoordinator|289|[Consumer clientId=consumer-37, groupId=center_user_share_monitoring_group] Setting newly assigned partitions [xmc-share-1] 2019-11-19 05:50:37.343|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#10-2-C-1|o.s.k.l.KafkaMessageListenerContainer|363|partitions assigned: [xmc-share-2] 2019-11-19 05:50:37.367|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#9-2-C-1|o.s.k.l.KafkaMessageListenerContainer|363|partitions assigned: [xmc-pool-share-day-2] 2019-11-19 05:50:37.369|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#4-2-C-1|o.s.k.l.KafkaMessageListenerContainer|363|partitions assigned: [xmc-worker-share-hour-2] 2019-11-19 05:50:37.370|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#2-0-C-1|o.s.k.l.KafkaMessageListenerContainer|363|partitions assigned: [xmc-user-share-day-2, xmc-user-share-day-1, xmc-user-share-day-0] 2019-11-19 05:50:37.370|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#6-2-C-1|o.s.k.l.KafkaMessageListenerContainer|363|partitions assigned: [xmc-node-share-hour-2] 2019-11-19 05:50:37.370|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#7-2-C-1|o.s.k.l.KafkaMessageListenerContainer|363|partitions assigned: [xmc-node-share-day-2] 2019-11-19 05:50:37.395|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#4-0-C-1|o.s.k.l.KafkaMessageListenerContainer|363|partitions assigned: [xmc-worker-share-hour-0] 2019-11-19 05:50:37.442|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#10-1-C-1|o.s.k.l.KafkaMessageListenerContainer|363|partitions assigned: [xmc-share-1] 2019-11-19 05:50:37.443|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#10-1-C-1|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=consumer-37, groupId=center_user_share_monitoring_group] Node 2 was unable to process the fetch request with (sessionId=396135804, epoch=19621): FETCH_SESSION_ID_NOT_FOUND . 2019-11-19 05:50:37.448|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#10-0-C-1|o.s.k.l.KafkaMessageListenerContainer|363|partitions assigned: [xmc-share-0] 2019-11-19 05:50:37.772|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#5-0-C-1|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=consumer-28, groupId=xmc-user-share-group] Node 0 was unable to process the fetch request with (sessionId=1988613944, epoch=19777): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:38.348|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#10-2-C-1|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=consumer-38, groupId=center_user_share_monitoring_group] Node 0 was unable to process the fetch request with (sessionId=134968515, epoch=19641): FETCH_SESSION_ID_NOT_FOUND . 2019-11-19 05:50:39.240|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#7-2-C-1|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=consumer-8, groupId=xmc-user-share-group] Node 0 was unable to process the fetch request with (sessionId=1735097056, epoch=19682): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:39.777|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#6-1-C-1|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=consumer-3, groupId=xmc-user-share-group] Node 0 was unable to process the fetch request with (sessionId=1563374043, epoch=19683): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:40.283|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#4-1-C-1|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=consumer-25, groupId=xmc-user-share-group] Node 0 was unable to process the fetch request with (sessionId=763530853, epoch=19772): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:40.785|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#1-0-C-1|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=consumer-34, groupId=xmc-user-share-group] Node 0 was unable to process the fetch request with (sessionId=1071603160, epoch=19800): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:41.786|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#9-1-C-1|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=consumer-15, groupId=xmc-user-share-group] Node 0 was unable to process the fetch request with (sessionId=802804214, epoch=19648): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:42.570|INFO |org.springframework.kafka.KafkaListenerEndpointContainer#3-0-C-1|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=consumer-20, groupId=xmc-pool_account_block_group] Node 0 was unable to process the fetch request with (sessionId=1508155242, epoch=1930903): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:43.259|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.c.i.AbstractCoordinator|831|[Consumer clientId=flash-client-xmc-StreamThread-1-consumer, groupId=flash-app-xmc] Attempt to heartbeat failed since group is rebalancing 2019-11-19 05:50:43.269|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.c.i.ConsumerCoordinator|458|[Consumer clientId=flash-client-xmc-StreamThread-1-consumer, groupId=flash-app-xmc] Revoking previously assigned partitions [xmc-share-2, xmc-worker-benchmark-share-1, flash-app-xmc-node-share-store-day-repartition-2, fl ash-app-xmc-pool-account-block-store-repartition-0] 2019-11-19 05:50:43.269|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-1] State transition from RUNNING to PARTITIONS_REVOKED 2019-11-19 05:50:43.285|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-1-14_2-producer, transactionalId=flash-app-xmc-14_2] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.301|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-1-0_2-producer, transactionalId=flash-app-xmc-0_2] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.318|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-1-3_1-producer, transactionalId=flash-app-xmc-3_1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.339|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-1-6_0-producer, transactionalId=flash-app-xmc-6_0] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.340|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-1-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:43.340|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|324|stream-thread [flash-client-xmc-StreamThread-1] partition revocation took 71 ms. suspended active tasks: [14_2, 0_2, 3_1, 6_0] suspended standby tasks: [] 2019-11-19 05:50:43.340|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.c.i.AbstractCoordinator|486|[Consumer clientId=flash-client-xmc-StreamThread-1-consumer, groupId=flash-app-xmc] (Re-)joining group 2019-11-19 05:50:43.475|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.c.i.AbstractCoordinator|831|[Consumer clientId=flash-client-xmc-StreamThread-9-consumer, groupId=flash-app-xmc] Attempt to heartbeat failed since group is rebalancing 2019-11-19 05:50:43.483|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.c.i.ConsumerCoordinator|458|[Consumer clientId=flash-client-xmc-StreamThread-9-consumer, groupId=flash-app-xmc] Revoking previously assigned partitions [flash-app-xmc-user-share-store-minute-repartition-1, xmc-user-benchmark-share-0, xmc-node-bench mark-share-2] 2019-11-19 05:50:43.483|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-9] State transition from RUNNING to PARTITIONS_REVOKED 2019-11-19 05:50:43.505|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-9-2_0-producer, transactionalId=flash-app-xmc-2_0] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.535|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-9-4_2-producer, transactionalId=flash-app-xmc-4_2] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.557|INFO |flash-client-xmc-StreamThread-4|o.a.k.c.c.i.AbstractCoordinator|831|[Consumer clientId=flash-client-xmc-StreamThread-4-consumer, groupId=flash-app-xmc] Attempt to heartbeat failed since group is rebalancing 2019-11-19 05:50:43.558|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-9-7_1-producer, transactionalId=flash-app-xmc-7_1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.560|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-9-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:43.560|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|324|stream-thread [flash-client-xmc-StreamThread-9] partition revocation took 77 ms. suspended active tasks: [2_0, 4_2, 7_1] suspended standby tasks: [] 2019-11-19 05:50:43.560|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.c.i.AbstractCoordinator|486|[Consumer clientId=flash-client-xmc-StreamThread-9-consumer, groupId=flash-app-xmc] (Re-)joining group 2019-11-19 05:50:43.570|INFO |flash-client-xmc-StreamThread-4|o.a.k.c.c.i.ConsumerCoordinator|458|[Consumer clientId=flash-client-xmc-StreamThread-4-consumer, groupId=flash-app-xmc] Revoking previously assigned partitions [xmc-node-benchmark-share-0, flash-app-xmc-pool-account-block-store-repartition-2, xmc-flatten-s hare-1, flash-app-xmc-pool-share-store-day-repartition-0] 2019-11-19 05:50:43.570|INFO |flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-4] State transition from RUNNING to PARTITIONS_REVOKED 2019-11-19 05:50:43.572|INFO |flash-client-xmc-StreamThread-4|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-4-16_0-producer, transactionalId=flash-app-xmc-16_0] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.575|ERROR|flash-client-xmc-StreamThread-4|o.a.k.s.p.i.AssignedStreamsTasks|178|stream-thread [flash-client-xmc-StreamThread-4] Suspending stream task 16_0 failed due to the following error: org.apache.kafka.common.KafkaException: Unexpected error in AddOffsetsToTxnResponse: The producer attempted to use a producer id which is not currently assigned to its transactional id. at org.apache.kafka.clients.producer.internals.TransactionManager$AddOffsetsToTxnHandler.handleResponse(TransactionManager.java:1238) 2019-11-19 05:50:43.584|ERROR|flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamTask|695|task [16_0] Could not close task due to the following error: java.lang.NullPointerException: null at org.apache.kafka.streams.processor.internals.StreamTask.maybeAbortTransactionAndCloseRecordCollector(StreamTask.java:592) 2019-11-19 05:50:43.588|ERROR|flash-client-xmc-StreamThread-4|o.a.k.s.p.i.AssignedStreamsTasks|183|stream-thread [flash-client-xmc-StreamThread-4] After suspending failed, closing the same stream task 16_0 failed again due to the following error: java.lang.NullPointerException: null at org.apache.kafka.streams.processor.internals.StreamTask.maybeAbortTransactionAndCloseRecordCollector(StreamTask.java:592) 2019-11-19 05:50:43.604|INFO |flash-client-xmc-StreamThread-4|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-4-1_1-producer, transactionalId=flash-app-xmc-1_1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.658|INFO |flash-client-xmc-StreamThread-4|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-4-4_0-producer, transactionalId=flash-app-xmc-4_0] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.679|INFO |flash-client-xmc-StreamThread-4|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-4-6_2-producer, transactionalId=flash-app-xmc-6_2] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.681|INFO |flash-client-xmc-StreamThread-4|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-4-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:43.682|ERROR|flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamThread|315|stream-thread [flash-client-xmc-StreamThread-4] Error caught during partition revocation, will abort the current process and re-throw at the end of rebalance: {} org.apache.kafka.streams.errors.StreamsException: stream-thread [flash-client-xmc-StreamThread-4] failed to suspend stream tasks at org.apache.kafka.streams.processor.internals.TaskManager.suspendTasksAndState(TaskManager.java:249) Caused by: org.apache.kafka.common.KafkaException: Unexpected error in AddOffsetsToTxnResponse: The producer attempted to use a producer id which is not currently assigned to its transactional id. at org.apache.kafka.clients.producer.internals.TransactionManager$AddOffsetsToTxnHandler.handleResponse(TransactionManager.java:1238) 2019-11-19 05:50:43.683|INFO |flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamThread|324|stream-thread [flash-client-xmc-StreamThread-4] partition revocation took 113 ms. suspended active tasks: [16_0, 1_1, 4_0, 6_2] suspended standby tasks: [] 2019-11-19 05:50:43.683|INFO |flash-client-xmc-StreamThread-4|o.a.k.c.c.i.AbstractCoordinator|486|[Consumer clientId=flash-client-xmc-StreamThread-4-consumer, groupId=flash-app-xmc] (Re-)joining group 2019-11-19 05:50:43.687|INFO |flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-4] State transition from PARTITIONS_REVOKED to PENDING_SHUTDOWN 2019-11-19 05:50:43.689|INFO |flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamThread|1178|stream-thread [flash-client-xmc-StreamThread-4] Shutting down 2019-11-19 05:50:43.690|ERROR|flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamTask|609|task [1_1] Failed to close producer due to the following error: java.lang.NullPointerException: null at org.apache.kafka.streams.processor.internals.RecordCollectorImpl.close(RecordCollectorImpl.java:252) 2019-11-19 05:50:43.696|ERROR|flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamTask|609|task [4_0] Failed to close producer due to the following error: java.lang.NullPointerException: null at org.apache.kafka.streams.processor.internals.RecordCollectorImpl.close(RecordCollectorImpl.java:252) 2019-11-19 05:50:43.700|ERROR|flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamTask|609|task [6_2] Failed to close producer due to the following error: java.lang.NullPointerException: null at org.apache.kafka.streams.processor.internals.RecordCollectorImpl.close(RecordCollectorImpl.java:252) 2019-11-19 05:50:43.705|INFO |flash-client-xmc-StreamThread-4|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-4-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:43.725|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.c.i.AbstractCoordinator|831|[Consumer clientId=flash-client-xmc-StreamThread-6-consumer, groupId=flash-app-xmc] Attempt to heartbeat failed since group is rebalancing 2019-11-19 05:50:43.744|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.c.i.AbstractCoordinator|831|[Consumer clientId=flash-client-xmc-StreamThread-3-consumer, groupId=flash-app-xmc] Attempt to heartbeat failed since group is rebalancing 2019-11-19 05:50:43.755|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.c.i.ConsumerCoordinator|458|[Consumer clientId=flash-client-xmc-StreamThread-3-consumer, groupId=flash-app-xmc] Revoking previously assigned partitions [xmc-pool-benchmark-share-0, xmc-user-benchmark-share-1, flash-app-xmc-user-share-store-hour-rep artition-0] 2019-11-19 05:50:43.756|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-3] State transition from RUNNING to PARTITIONS_REVOKED 2019-11-19 05:50:43.762|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.c.i.ConsumerCoordinator|458|[Consumer clientId=flash-client-xmc-StreamThread-6-consumer, groupId=flash-app-xmc] Revoking previously assigned partitions [flash-app-xmc-user-share-store-minute-repartition-0, xmc-flatten-share-2, xmc-node-benchmark-sh are-1] 2019-11-19 05:50:43.762|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-6] State transition from RUNNING to PARTITIONS_REVOKED 2019-11-19 05:50:43.768|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-3-2_1-producer, transactionalId=flash-app-xmc-2_1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.793|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-3-5_0-producer, transactionalId=flash-app-xmc-5_0] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.794|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-6-1_2-producer, transactionalId=flash-app-xmc-1_2] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.814|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-6-4_1-producer, transactionalId=flash-app-xmc-4_1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.848|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-6-7_0-producer, transactionalId=flash-app-xmc-7_0] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.850|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-6-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:43.850|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|324|stream-thread [flash-client-xmc-StreamThread-6] partition revocation took 87 ms. suspended active tasks: [1_2, 4_1, 7_0] suspended standby tasks: [] 2019-11-19 05:50:43.850|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.c.i.AbstractCoordinator|486|[Consumer clientId=flash-client-xmc-StreamThread-6-consumer, groupId=flash-app-xmc] (Re-)joining group 2019-11-19 05:50:43.969|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-3-8_0-producer, transactionalId=flash-app-xmc-8_0] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:43.971|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-3-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:43.971|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StreamThread|324|stream-thread [flash-client-xmc-StreamThread-3] partition revocation took 215 ms. suspended active tasks: [2_1, 5_0, 8_0] suspended standby tasks: [] 2019-11-19 05:50:43.971|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.c.i.AbstractCoordinator|486|[Consumer clientId=flash-client-xmc-StreamThread-3-consumer, groupId=flash-app-xmc] (Re-)joining group 2019-11-19 05:50:45.387|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.c.i.AbstractCoordinator|831|[Consumer clientId=flash-client-xmc-StreamThread-2-consumer, groupId=flash-app-xmc] Attempt to heartbeat failed since group is rebalancing 2019-11-19 05:50:45.487|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.c.i.AbstractCoordinator|831|[Consumer clientId=flash-client-xmc-StreamThread-7-consumer, groupId=flash-app-xmc] Attempt to heartbeat failed since group is rebalancing 2019-11-19 05:50:45.495|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.c.i.ConsumerCoordinator|458|[Consumer clientId=flash-client-xmc-StreamThread-7-consumer, groupId=flash-app-xmc] Revoking previously assigned partitions [xmc-flatten-share-0, xmc-worker-benchmark-share-2, flash-app-xmc-pool-account-block-store-repar tition-1, flash-app-xmc-pool-share-store-hour-repartition-2] 2019-11-19 05:50:45.495|INFO |flash-client-xmc-StreamThread-7|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-7] State transition from RUNNING to PARTITIONS_REVOKED 2019-11-19 05:50:45.508|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-7-1_0-producer, transactionalId=flash-app-xmc-1_0] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:45.525|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-7-15_2-producer, transactionalId=flash-app-xmc-15_2] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:45.583|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-7-3_2-producer, transactionalId=flash-app-xmc-3_2] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:45.589|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.c.i.ConsumerCoordinator|458|[Consumer clientId=flash-client-xmc-StreamThread-2-consumer, groupId=flash-app-xmc] Revoking previously assigned partitions [xmc-pool-benchmark-share-1, xmc-share-0, xmc-user-benchmark-share-2, flash-app-xmc-node-share-s tore-hour-repartition-1] 2019-11-19 05:50:45.589|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-2] State transition from RUNNING to PARTITIONS_REVOKED 2019-11-19 05:50:45.598|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-7-6_1-producer, transactionalId=flash-app-xmc-6_1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:45.599|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-7-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:45.599|INFO |flash-client-xmc-StreamThread-7|o.a.k.s.p.i.StreamThread|324|stream-thread [flash-client-xmc-StreamThread-7] partition revocation took 103 ms. suspended active tasks: [1_0, 15_2, 3_2, 6_1] suspended standby tasks: [] 2019-11-19 05:50:45.599|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.c.i.AbstractCoordinator|486|[Consumer clientId=flash-client-xmc-StreamThread-7-consumer, groupId=flash-app-xmc] (Re-)joining group 2019-11-19 05:50:45.615|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-2-0_0-producer, transactionalId=flash-app-xmc-0_0] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:45.643|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-2-2_2-producer, transactionalId=flash-app-xmc-2_2] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:45.666|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-2-5_1-producer, transactionalId=flash-app-xmc-5_1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:45.714|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-2-13_1-producer, transactionalId=flash-app-xmc-13_1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:45.715|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-2-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:45.715|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|324|stream-thread [flash-client-xmc-StreamThread-2] partition revocation took 126 ms. suspended active tasks: [0_0, 2_2, 5_1, 13_1] suspended standby tasks: [] 2019-11-19 05:50:45.715|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.c.i.AbstractCoordinator|486|[Consumer clientId=flash-client-xmc-StreamThread-2-consumer, groupId=flash-app-xmc] (Re-)joining group 2019-11-19 05:50:46.051|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.c.i.AbstractCoordinator|831|[Consumer clientId=flash-client-xmc-StreamThread-8-consumer, groupId=flash-app-xmc] Attempt to heartbeat failed since group is rebalancing 2019-11-19 05:50:46.059|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.c.i.ConsumerCoordinator|458|[Consumer clientId=flash-client-xmc-StreamThread-8-consumer, groupId=flash-app-xmc] Revoking previously assigned partitions [flash-app-xmc-node-share-store-day-repartition-0, xmc-pool-benchmark-share-2, xmc-worker-benchm ark-share-0, xmc-share-1] 2019-11-19 05:50:46.059|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-8] State transition from RUNNING to PARTITIONS_REVOKED 2019-11-19 05:50:46.079|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-8-0_1-producer, transactionalId=flash-app-xmc-0_1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:46.102|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-8-3_0-producer, transactionalId=flash-app-xmc-3_0] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:46.126|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-8-5_2-producer, transactionalId=flash-app-xmc-5_2] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:46.185|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|1136|[Producer clientId=flash-client-xmc-StreamThread-8-14_0-producer, transactionalId=flash-app-xmc-14_0] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2019-11-19 05:50:46.187|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-8-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:46.187|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|324|stream-thread [flash-client-xmc-StreamThread-8] partition revocation took 128 ms. suspended active tasks: [0_1, 3_0, 5_2, 14_0] suspended standby tasks: [] 2019-11-19 05:50:46.187|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.c.i.AbstractCoordinator|486|[Consumer clientId=flash-client-xmc-StreamThread-8-consumer, groupId=flash-app-xmc] (Re-)joining group 2019-11-19 05:50:46.195|INFO |flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamsPartitionAssignor|632|stream-thread [flash-client-xmc-StreamThread-4-consumer] Assigned tasks to clients as {055d3626-06b1-403d-a727-7050ff2cb0b7=[activeTasks: ([0_0, 0_1, 1_0, 0_2, 1_1, 2_0, 3_0, 1_2, 2_1, 2_2, 3_1, 4_0, 3_2, 4_1, 5_0, 5_1, 6_0, 4_2, 5_2, 6_1, 7_0, 6_2, 7_1, 8_0, 8_1, 9_0, 7_2, 8_2, 9_1, 10_0, 9_2, 10_1, 11_0, 10_2, 11_1, 12_0, 11_2, 12_1, 13_0, 13_1, 14_0, 12_2, 13_2, 14_1, 15_0, 14_2, 16_0, 15_1, 15_2, 16_1, 16_2]) standbyTasks: ([]) assignedTasks: ([0_0, 0_1, 1_0, 0_2, 1_1, 2_0, 3_0, 1_2, 2_1, 2_2, 3_1, 4_0, 3_2, 4_1, 5_0, 5_1, 6_0, 4_2, 5_2, 6_1, 7_0, 6_2, 7_1, 8_0, 8_1, 9_0, 7_2, 8_2, 9_1, 10_0, 9_2, 10_1, 11_0, 10_2, 11_1, 12_0, 11_2, 12_1, 13_0, 13_1, 14_0, 12_2, 13_2, 14_1, 15_0, 14_2, 16_0, 15_1, 15_2, 16_1, 16_2]) prevActiveTasks: ([0_0, 0_1, 1_0, 0_2, 1_1, 2_0, 3_0, 1_2, 2_1, 2_2, 3_1, 4_0, 3_2, 4_1, 5_0, 5_1, 6_0, 4_2, 5_2, 6_1, 7_ 0, 6_2, 7_1, 8_0, 13_1, 14_0, 14_2, 16_0, 15_2]) prevStandbyTasks: ([8_1, 9_0, 10_0, 8_2, 9_1, 10_1, 9_2, 11_0, 11_1, 12_0, 10_2, 11_2, 13_0, 12_1, 12_2, 13_2, 16_2]) prevAssignedTasks: ([0_0, 0_1, 1_0, 0_2, 1_1, 2_0, 3_0, 1_2, 2_1, 2_2, 3_1, 4_0, 3_2, 4_1, 5_0, 5_1, 6_0, 4_2, 5_2, 6_1, 7_0, 6_2, 7_1, 8_0, 8_1, 9_0, 10_0, 8_2, 9_1, 10_1, 9_2, 11_0, 11_1, 12_0, 10_2, 11_2, 13_0, 12_1, 13_1, 12_2, 14_0, 13_2, 14_2, 16_0, 15_2, 16_2]) capacity: 8]}. 2019-11-19 05:50:46.206|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.c.i.AbstractCoordinator|450|[Consumer clientId=flash-client-xmc-StreamThread-1-consumer, groupId=flash-app-xmc] Successfully joined group with generation 123 2019-11-19 05:50:46.206|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.c.i.ConsumerCoordinator|289|[Consumer clientId=flash-client-xmc-StreamThread-1-consumer, groupId=flash-app-xmc] Setting newly assigned partitions [flash-app-xmc-worker-share-store-hour-repartition-1, xmc-share-2, flash-app-xmc-node-share-store-day- repartition-0, xmc-worker-benchmark-share-1, flash-app-xmc-user-share-store-hour-repartition-2, flash-app-xmc-pool-share-store-day-repartition-2, flash-app-xmc-pool-account-block-store-repartition-0] 2019-11-19 05:50:46.206|INFO |flash-client-xmc-StreamThread-4|o.a.k.c.c.i.AbstractCoordinator|450|[Consumer clientId=flash-client-xmc-StreamThread-4-consumer, groupId=flash-app-xmc] Successfully joined group with generation 123 2019-11-19 05:50:46.206|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-1] State transition from PARTITIONS_REVOKED to PARTITIONS_ASSIGNED 2019-11-19 05:50:46.207|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.c.i.AbstractCoordinator|450|[Consumer clientId=flash-client-xmc-StreamThread-6-consumer, groupId=flash-app-xmc] Successfully joined group with generation 123 2019-11-19 05:50:46.207|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.c.i.ConsumerCoordinator|289|[Consumer clientId=flash-client-xmc-StreamThread-6-consumer, groupId=flash-app-xmc] Setting newly assigned partitions [flash-app-xmc-user-share-store-day-repartition-2, flash-app-xmc-user-share-store-minute-repartition-0 , xmc-flatten-share-2, xmc-node-benchmark-share-1, flash-app-xmc-worker-share-store-day-repartition-1, flash-app-xmc-pool-share-store-hour-repartition-0] 2019-11-19 05:50:46.207|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-6] State transition from PARTITIONS_REVOKED to PARTITIONS_ASSIGNED 2019-11-19 05:50:46.207|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-6] Creating producer client for task 1_2 2019-11-19 05:50:46.208|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-6-1_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-1_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.208|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-6-1_2-producer, transactionalId=flash-app-xmc-1_2] Instantiated a transactional producer. 2019-11-19 05:50:46.208|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.c.i.AbstractCoordinator|450|[Consumer clientId=flash-client-xmc-StreamThread-9-consumer, groupId=flash-app-xmc] Successfully joined group with generation 123 2019-11-19 05:50:46.208|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.c.i.ConsumerCoordinator|289|[Consumer clientId=flash-client-xmc-StreamThread-9-consumer, groupId=flash-app-xmc] Setting newly assigned partitions [flash-app-xmc-user-share-store-minute-repartition-1, flash-app-xmc-worker-share-store-minute-repartit ion-0, xmc-user-benchmark-share-0, flash-app-xmc-pool-share-store-hour-repartition-1, xmc-node-benchmark-share-2, flash-app-xmc-worker-share-store-day-repartition-2] 2019-11-19 05:50:46.209|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.c.i.AbstractCoordinator|450|[Consumer clientId=flash-client-xmc-StreamThread-7-consumer, groupId=flash-app-xmc] Successfully joined group with generation 123 2019-11-19 05:50:46.209|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-9] State transition from PARTITIONS_REVOKED to PARTITIONS_ASSIGNED 2019-11-19 05:50:46.206|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.c.i.AbstractCoordinator|450|[Consumer clientId=flash-client-xmc-StreamThread-2-consumer, groupId=flash-app-xmc] Successfully joined group with generation 123 2019-11-19 05:50:46.209|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-9] Creating producer client for task 2_0 2019-11-19 05:50:46.209|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.c.i.AbstractCoordinator|450|[Consumer clientId=flash-client-xmc-StreamThread-3-consumer, groupId=flash-app-xmc] Successfully joined group with generation 123 2019-11-19 05:50:46.209|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.c.i.ConsumerCoordinator|289|[Consumer clientId=flash-client-xmc-StreamThread-2-consumer, groupId=flash-app-xmc] Setting newly assigned partitions [flash-app-xmc-worker-share-store-minute-repartition-2, xmc-pool-benchmark-share-1, flash-app-xmc-user -share-store-hour-repartition-0, xmc-user-benchmark-share-2, xmc-share-0, flash-app-xmc-pool-share-store-day-repartition-0, flash-app-xmc-node-share-store-hour-repartition-1] 2019-11-19 05:50:46.209|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-2] State transition from PARTITIONS_REVOKED to PARTITIONS_ASSIGNED 2019-11-19 05:50:46.209|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-9-2_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-2_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.210|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-2] Creating producer client for task 0_0 2019-11-19 05:50:46.210|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.c.i.ConsumerCoordinator|289|[Consumer clientId=flash-client-xmc-StreamThread-3-consumer, groupId=flash-app-xmc] Setting newly assigned partitions [flash-app-xmc-worker-share-store-minute-repartition-1, flash-app-xmc-user-share-store-minute-repartit ion-2, xmc-pool-benchmark-share-0, flash-app-xmc-node-share-store-hour-repartition-0, xmc-user-benchmark-share-1, flash-app-xmc-pool-share-store-hour-repartition-2] 2019-11-19 05:50:46.210|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-3] State transition from PARTITIONS_REVOKED to PARTITIONS_ASSIGNED 2019-11-19 05:50:46.210|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-9-2_0-producer, transactionalId=flash-app-xmc-2_0] Instantiated a transactional producer. 2019-11-19 05:50:46.210|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-2-0_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-0_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.212|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-2-0_0-producer, transactionalId=flash-app-xmc-0_0] Instantiated a transactional producer. 2019-11-19 05:50:46.211|INFO |flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-4] State transition from PENDING_SHUTDOWN to DEAD 2019-11-19 05:50:46.212|INFO |flash-client-xmc-StreamThread-4|o.a.k.s.p.i.StreamThread|1198|stream-thread [flash-client-xmc-StreamThread-4] Shutdown complete 2019-11-19 05:50:46.213|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.c.i.AbstractCoordinator|450|[Consumer clientId=flash-client-xmc-StreamThread-8-consumer, groupId=flash-app-xmc] Successfully joined group with generation 123 2019-11-19 05:50:46.213|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.c.i.ConsumerCoordinator|289|[Consumer clientId=flash-client-xmc-StreamThread-7-consumer, groupId=flash-app-xmc] Setting newly assigned partitions [flash-app-xmc-worker-share-store-hour-repartition-2, flash-app-xmc-user-share-store-day-repartition-0 , xmc-flatten-share-0, flash-app-xmc-node-share-store-day-repartition-1, xmc-worker-benchmark-share-2, flash-app-xmc-pool-account-block-store-repartition-1] 2019-11-19 05:50:46.213|INFO |flash-client-xmc-StreamThread-7|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-7] State transition from PARTITIONS_REVOKED to PARTITIONS_ASSIGNED 2019-11-19 05:50:46.214|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-1] Creating producer client for task 0_2 2019-11-19 05:50:46.215|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-1-0_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-0_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.215|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-1-0_2-producer, transactionalId=flash-app-xmc-0_2] Instantiated a transactional producer. 2019-11-19 05:50:46.218|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-6-1_2-producer, transactionalId=flash-app-xmc-1_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.218|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-6-1_2-producer, transactionalId=flash-app-xmc-1_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.219|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.219|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.219|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-1_2-producer, transactionalId=flash-app-xmc-1_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.219|INFO |flash-client-xmc-StreamThread-7|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-7] Creating producer client for task 1_0 2019-11-19 05:50:46.220|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-7-1_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-1_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.220|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-7-1_0-producer, transactionalId=flash-app-xmc-1_0] Instantiated a transactional producer. 2019-11-19 05:50:46.220|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-2-0_0-producer, transactionalId=flash-app-xmc-0_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.221|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-2-0_0-producer, transactionalId=flash-app-xmc-0_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.221|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-7-1_0-producer, transactionalId=flash-app-xmc-1_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.221|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-7-1_0-producer, transactionalId=flash-app-xmc-1_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.221|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.221|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.221|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-0_0-producer, transactionalId=flash-app-xmc-0_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.221|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-1-0_2-producer, transactionalId=flash-app-xmc-0_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.221|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-1-0_2-producer, transactionalId=flash-app-xmc-0_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.222|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-9-2_0-producer, transactionalId=flash-app-xmc-2_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.222|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-9-2_0-producer, transactionalId=flash-app-xmc-2_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.223|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-3] Creating producer client for task 2_1 2019-11-19 05:50:46.223|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-3-2_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-2_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.224|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-3-2_1-producer, transactionalId=flash-app-xmc-2_1] Instantiated a transactional producer. 2019-11-19 05:50:46.225|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.225|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.225|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-0_2-producer, transactionalId=flash-app-xmc-0_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.225|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-3-2_1-producer, transactionalId=flash-app-xmc-2_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.225|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-3-2_1-producer, transactionalId=flash-app-xmc-2_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.226|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.226|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.226|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.226|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-2_0-producer, transactionalId=flash-app-xmc-2_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.226|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.226|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-2_1-producer, transactionalId=flash-app-xmc-2_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.226|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.227|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.227|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-1_0-producer, transactionalId=flash-app-xmc-1_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.290|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.c.i.ConsumerCoordinator|289|[Consumer clientId=flash-client-xmc-StreamThread-8-consumer, groupId=flash-app-xmc] Setting newly assigned partitions [xmc-pool-benchmark-share-2, xmc-worker-benchmark-share-0, flash-app-xmc-pool-share-store-day-repartit ion-1, flash-app-xmc-user-share-store-hour-repartition-1, xmc-share-1, flash-app-xmc-worker-share-store-hour-repartition-0, flash-app-xmc-node-share-store-hour-repartition-2] 2019-11-19 05:50:46.290|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-8] State transition from PARTITIONS_REVOKED to PARTITIONS_ASSIGNED 2019-11-19 05:50:46.295|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-8] Creating producer client for task 0_1 2019-11-19 05:50:46.295|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-8-0_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-0_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.296|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-8-0_1-producer, transactionalId=flash-app-xmc-0_1] Instantiated a transactional producer. 2019-11-19 05:50:46.297|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-8-0_1-producer, transactionalId=flash-app-xmc-0_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.297|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-8-0_1-producer, transactionalId=flash-app-xmc-0_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.297|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.297|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.297|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-0_1-producer, transactionalId=flash-app-xmc-0_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.332|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-1-0_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-0_2-producer, transactionalId=flash-app-xmc-0_2] ProducerId set to 30077 with epoch 95 2019-11-19 05:50:46.332|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-6-1_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-1_2-producer, transactionalId=flash-app-xmc-1_2] ProducerId set to 31083 with epoch 94 2019-11-19 05:50:46.334|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-1] Creating producer client for task 3_1 2019-11-19 05:50:46.335|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-1-3_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-3_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.335|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-1-3_1-producer, transactionalId=flash-app-xmc-3_1] Instantiated a transactional producer. 2019-11-19 05:50:46.339|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-6] Creating producer client for task 4_1 2019-11-19 05:50:46.339|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-6-4_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-4_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.341|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-1-3_1-producer, transactionalId=flash-app-xmc-3_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.341|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-1-3_1-producer, transactionalId=flash-app-xmc-3_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.339|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-6-4_1-producer, transactionalId=flash-app-xmc-4_1] Instantiated a transactional producer. 2019-11-19 05:50:46.342|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-6-4_1-producer, transactionalId=flash-app-xmc-4_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.342|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-6-4_1-producer, transactionalId=flash-app-xmc-4_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.342|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.343|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.343|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-3_1-producer, transactionalId=flash-app-xmc-3_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.343|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.343|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.343|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-2-0_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-0_0-producer, transactionalId=flash-app-xmc-0_0] ProducerId set to 29085 with epoch 95 2019-11-19 05:50:46.343|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-4_1-producer, transactionalId=flash-app-xmc-4_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.345|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-2] Creating producer client for task 2_2 2019-11-19 05:50:46.345|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-2-2_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-2_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.346|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-2-2_2-producer, transactionalId=flash-app-xmc-2_2] Instantiated a transactional producer. 2019-11-19 05:50:46.346|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-2-2_2-producer, transactionalId=flash-app-xmc-2_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.346|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-2-2_2-producer, transactionalId=flash-app-xmc-2_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.347|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.347|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.347|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-2_2-producer, transactionalId=flash-app-xmc-2_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.432|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-9-2_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-2_0-producer, transactionalId=flash-app-xmc-2_0] ProducerId set to 31084 with epoch 94 2019-11-19 05:50:46.432|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-7-1_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-1_0-producer, transactionalId=flash-app-xmc-1_0] ProducerId set to 30079 with epoch 94 2019-11-19 05:50:46.435|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-3-2_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-2_1-producer, transactionalId=flash-app-xmc-2_1] ProducerId set to 30078 with epoch 95 2019-11-19 05:50:46.436|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-9] Creating producer client for task 4_2 2019-11-19 05:50:46.437|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-9-4_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-4_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.437|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-9-4_2-producer, transactionalId=flash-app-xmc-4_2] Instantiated a transactional producer. 2019-11-19 05:50:46.438|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-9-4_2-producer, transactionalId=flash-app-xmc-4_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.438|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-9-4_2-producer, transactionalId=flash-app-xmc-4_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.439|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.439|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.439|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-4_2-producer, transactionalId=flash-app-xmc-4_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.444|INFO |flash-client-xmc-StreamThread-7|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-7] Creating producer client for task 3_2 2019-11-19 05:50:46.444|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-7-3_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-3_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.444|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-7-3_2-producer, transactionalId=flash-app-xmc-3_2] Instantiated a transactional producer. 2019-11-19 05:50:46.445|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-3] Creating producer client for task 5_0 2019-11-19 05:50:46.445|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-3-5_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-5_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.445|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-7-3_2-producer, transactionalId=flash-app-xmc-3_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.445|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-7-3_2-producer, transactionalId=flash-app-xmc-3_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.445|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-3-5_0-producer, transactionalId=flash-app-xmc-5_0] Instantiated a transactional producer. 2019-11-19 05:50:46.446|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.446|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.446|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-3-5_0-producer, transactionalId=flash-app-xmc-5_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.447|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-3-5_0-producer, transactionalId=flash-app-xmc-5_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.447|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-3_2-producer, transactionalId=flash-app-xmc-3_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.447|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.447|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.447|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-5_0-producer, transactionalId=flash-app-xmc-5_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.451|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-1-3_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-3_1-producer, transactionalId=flash-app-xmc-3_1] ProducerId set to 31087 with epoch 95 2019-11-19 05:50:46.454|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-1] Creating producer client for task 6_0 2019-11-19 05:50:46.454|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-1-6_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-6_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.454|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-1-6_0-producer, transactionalId=flash-app-xmc-6_0] Instantiated a transactional producer. 2019-11-19 05:50:46.455|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-1-6_0-producer, transactionalId=flash-app-xmc-6_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.455|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-1-6_0-producer, transactionalId=flash-app-xmc-6_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.455|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.455|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.455|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-6_0-producer, transactionalId=flash-app-xmc-6_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.503|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-8-0_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-0_1-producer, transactionalId=flash-app-xmc-0_1] ProducerId set to 31085 with epoch 95 2019-11-19 05:50:46.505|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-8] Creating producer client for task 3_0 2019-11-19 05:50:46.505|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-8-3_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-3_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.505|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-8-3_0-producer, transactionalId=flash-app-xmc-3_0] Instantiated a transactional producer. 2019-11-19 05:50:46.506|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-8-3_0-producer, transactionalId=flash-app-xmc-3_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.506|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-8-3_0-producer, transactionalId=flash-app-xmc-3_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.506|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.506|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.507|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-3_0-producer, transactionalId=flash-app-xmc-3_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.554|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-7-3_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-3_2-producer, transactionalId=flash-app-xmc-3_2] ProducerId set to 30082 with epoch 96 2019-11-19 05:50:46.557|INFO |flash-client-xmc-StreamThread-7|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-7] Creating producer client for task 6_1 2019-11-19 05:50:46.557|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-7-6_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-6_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.557|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-7-6_1-producer, transactionalId=flash-app-xmc-6_1] Instantiated a transactional producer. 2019-11-19 05:50:46.558|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-7-6_1-producer, transactionalId=flash-app-xmc-6_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.558|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-7-6_1-producer, transactionalId=flash-app-xmc-6_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.559|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.559|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.559|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-6_1-producer, transactionalId=flash-app-xmc-6_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.561|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-2-2_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-2_2-producer, transactionalId=flash-app-xmc-2_2] ProducerId set to 29083 with epoch 95 2019-11-19 05:50:46.561|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-6-4_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-4_1-producer, transactionalId=flash-app-xmc-4_1] ProducerId set to 29088 with epoch 94 2019-11-19 05:50:46.565|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-6] Creating producer client for task 7_0 2019-11-19 05:50:46.565|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-6-7_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-7_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.565|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-6-7_0-producer, transactionalId=flash-app-xmc-7_0] Instantiated a transactional producer. 2019-11-19 05:50:46.566|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-2] Creating producer client for task 5_1 2019-11-19 05:50:46.566|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-2-5_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-5_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.566|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-2-5_1-producer, transactionalId=flash-app-xmc-5_1] Instantiated a transactional producer. 2019-11-19 05:50:46.566|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-6-7_0-producer, transactionalId=flash-app-xmc-7_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.566|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-6-7_0-producer, transactionalId=flash-app-xmc-7_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.567|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-2-5_1-producer, transactionalId=flash-app-xmc-5_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.567|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.567|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-2-5_1-producer, transactionalId=flash-app-xmc-5_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.567|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.567|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-7_0-producer, transactionalId=flash-app-xmc-7_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.568|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.568|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.568|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-5_1-producer, transactionalId=flash-app-xmc-5_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.652|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-3-5_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-5_0-producer, transactionalId=flash-app-xmc-5_0] ProducerId set to 41057 with epoch 66 2019-11-19 05:50:46.655|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-3] Creating producer client for task 15_2 2019-11-19 05:50:46.655|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-3-15_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-15_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.655|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-3-15_2-producer, transactionalId=flash-app-xmc-15_2] Instantiated a transactional producer. 2019-11-19 05:50:46.656|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-3-15_2-producer, transactionalId=flash-app-xmc-15_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.656|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-3-15_2-producer, transactionalId=flash-app-xmc-15_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.657|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.657|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.657|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-15_2-producer, transactionalId=flash-app-xmc-15_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.661|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-9-4_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-4_2-producer, transactionalId=flash-app-xmc-4_2] ProducerId set to 31089 with epoch 94 2019-11-19 05:50:46.663|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-9] Creating producer client for task 7_1 2019-11-19 05:50:46.663|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-9-7_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-7_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.663|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-1-6_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-6_0-producer, transactionalId=flash-app-xmc-6_0] ProducerId set to 31086 with epoch 94 2019-11-19 05:50:46.664|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-9-7_1-producer, transactionalId=flash-app-xmc-7_1] Instantiated a transactional producer. 2019-11-19 05:50:46.664|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-9-7_1-producer, transactionalId=flash-app-xmc-7_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.665|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-9-7_1-producer, transactionalId=flash-app-xmc-7_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.665|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.665|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.665|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-7_1-producer, transactionalId=flash-app-xmc-7_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.666|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-1] Creating producer client for task 16_2 2019-11-19 05:50:46.666|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-1-16_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-16_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.666|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-1-16_2-producer, transactionalId=flash-app-xmc-16_2] Instantiated a transactional producer. 2019-11-19 05:50:46.667|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-1-16_2-producer, transactionalId=flash-app-xmc-16_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.667|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-1-16_2-producer, transactionalId=flash-app-xmc-16_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.667|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.668|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.668|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-16_2-producer, transactionalId=flash-app-xmc-16_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.713|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-8-3_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-3_0-producer, transactionalId=flash-app-xmc-3_0] ProducerId set to 29084 with epoch 94 2019-11-19 05:50:46.716|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-8] Creating producer client for task 5_2 2019-11-19 05:50:46.716|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-8-5_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-5_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.717|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-8-5_2-producer, transactionalId=flash-app-xmc-5_2] Instantiated a transactional producer. 2019-11-19 05:50:46.717|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-8-5_2-producer, transactionalId=flash-app-xmc-5_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.718|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-8-5_2-producer, transactionalId=flash-app-xmc-5_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.718|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.718|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.718|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-5_2-producer, transactionalId=flash-app-xmc-5_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.765|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-7-6_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-6_1-producer, transactionalId=flash-app-xmc-6_1] ProducerId set to 30080 with epoch 95 2019-11-19 05:50:46.768|INFO |flash-client-xmc-StreamThread-7|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-7] Creating producer client for task 9_0 2019-11-19 05:50:46.769|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-7-9_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-9_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.769|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-7-9_0-producer, transactionalId=flash-app-xmc-9_0] Instantiated a transactional producer. 2019-11-19 05:50:46.770|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-7-9_0-producer, transactionalId=flash-app-xmc-9_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.770|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-7-9_0-producer, transactionalId=flash-app-xmc-9_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.770|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.771|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.771|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-9_0-producer, transactionalId=flash-app-xmc-9_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.800|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-6-7_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-7_0-producer, transactionalId=flash-app-xmc-7_0] ProducerId set to 29091 with epoch 94 2019-11-19 05:50:46.802|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-6] Creating producer client for task 9_2 2019-11-19 05:50:46.802|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-6-9_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-9_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.802|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-6-9_2-producer, transactionalId=flash-app-xmc-9_2] Instantiated a transactional producer. 2019-11-19 05:50:46.803|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-6-9_2-producer, transactionalId=flash-app-xmc-9_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.803|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-6-9_2-producer, transactionalId=flash-app-xmc-9_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.804|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.804|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.804|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-9_2-producer, transactionalId=flash-app-xmc-9_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.805|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-2-5_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-5_1-producer, transactionalId=flash-app-xmc-5_1] ProducerId set to 42064 with epoch 66 2019-11-19 05:50:46.807|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-2] Creating producer client for task 13_1 2019-11-19 05:50:46.807|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-2-13_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-13_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.808|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-2-13_1-producer, transactionalId=flash-app-xmc-13_1] Instantiated a transactional producer. 2019-11-19 05:50:46.808|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-2-13_1-producer, transactionalId=flash-app-xmc-13_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.809|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-2-13_1-producer, transactionalId=flash-app-xmc-13_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.809|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.809|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.809|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-13_1-producer, transactionalId=flash-app-xmc-13_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.874|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-9-7_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-7_1-producer, transactionalId=flash-app-xmc-7_1] ProducerId set to 31090 with epoch 96 2019-11-19 05:50:46.875|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-1-16_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-16_2-producer, transactionalId=flash-app-xmc-16_2] ProducerId set to 42007 with epoch 69 2019-11-19 05:50:46.875|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-9] Creating producer client for task 15_1 2019-11-19 05:50:46.876|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-9-15_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-15_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.876|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-9-15_1-producer, transactionalId=flash-app-xmc-15_1] Instantiated a transactional producer. 2019-11-19 05:50:46.877|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-9-15_1-producer, transactionalId=flash-app-xmc-15_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.877|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-9-15_1-producer, transactionalId=flash-app-xmc-15_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.877|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-1] Creating producer client for task 8_2 2019-11-19 05:50:46.877|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-1-8_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-8_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.877|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.878|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.878|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-1-8_2-producer, transactionalId=flash-app-xmc-8_2] Instantiated a transactional producer. 2019-11-19 05:50:46.878|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-3-15_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-15_2-producer, transactionalId=flash-app-xmc-15_2] ProducerId set to 41004 with epoch 71 2019-11-19 05:50:46.878|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-15_1-producer, transactionalId=flash-app-xmc-15_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.878|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-1-8_2-producer, transactionalId=flash-app-xmc-8_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.878|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-3] Creating producer client for task 7_2 2019-11-19 05:50:46.878|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-1-8_2-producer, transactionalId=flash-app-xmc-8_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.879|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-3-7_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-7_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.879|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.879|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-3-7_2-producer, transactionalId=flash-app-xmc-7_2] Instantiated a transactional producer. 2019-11-19 05:50:46.880|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.880|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-8_2-producer, transactionalId=flash-app-xmc-8_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.880|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-3-7_2-producer, transactionalId=flash-app-xmc-7_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.880|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-3-7_2-producer, transactionalId=flash-app-xmc-7_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.881|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.881|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.881|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-7_2-producer, transactionalId=flash-app-xmc-7_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:46.952|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-8-5_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-5_2-producer, transactionalId=flash-app-xmc-5_2] ProducerId set to 31088 with epoch 95 2019-11-19 05:50:46.955|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-8] Creating producer client for task 16_1 2019-11-19 05:50:46.955|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-8-16_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-16_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:46.955|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-8-16_1-producer, transactionalId=flash-app-xmc-16_1] Instantiated a transactional producer. 2019-11-19 05:50:46.956|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-8-16_1-producer, transactionalId=flash-app-xmc-16_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:46.956|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-8-16_1-producer, transactionalId=flash-app-xmc-16_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:46.957|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:46.957|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:46.957|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-16_1-producer, transactionalId=flash-app-xmc-16_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.007|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-7-9_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-9_0-producer, transactionalId=flash-app-xmc-9_0] ProducerId set to 30084 with epoch 94 2019-11-19 05:50:47.009|INFO |flash-client-xmc-StreamThread-7|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-7] Creating producer client for task 11_2 2019-11-19 05:50:47.009|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-7-11_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-11_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.010|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-7-11_2-producer, transactionalId=flash-app-xmc-11_2] Instantiated a transactional producer. 2019-11-19 05:50:47.011|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-7-11_2-producer, transactionalId=flash-app-xmc-11_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.011|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-7-11_2-producer, transactionalId=flash-app-xmc-11_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.011|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.011|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.012|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-11_2-producer, transactionalId=flash-app-xmc-11_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.012|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-6-9_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-9_2-producer, transactionalId=flash-app-xmc-9_2] ProducerId set to 31091 with epoch 95 2019-11-19 05:50:47.014|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-6] Creating producer client for task 12_1 2019-11-19 05:50:47.014|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-6-12_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-12_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.014|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-6-12_1-producer, transactionalId=flash-app-xmc-12_1] Instantiated a transactional producer. 2019-11-19 05:50:47.015|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-6-12_1-producer, transactionalId=flash-app-xmc-12_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.015|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-6-12_1-producer, transactionalId=flash-app-xmc-12_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.015|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.016|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.016|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-12_1-producer, transactionalId=flash-app-xmc-12_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.023|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-2-13_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-13_1-producer, transactionalId=flash-app-xmc-13_1] ProducerId set to 31123 with epoch 88 2019-11-19 05:50:47.025|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-2] Creating producer client for task 16_0 2019-11-19 05:50:47.025|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-2-16_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-16_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.025|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-2-16_0-producer, transactionalId=flash-app-xmc-16_0] Instantiated a transactional producer. 2019-11-19 05:50:47.026|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-2-16_0-producer, transactionalId=flash-app-xmc-16_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.026|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-2-16_0-producer, transactionalId=flash-app-xmc-16_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.027|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.027|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.027|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-16_0-producer, transactionalId=flash-app-xmc-16_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.063|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-8-16_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-16_1-producer, transactionalId=flash-app-xmc-16_1] ProducerId set to 43092 with epoch 0 2019-11-19 05:50:47.065|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-8] Creating producer client for task 8_1 2019-11-19 05:50:47.065|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-8-8_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-8_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.066|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-8-8_1-producer, transactionalId=flash-app-xmc-8_1] Instantiated a transactional producer. 2019-11-19 05:50:47.067|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-8-8_1-producer, transactionalId=flash-app-xmc-8_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.068|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-8-8_1-producer, transactionalId=flash-app-xmc-8_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.068|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.068|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.069|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-8_1-producer, transactionalId=flash-app-xmc-8_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.108|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-1-8_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-8_2-producer, transactionalId=flash-app-xmc-8_2] ProducerId set to 31092 with epoch 95 2019-11-19 05:50:47.110|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-1] Creating producer client for task 11_1 2019-11-19 05:50:47.110|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-1-11_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-11_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.111|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-1-11_1-producer, transactionalId=flash-app-xmc-11_1] Instantiated a transactional producer. 2019-11-19 05:50:47.111|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-1-11_1-producer, transactionalId=flash-app-xmc-11_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.112|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-1-11_1-producer, transactionalId=flash-app-xmc-11_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.112|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.113|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.113|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-11_1-producer, transactionalId=flash-app-xmc-11_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.119|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-3-7_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-7_2-producer, transactionalId=flash-app-xmc-7_2] ProducerId set to 30085 with epoch 94 2019-11-19 05:50:47.120|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-3] Creating producer client for task 10_1 2019-11-19 05:50:47.120|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-3-10_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-10_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.121|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-9-15_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-15_1-producer, transactionalId=flash-app-xmc-15_1] ProducerId set to 42090 with epoch 0 2019-11-19 05:50:47.121|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-3-10_1-producer, transactionalId=flash-app-xmc-10_1] Instantiated a transactional producer. 2019-11-19 05:50:47.121|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-3-10_1-producer, transactionalId=flash-app-xmc-10_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.121|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-3-10_1-producer, transactionalId=flash-app-xmc-10_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.122|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-9] Creating producer client for task 10_0 2019-11-19 05:50:47.122|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-9-10_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-10_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.122|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-9-10_0-producer, transactionalId=flash-app-xmc-10_0] Instantiated a transactional producer. 2019-11-19 05:50:47.123|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.123|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.123|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-9-10_0-producer, transactionalId=flash-app-xmc-10_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.123|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-9-10_0-producer, transactionalId=flash-app-xmc-10_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.123|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-10_1-producer, transactionalId=flash-app-xmc-10_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.123|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.124|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.124|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-10_0-producer, transactionalId=flash-app-xmc-10_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.133|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-2-16_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-16_0-producer, transactionalId=flash-app-xmc-16_0] ProducerId set to 41081 with epoch 0 2019-11-19 05:50:47.134|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-2] Creating producer client for task 8_0 2019-11-19 05:50:47.134|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-2-8_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-8_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.135|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-2-8_0-producer, transactionalId=flash-app-xmc-8_0] Instantiated a transactional producer. 2019-11-19 05:50:47.135|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-2-8_0-producer, transactionalId=flash-app-xmc-8_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.136|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-2-8_0-producer, transactionalId=flash-app-xmc-8_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.136|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.136|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.137|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-8_0-producer, transactionalId=flash-app-xmc-8_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.175|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-8-8_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-8_1-producer, transactionalId=flash-app-xmc-8_1] ProducerId set to 29090 with epoch 96 2019-11-19 05:50:47.177|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-8] Creating producer client for task 11_0 2019-11-19 05:50:47.177|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-8-11_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-11_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.178|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-8-11_0-producer, transactionalId=flash-app-xmc-11_0] Instantiated a transactional producer. 2019-11-19 05:50:47.179|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-8-11_0-producer, transactionalId=flash-app-xmc-11_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.179|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-8-11_0-producer, transactionalId=flash-app-xmc-11_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.179|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.179|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.180|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-11_0-producer, transactionalId=flash-app-xmc-11_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.220|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-7-11_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-11_2-producer, transactionalId=flash-app-xmc-11_2] ProducerId set to 30116 with epoch 87 2019-11-19 05:50:47.221|INFO |flash-client-xmc-StreamThread-7|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-7] Creating producer client for task 14_1 2019-11-19 05:50:47.221|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-7-14_1-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-14_1 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.222|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-7-14_1-producer, transactionalId=flash-app-xmc-14_1] Instantiated a transactional producer. 2019-11-19 05:50:47.222|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-6-12_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-12_1-producer, transactionalId=flash-app-xmc-12_1] ProducerId set to 31121 with epoch 88 2019-11-19 05:50:47.222|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-7-14_1-producer, transactionalId=flash-app-xmc-14_1] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.222|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-7-14_1-producer, transactionalId=flash-app-xmc-14_1] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.223|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-6] Creating producer client for task 15_0 2019-11-19 05:50:47.223|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-6-15_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-15_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.223|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.223|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.223|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-6-15_0-producer, transactionalId=flash-app-xmc-15_0] Instantiated a transactional producer. 2019-11-19 05:50:47.224|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-14_1-producer, transactionalId=flash-app-xmc-14_1] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.224|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-6-15_0-producer, transactionalId=flash-app-xmc-15_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.224|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-6-15_0-producer, transactionalId=flash-app-xmc-15_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.225|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.225|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.225|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-15_0-producer, transactionalId=flash-app-xmc-15_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.243|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-2-8_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-8_0-producer, transactionalId=flash-app-xmc-8_0] ProducerId set to 30086 with epoch 94 2019-11-19 05:50:47.244|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-2] Creating producer client for task 10_2 2019-11-19 05:50:47.244|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-2-10_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-10_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.245|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-2-10_2-producer, transactionalId=flash-app-xmc-10_2] Instantiated a transactional producer. 2019-11-19 05:50:47.245|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-2-10_2-producer, transactionalId=flash-app-xmc-10_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.246|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-2-10_2-producer, transactionalId=flash-app-xmc-10_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.246|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.247|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.247|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-10_2-producer, transactionalId=flash-app-xmc-10_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.287|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-8-11_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-11_0-producer, transactionalId=flash-app-xmc-11_0] ProducerId set to 31122 with epoch 87 2019-11-19 05:50:47.288|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-8] Creating producer client for task 13_2 2019-11-19 05:50:47.289|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-8-13_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-13_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.289|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-8-13_2-producer, transactionalId=flash-app-xmc-13_2] Instantiated a transactional producer. 2019-11-19 05:50:47.289|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-8-13_2-producer, transactionalId=flash-app-xmc-13_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.290|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-8-13_2-producer, transactionalId=flash-app-xmc-13_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.290|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.290|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.291|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-13_2-producer, transactionalId=flash-app-xmc-13_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.318|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-1-11_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-11_1-producer, transactionalId=flash-app-xmc-11_1] ProducerId set to 29122 with epoch 88 2019-11-19 05:50:47.319|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-1] Creating producer client for task 14_0 2019-11-19 05:50:47.319|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-1-14_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-14_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.320|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-1-14_0-producer, transactionalId=flash-app-xmc-14_0] Instantiated a transactional producer. 2019-11-19 05:50:47.320|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-1-14_0-producer, transactionalId=flash-app-xmc-14_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.321|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-1-14_0-producer, transactionalId=flash-app-xmc-14_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.321|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.321|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.322|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-14_0-producer, transactionalId=flash-app-xmc-14_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.330|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-3-10_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-10_1-producer, transactionalId=flash-app-xmc-10_1] ProducerId set to 30087 with epoch 95 2019-11-19 05:50:47.330|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-9-10_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-10_0-producer, transactionalId=flash-app-xmc-10_0] ProducerId set to 29093 with epoch 95 2019-11-19 05:50:47.331|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-6-15_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-6-15_0-producer, transactionalId=flash-app-xmc-15_0] ProducerId set to 43093 with epoch 0 2019-11-19 05:50:47.331|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|284|stream-thread [flash-client-xmc-StreamThread-6] partition assignment took 1124 ms. current active tasks: [1_2, 4_1, 7_0, 9_2, 12_1, 15_0] current standby tasks: [] previous active tasks: [1_2, 4_1, 7_0] 2019-11-19 05:50:47.331|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-3] Creating producer client for task 13_0 2019-11-19 05:50:47.332|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-3-13_0-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-13_0 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.332|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-3-13_0-producer, transactionalId=flash-app-xmc-13_0] Instantiated a transactional producer. 2019-11-19 05:50:47.333|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-3-13_0-producer, transactionalId=flash-app-xmc-13_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.333|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-3-13_0-producer, transactionalId=flash-app-xmc-13_0] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.333|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.333|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|448|stream-thread [flash-client-xmc-StreamThread-9] Creating producer client for task 12_2 2019-11-19 05:50:47.333|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.333|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.ProducerConfig|279|ProducerConfig values: acks = 1 batch.size = 16384 bootstrap.servers = [ap-1001-kafka-prod-ali-hk001:9092, ap-1001-kafka-prod-ali-hk002:9092, ap-1001-kafka-prod-ali-hk003:9092, ap-1001-kafka-prod-ali-hk004:9092, ap-1001-kafka-prod-ali-hk005:9092] buffer.memory = 33554432 client.dns.lookup = default client.id = flash-client-xmc-StreamThread-9-12_2-producer compression.type = none connections.max.idle.ms = 540000 delivery.timeout.ms = 2147483647 enable.idempotence = true interceptor.classes = [] key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 100 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.max.ms = 1000 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 2147483647 retry.backoff.ms = 100 sasl.client.callback.handler.class = null sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = https ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.timeout.ms = 60000 transactional.id = flash-app-xmc-12_2 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2019-11-19 05:50:47.334|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-13_0-producer, transactionalId=flash-app-xmc-13_0] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.334|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|525|[Producer clientId=flash-client-xmc-StreamThread-9-12_2-producer, transactionalId=flash-app-xmc-12_2] Instantiated a transactional producer. 2019-11-19 05:50:47.334|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|541|[Producer clientId=flash-client-xmc-StreamThread-9-12_2-producer, transactionalId=flash-app-xmc-12_2] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2019-11-19 05:50:47.334|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.KafkaProducer|567|[Producer clientId=flash-client-xmc-StreamThread-9-12_2-producer, transactionalId=flash-app-xmc-12_2] Overriding the default acks to all since idempotence is enabled. 2019-11-19 05:50:47.335|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|109|Kafka version : 2.1.0 2019-11-19 05:50:47.335|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.u.AppInfoParser|110|Kafka commitId : eec43959745f444f 2019-11-19 05:50:47.336|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-12_2-producer, transactionalId=flash-app-xmc-12_2] ProducerId set to -1 with epoch -1 2019-11-19 05:50:47.429|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-7-14_1-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-7-14_1-producer, transactionalId=flash-app-xmc-14_1] ProducerId set to 41006 with epoch 68 2019-11-19 05:50:47.429|INFO |flash-client-xmc-StreamThread-7|o.a.k.s.p.i.StreamThread|284|stream-thread [flash-client-xmc-StreamThread-7] partition assignment took 1216 ms. current active tasks: [1_0, 3_2, 6_1, 9_0, 11_2, 14_1] current standby tasks: [] previous active tasks: [1_0, 15_2, 3_2, 6_1] 2019-11-19 05:50:47.453|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-2-10_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-2-10_2-producer, transactionalId=flash-app-xmc-10_2] ProducerId set to 31093 with epoch 95 2019-11-19 05:50:47.453|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|284|stream-thread [flash-client-xmc-StreamThread-2] partition assignment took 1244 ms. current active tasks: [0_0, 16_0, 2_2, 5_1, 8_0, 10_2, 13_1] current standby tasks: [] previous active tasks: [0_0, 2_2, 5_1, 13_1] 2019-11-19 05:50:47.496|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-8-13_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-8-13_2-producer, transactionalId=flash-app-xmc-13_2] ProducerId set to 29123 with epoch 88 2019-11-19 05:50:47.497|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|284|stream-thread [flash-client-xmc-StreamThread-8] partition assignment took 1207 ms. current active tasks: [0_1, 16_1, 3_0, 5_2, 8_1, 11_0, 13_2] current standby tasks: [] previous active tasks: [0_1, 3_0, 5_2, 14_0] 2019-11-19 05:50:47.528|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-1-14_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-1-14_0-producer, transactionalId=flash-app-xmc-14_0] ProducerId set to 42008 with epoch 70 2019-11-19 05:50:47.528|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|284|stream-thread [flash-client-xmc-StreamThread-1] partition assignment took 1322 ms. current active tasks: [0_2, 16_2, 3_1, 6_0, 8_2, 11_1, 14_0] current standby tasks: [] previous active tasks: [14_2, 0_2, 3_1, 6_0] 2019-11-19 05:50:47.544|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-3-13_0-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-3-13_0-producer, transactionalId=flash-app-xmc-13_0] ProducerId set to 30115 with epoch 88 2019-11-19 05:50:47.545|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StreamThread|284|stream-thread [flash-client-xmc-StreamThread-3] partition assignment took 1335 ms. current active tasks: [15_2, 2_1, 5_0, 7_2, 10_1, 13_0] current standby tasks: [] previous active tasks: [2_1, 5_0, 8_0] 2019-11-19 05:50:47.565|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-9-12_2-producer|o.a.k.c.p.i.TransactionManager|372|[Producer clientId=flash-client-xmc-StreamThread-9-12_2-producer, transactionalId=flash-app-xmc-12_2] ProducerId set to 29121 with epoch 89 2019-11-19 05:50:47.565|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|284|stream-thread [flash-client-xmc-StreamThread-9] partition assignment took 1356 ms. current active tasks: [15_1, 2_0, 4_2, 7_1, 10_0, 12_2] current standby tasks: [] previous active tasks: [2_0, 4_2, 7_1] 2019-11-19 05:50:47.903|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=flash-client-xmc-StreamThread-6-restore-consumer, groupId=] Node 2 was unable to process the fetch request with (sessionId=484044003, epoch=2): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:47.903|WARN |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-6] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-user-share-store-day-changelog-2=2073820} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:47.904|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-6] Reinitializing StreamTask TaskId: 9_2 ProcessorTopology: KSTREAM-SOURCE-0000000061: topics: [flash-app-xmc-user-share-store-day-repartition] children: [KSTREAM-AGGREGATE-0000000058] KSTREAM-AGGREGATE-0000000058: states: [user-share-store-day] children: [KTABLE-TOSTREAM-0000000062] KTABLE-TOSTREAM-0000000062: children: [KSTREAM-SINK-0000000063] KSTREAM-SINK-0000000063: topic: StaticTopicNameExtractor(xmc-user-share-day) Partitions [flash-app-xmc-user-share-store-day-repartition-2] for changelog flash-app-xmc-user-share-store-day-changelog-2 2019-11-19 05:50:47.908|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-6-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:47.912|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-6-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:47.912|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-6] State transition from PARTITIONS_ASSIGNED to RUNNING 2019-11-19 05:50:47.913|INFO |flash-client-xmc-StreamThread-6|o.a.k.s.p.i.StreamThread|967|stream-thread [flash-client-xmc-StreamThread-6] No custom setting defined for topic 'flash-app-xmc-pool-share-store-hour-repartition' using original config 'earliest' for offset reset 2019-11-19 05:50:47.914|INFO |flash-client-xmc-StreamThread-6|o.a.k.c.c.i.Fetcher|583|[Consumer clientId=flash-client-xmc-StreamThread-6-consumer, groupId=flash-app-xmc] Resetting offset for partition flash-app-xmc-pool-share-store-hour-repartition-0 to offset 0. 2019-11-19 05:50:47.929|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-6-9_2-producer|o.a.k.c.Metadata|285|Cluster ID: lRcgc40URC2lSyDaA32lgQ 2019-11-19 05:50:48.040|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-6-12_1-producer|o.a.k.c.Metadata|285|Cluster ID: lRcgc40URC2lSyDaA32lgQ 2019-11-19 05:50:48.087|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=flash-client-xmc-StreamThread-2-restore-consumer, groupId=] Node 2 was unable to process the fetch request with (sessionId=104514242, epoch=21): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:48.088|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=flash-client-xmc-StreamThread-9-restore-consumer, groupId=] Node 2 was unable to process the fetch request with (sessionId=1137367258, epoch=5): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:48.088|WARN |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-9] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-0=6558790} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:48.089|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-9] Reinitializing StreamTask TaskId: 10_0 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-0] for changelog flash-app-xmc-worker-share-store-minute-changelog-0 2019-11-19 05:50:48.090|WARN |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-2] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-2=6013642} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:48.090|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-2] Reinitializing StreamTask TaskId: 10_2 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-2] for changelog flash-app-xmc-worker-share-store-minute-changelog-2 2019-11-19 05:50:48.092|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-9-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:48.097|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-9-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:48.097|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-9] State transition from PARTITIONS_ASSIGNED to RUNNING 2019-11-19 05:50:48.098|INFO |flash-client-xmc-StreamThread-9|o.a.k.s.p.i.StreamThread|967|stream-thread [flash-client-xmc-StreamThread-9] No custom setting defined for topic 'flash-app-xmc-pool-share-store-hour-repartition' using original config 'earliest' for offset reset 2019-11-19 05:50:48.100|INFO |flash-client-xmc-StreamThread-9|o.a.k.c.c.i.Fetcher|583|[Consumer clientId=flash-client-xmc-StreamThread-9-consumer, groupId=flash-app-xmc] Resetting offset for partition flash-app-xmc-pool-share-store-hour-repartition-1 to offset 0. 2019-11-19 05:50:48.102|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-9-10_0-producer|o.a.k.c.Metadata|285|Cluster ID: lRcgc40URC2lSyDaA32lgQ 2019-11-19 05:50:48.103|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-2-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:48.106|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-2-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:48.106|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-2] State transition from PARTITIONS_ASSIGNED to RUNNING 2019-11-19 05:50:48.107|INFO |flash-client-xmc-StreamThread-2|o.a.k.s.p.i.StreamThread|967|stream-thread [flash-client-xmc-StreamThread-2] No custom setting defined for topic 'flash-app-xmc-pool-share-store-day-repartition' using original config 'earliest' for offset reset 2019-11-19 05:50:48.108|INFO |flash-client-xmc-StreamThread-2|o.a.k.c.c.i.Fetcher|583|[Consumer clientId=flash-client-xmc-StreamThread-2-consumer, groupId=flash-app-xmc] Resetting offset for partition flash-app-xmc-pool-share-store-day-repartition-0 to offset 0. 2019-11-19 05:50:48.151|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-9-12_2-producer|o.a.k.c.Metadata|285|Cluster ID: lRcgc40URC2lSyDaA32lgQ 2019-11-19 05:50:48.248|WARN |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-8] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-user-share-store-hour-changelog-1=2039329} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:48.249|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-8] Reinitializing StreamTask TaskId: 8_1 ProcessorTopology: KSTREAM-SOURCE-0000000052: topics: [flash-app-xmc-user-share-store-hour-repartition] children: [KSTREAM-AGGREGATE-0000000049] KSTREAM-AGGREGATE-0000000049: states: [user-share-store-hour] children: [KTABLE-TOSTREAM-0000000053] KTABLE-TOSTREAM-0000000053: children: [KSTREAM-SINK-0000000054] KSTREAM-SINK-0000000054: topic: StaticTopicNameExtractor(xmc-user-share-hour) Partitions [flash-app-xmc-user-share-store-hour-repartition-1] for changelog flash-app-xmc-user-share-store-hour-changelog-1 2019-11-19 05:50:48.251|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-8-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:48.256|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-8-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:48.256|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-8] State transition from PARTITIONS_ASSIGNED to RUNNING 2019-11-19 05:50:48.257|INFO |flash-client-xmc-StreamThread-8|o.a.k.s.p.i.StreamThread|967|stream-thread [flash-client-xmc-StreamThread-8] No custom setting defined for topic 'flash-app-xmc-pool-share-store-day-repartition' using original config 'earliest' for offset reset 2019-11-19 05:50:48.257|INFO |flash-client-xmc-StreamThread-8|o.a.k.c.c.i.Fetcher|583|[Consumer clientId=flash-client-xmc-StreamThread-8-consumer, groupId=flash-app-xmc] Resetting offset for partition flash-app-xmc-pool-share-store-day-repartition-1 to offset 0. 2019-11-19 05:50:48.520|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-2-10_2-producer|o.a.k.c.Metadata|285|Cluster ID: lRcgc40URC2lSyDaA32lgQ 2019-11-19 05:50:48.704|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=flash-client-xmc-StreamThread-1-restore-consumer, groupId=] Node 0 was unable to process the fetch request with (sessionId=733477335, epoch=9): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:48.705|WARN |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-1] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-hour-changelog-1=6123916} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:48.705|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-1] Reinitializing StreamTask TaskId: 11_1 ProcessorTopology: KSTREAM-SOURCE-0000000079: topics: [flash-app-xmc-worker-share-store-hour-repartition] children: [KSTREAM-AGGREGATE-0000000076] KSTREAM-AGGREGATE-0000000076: states: [worker-share-store-hour] children: [KTABLE-TOSTREAM-0000000080] KTABLE-TOSTREAM-0000000080: children: [KSTREAM-SINK-0000000081] KSTREAM-SINK-0000000081: topic: StaticTopicNameExtractor(xmc-worker-share-hour) Partitions [flash-app-xmc-worker-share-store-hour-repartition-1] for changelog flash-app-xmc-worker-share-store-hour-changelog-1 2019-11-19 05:50:48.710|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-1-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:48.714|INFO |flash-client-xmc-StreamThread-1|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-1-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:48.714|INFO |flash-client-xmc-StreamThread-1|o.a.k.s.p.i.StreamThread|207|stream-thread [flash-client-xmc-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING 2019-11-19 05:50:48.719|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-1-8_2-producer|o.a.k.c.Metadata|285|Cluster ID: lRcgc40URC2lSyDaA32lgQ 2019-11-19 05:50:48.742|INFO |kafka-producer-network-thread | flash-client-xmc-StreamThread-1-11_1-producer|o.a.k.c.Metadata|285|Cluster ID: lRcgc40URC2lSyDaA32lgQ 2019-11-19 05:50:49.021|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|215|stream-thread [flash-client-xmc-StreamThread-3] No checkpoint found for task 7_2 state store user-share-store-minute changelog flash-app-xmc-user-share-store-minute-changelog-2 with EOS turned on. Reinitializing the tas k and restore its state from the beginning. 2019-11-19 05:50:49.023|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.c.i.Fetcher|583|[Consumer clientId=flash-client-xmc-StreamThread-3-restore-consumer, groupId=] Resetting offset for partition flash-app-xmc-user-share-store-minute-changelog-2 to offset 1150937. 2019-11-19 05:50:49.053|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=flash-client-xmc-StreamThread-3-restore-consumer, groupId=] Node 0 was unable to process the fetch request with (sessionId=377267410, epoch=55): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:49.053|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=flash-client-xmc-StreamThread-3-restore-consumer, groupId=] Node 1 was unable to process the fetch request with (sessionId=1301279447, epoch=5): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:49.054|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.FetchSessionHandler|381|[Consumer clientId=flash-client-xmc-StreamThread-3-restore-consumer, groupId=] Node 2 was unable to process the fetch request with (sessionId=2009367442, epoch=100): FETCH_SESSION_ID_NOT_FOUND. 2019-11-19 05:50:49.054|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.055|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.057|INFO |flash-client-xmc-StreamThread-3|o.a.k.c.c.KafkaConsumer|1031|[Consumer clientId=flash-client-xmc-StreamThread-3-restore-consumer, groupId=] Unsubscribed all topics or patterns and assigned partitions 2019-11-19 05:50:49.071|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.072|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.082|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.082|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.095|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.095|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.110|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.110|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.122|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.122|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.131|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.131|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.141|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.141|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.154|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.154|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.163|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.163|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.172|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.172|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.183|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.183|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.193|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.193|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.204|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.204|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.221|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.221|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.232|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.232|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.241|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.242|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.253|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.253|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.263|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.264|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.298|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.299|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.313|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.313|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.323|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.324|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.334|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.334|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.344|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.344|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.356|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.356|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.362|INFO |flash-client-xmc-StreamThread-7|o.a.k.s.p.i.StoreChangelogReader|215|stream-thread [flash-client-xmc-StreamThread-7] No checkpoint found for task 14_1 state store node-share-store-day changelog flash-app-xmc-node-share-store-day-changelog-1 with EOS turned on. Reinitializing the task and restore its state from the beginning. 2019-11-19 05:50:49.362|INFO |flash-client-xmc-StreamThread-7|o.a.k.c.c.i.Fetcher|583|[Consumer clientId=flash-client-xmc-StreamThread-7-restore-consumer, groupId=] Resetting offset for partition flash-app-xmc-node-share-store-day-changelog-1 to offset 40852. 2019-11-19 05:50:49.368|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.368|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.378|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.378|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: children: [KSTREAM-SINK-0000000072] KSTREAM-SINK-0000000072: topic: StaticTopicNameExtractor(xmc-worker-share-minute) Partitions [flash-app-xmc-worker-share-store-minute-repartition-1] for changelog flash-app-xmc-worker-share-store-minute-changelog-1 2019-11-19 05:50:49.389|WARN |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|101|stream-thread [flash-client-xmc-StreamThread-3] Restoring StreamTasks failed. Deleting StreamTasks stores to recreate from scratch. org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {flash-app-xmc-worker-share-store-minute-changelog-1=6128684} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:987) 2019-11-19 05:50:49.390|INFO |flash-client-xmc-StreamThread-3|o.a.k.s.p.i.StoreChangelogReader|105|stream-thread [flash-client-xmc-StreamThread-3] Reinitializing StreamTask TaskId: 10_1 ProcessorTopology: KSTREAM-SOURCE-0000000070: topics: [flash-app-xmc-worker-share-store-minute-repartition] children: [KSTREAM-AGGREGATE-0000000067] KSTREAM-AGGREGATE-0000000067: states: [worker-share-store-minute] children: [KTABLE-TOSTREAM-0000000071] KTABLE-TOSTREAM-0000000071: