2021-05-06 10:09:59.193 INFO 1 --- [ main] o.a.k.s.p.internals.StreamThread : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1] Creating restore consumer client 2021-05-06 10:09:59.216 INFO 1 --- [ main] o.a.k.s.p.internals.StreamThread : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1] Creating consumer client 2021-05-06 10:09:59.219 INFO 1 --- [ main] o.a.k.s.p.i.a.AssignorConfiguration : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer] Cooperative rebalancing enabled now 2021-05-06 10:09:59.224 INFO 1 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1] Starting 2021-05-06 10:09:59.224 INFO 1 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1] State transition from CREATED to STARTING 2021-05-06 10:09:59.259 INFO 1 --- [-StreamThread-1] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Subscribed to topic(s): ieb.publish.baseline_pc.due_pattern 2021-05-06 10:09:59.414 INFO 1 --- [-StreamThread-1] org.apache.kafka.clients.Metadata : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Cluster ID: POiKlz0kQzK32ME6BBDnRg 2021-05-06 10:09:59.415 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Discovered group coordinator 1.broker:9092 (id: 2147483646 rack: null) 2021-05-06 10:09:59.538 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] (Re-)joining group 2021-05-06 10:09:59.788 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Join group failed with org.apache.kafka.common.errors.MemberIdRequiredException: The group member needs to have a valid member id before actually entering a consumer group 2021-05-06 10:09:59.789 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] (Re-)joining group 2021-05-06 10:10:03.053 INFO 1 --- [-StreamThread-1] o.a.k.s.p.i.StreamsPartitionAssignor : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer] Assigned tasks to clients as 2021-05-06 10:10:03.059 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Finished assignment for group at generation 15: {ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer-efb312c3-9c24-4088-a5e0-563a3d52c944=Assignment(partitions=[ieb.publish.baseline_pc.due_pattern-0], userDataSize=40)} 2021-05-06 10:10:03.059 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Finished assignment for group at generation 15: {ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer-efb312c3-9c24-4088-a5e0-563a3d52c944=Assignment(partitions=[ieb.publish.baseline_pc.due_pattern-0], userDataSize=40)} 2021-05-06 10:10:03.200 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.AbstractCoordinator : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Successfully joined group with generation 15 2021-05-06 10:10:03.220 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Updating assignment with 2021-05-06 10:10:03.286 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Adding newly assigned partitions: ieb.publish.baseline_pc.due_pattern-0 2021-05-06 10:10:03.286 INFO 1 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1] State transition from STARTING to PARTITIONS_ASSIGNED 2021-05-06 10:10:03.631 INFO 1 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1] Creating producer client for task 0_0 2021-05-06 10:10:03.731 INFO 1 --- [-StreamThread-1] o.a.k.clients.producer.KafkaProducer : [Producer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-0_0-producer, transactionalId=ieb-x07-baseline-pc-data-storage-due-pattern-0_0] Instantiated a transactional producer. 2021-05-06 10:10:03.864 INFO 1 --- [-StreamThread-1] o.a.k.clients.producer.KafkaProducer : [Producer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-0_0-producer, transactionalId=ieb-x07-baseline-pc-data-storage-due-pattern-0_0] Overriding the default retries config to the recommended value of 2147483647 since the idempotent producer is enabled. 2021-05-06 10:10:03.864 INFO 1 --- [-StreamThread-1] o.a.k.clients.producer.KafkaProducer : [Producer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-0_0-producer, transactionalId=ieb-x07-baseline-pc-data-storage-due-pattern-0_0] Overriding the default acks to all since idempotence is enabled. 2021-05-06 10:10:04.324 INFO 1 --- [-StreamThread-1] o.a.k.c.p.internals.TransactionManager : [Producer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-0_0-producer, transactionalId=ieb-x07-baseline-pc-data-storage-due-pattern-0_0] Invoking InitProducerId for the first time in order to acquire a producer ID 2021-05-06 10:10:04.349 INFO 1 --- [-1-0_0-producer] org.apache.kafka.clients.Metadata : [Producer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-0_0-producer, transactionalId=ieb-x07-baseline-pc-data-storage-due-pattern-0_0] Cluster ID: POiKlz0kQzK32ME6BBDnRg 2021-05-06 10:10:04.350 INFO 1 --- [-1-0_0-producer] o.a.k.c.p.internals.TransactionManager : [Producer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-0_0-producer, transactionalId=ieb-x07-baseline-pc-data-storage-due-pattern-0_0] Discovered transaction coordinator 0.broker:9092 (id: 0 rack: null) 2021-05-06 10:10:04.483 INFO 1 --- [-1-0_0-producer] o.a.k.c.p.internals.TransactionManager : [Producer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-0_0-producer, transactionalId=ieb-x07-baseline-pc-data-storage-due-pattern-0_0] ProducerId set to 17028 with epoch 28 2021-05-06 10:10:04.484 INFO 1 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1] partition assignment took 1198 ms. 2021-05-06 10:10:04.684 INFO 1 --- [age-due-pattern] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Found no committed offset for partition ieb.publish.baseline_pc.due_pattern-0 2021-05-06 10:10:05.250 INFO 1 --- [-StreamThread-1] org.apache.kafka.clients.Metadata : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-restore-consumer, groupId=null] Cluster ID: POiKlz0kQzK32ME6BBDnRg 2021-05-06 10:10:05.572 INFO 1 --- [-StreamThread-1] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-restore-consumer, groupId=null] Subscribed to partition(s): ieb-x07-baseline-pc-data-storage-due-pattern-BATCH-DUE-PATTERN-STORE-changelog-0 2021-05-06 10:10:05.573 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.SubscriptionState : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-restore-consumer, groupId=null] Seeking to EARLIEST offset of partition ieb-x07-baseline-pc-data-storage-due-pattern-BATCH-DUE-PATTERN-STORE-changelog-0 2021-05-06 10:10:05.573 INFO 1 --- [-StreamThread-1] o.a.k.s.p.i.StoreChangelogReader : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1] No checkpoint found for task 0_0 state store BATCH-DUE-PATTERN-STORE changelog ieb-x07-baseline-pc-data-storage-due-pattern-BATCH-DUE-PATTERN-STORE-changelog-0 with EOS turned on. Reinitializing the task and restore its state from the beginning. 2021-05-06 10:10:05.578 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.SubscriptionState : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-restore-consumer, groupId=null] Resetting offset for partition ieb-x07-baseline-pc-data-storage-due-pattern-BATCH-DUE-PATTERN-STORE-changelog-0 to offset 0. 2021-05-06 10:10:05.814 INFO 1 --- [-StreamThread-1] o.a.k.s.p.i.StoreChangelogReader : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1] Finished restoring all active tasks 2021-05-06 10:10:05.815 INFO 1 --- [-StreamThread-1] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-restore-consumer, groupId=null] Unsubscribed all topics or patterns and assigned partitions 2021-05-06 10:10:05.963 INFO 1 --- [age-due-pattern] o.a.k.c.c.internals.ConsumerCoordinator : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Found no committed offset for partition ieb.publish.baseline_pc.due_pattern-0 2021-05-06 10:10:05.971 INFO 1 --- [-StreamThread-1] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-restore-consumer, groupId=null] Subscribed to partition(s): ieb-x07-baseline-pc-data-storage-due-pattern-BATCH-DUE-PATTERN-STORE-changelog-0 2021-05-06 10:10:05.971 INFO 1 --- [-StreamThread-1] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-restore-consumer, groupId=null] Seeking to offset 0 for partition ieb-x07-baseline-pc-data-storage-due-pattern-BATCH-DUE-PATTERN-STORE-changelog-0 2021-05-06 10:10:07.033 INFO 1 --- [-StreamThread-1] o.a.k.s.p.i.StoreChangelogReader : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1] Finished restoring all active tasks 2021-05-06 10:10:07.034 INFO 1 --- [-StreamThread-1] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-restore-consumer, groupId=null] Unsubscribed all topics or patterns and assigned partitions 2021-05-06 10:10:07.126 INFO 1 --- [-StreamThread-1] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-restore-consumer, groupId=null] Unsubscribed all topics or patterns and assigned partitions 2021-05-06 10:10:07.126 INFO 1 --- [-StreamThread-1] o.a.k.clients.consumer.KafkaConsumer : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-restore-consumer, groupId=null] Unsubscribed all topics or patterns and assigned partitions 2021-05-06 10:10:07.126 INFO 1 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread : stream-thread [ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1] State transition from PARTITIONS_ASSIGNED to RUNNING 2021-05-06 10:10:07.233 INFO 1 --- [-StreamThread-1] o.a.k.c.c.internals.SubscriptionState : [Consumer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-consumer, groupId=ieb-x07-baseline-pc-data-storage-due-pattern] Resetting offset for partition ieb.publish.baseline_pc.due_pattern-0 to offset 0. 2021-05-06 10:10:09.023 INFO 1 --- [-1-0_0-producer] o.a.k.c.p.internals.TransactionManager : [Producer clientId=ieb-x07-baseline-pc-data-storage-due-pattern-0fb01327-b21e-4be7-851a-9985e381f8b8-StreamThread-1-0_0-producer, transactionalId=ieb-x07-baseline-pc-data-storage-due-pattern-0_0] Discovered group coordinator 1.broker:9092 (id: 1 rack: null)