[2017-05-24 15:26:19,458] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Creating consumer client (org.apache.kafka.streams.processor.internals.StreamThread:465) [2017-05-24 15:26:19,521] WARN Error while loading kafka-version.properties :null (org.apache.kafka.common.utils.AppInfoParser:42) [2017-05-24 15:26:19,522] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Creating restore consumer client (org.apache.kafka.streams.processor.internals.StreamThread:475) [2017-05-24 15:26:19,534] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from NOT_RUNNING to RUNNING. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:26:19,798] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Starting (org.apache.kafka.streams.processor.internals.StreamThread:515) [2017-05-24 15:26:19,813] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] at state RUNNING: partitions [] revoked at the beginning of consumer rebalance. current assigned active tasks: [] current assigned standby tasks: [] (org.apache.kafka.streams.processor.internals.StreamThread:199) [2017-05-24 15:26:19,813] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from RUNNING to PARTITIONS_REVOKED. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:26:19,813] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] suspendTasksAndState: suspending all active tasks [] and standby tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1097) [2017-05-24 15:26:19,814] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Updating suspended tasks to contain active tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1391) [2017-05-24 15:26:19,814] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Removing all active tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1398) [2017-05-24 15:26:19,814] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Removing all standby tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1412) [2017-05-24 15:26:19,814] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] partition revocation took 1 ms. suspended active tasks: [] suspended standby tasks: [] previous active tasks: [] (org.apache.kafka.streams.processor.internals.StreamThread:221) [2017-05-24 15:26:19,816] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] found [us.Trigger] topics possibly matching regex (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:258) [2017-05-24 15:26:19,816] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] updating builder with SubscriptionUpdates{updatedTopicSubscriptions=[us.Trigger]} topic(s) with possible matching regex subscription(s) (org.apache.kafka.streams.processor.TopologyBuilder:1550) [2017-05-24 15:26:19,817] DEBUG nodeToSourceTopics {KSTREAM-SOURCE-0000000000=[us.Trigger]} (org.apache.kafka.streams.processor.TopologyBuilder:1371) [2017-05-24 15:26:20,143] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] at state PARTITIONS_REVOKED: new partitions [us.Trigger-2] assigned at the end of consumer rebalance. assigned active tasks: [0_2] assigned standby tasks: [] current suspended active tasks: [] current suspended standby tasks: [] previous active tasks: [] (org.apache.kafka.streams.processor.internals.StreamThread:154) [2017-05-24 15:26:20,146] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:26:20,147] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Adding assigned tasks as active {0_2=[us.Trigger-2]} (org.apache.kafka.streams.processor.internals.StreamThread:1271) [2017-05-24 15:26:20,147] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] New active tasks to be created: {0_2=[us.Trigger-2]} (org.apache.kafka.streams.processor.internals.StreamThread:1302) [2017-05-24 15:26:20,147] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Creating active task 0_2 with assigned partitions [[us.Trigger-2]] (org.apache.kafka.streams.processor.internals.StreamThread:1221) [2017-05-24 15:26:20,167] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Creating shared producer client (org.apache.kafka.streams.processor.internals.StreamThread:1254) [2017-05-24 15:26:20,208] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Acquired state dir lock for task 0_2 (org.apache.kafka.streams.processor.internals.StateDirectory:135) [2017-05-24 15:26:20,209] INFO task [0_2] Created state store manager for task 0_2 with the acquired state dir lock (org.apache.kafka.streams.processor.internals.ProcessorStateManager:122) [2017-05-24 15:26:20,216] DEBUG task [0_2] Initializing (org.apache.kafka.streams.processor.internals.StreamTask:138) [2017-05-24 15:26:20,217] DEBUG task [0_2] Initializing state stores (org.apache.kafka.streams.processor.internals.AbstractTask:194) [2017-05-24 15:26:20,217] DEBUG task [0_2] Updating store offset limits {} (org.apache.kafka.streams.processor.internals.AbstractTask:171) [2017-05-24 15:26:20,220] INFO task [0_2] Register global stores [] (org.apache.kafka.streams.processor.internals.ProcessorStateManager:352) [2017-05-24 15:26:20,220] DEBUG task [0_2] Initializing processor nodes of the topology (org.apache.kafka.streams.processor.internals.StreamTask:316) [2017-05-24 15:26:20,228] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Created active task 0_2 with assigned partitions [us.Trigger-2] (org.apache.kafka.streams.processor.internals.StreamThread:1240) [2017-05-24 15:26:20,228] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Starting restoring state stores from changelog topics [] (org.apache.kafka.streams.processor.internals.StoreChangelogReader:121) [2017-05-24 15:26:20,228] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Took 0 ms to restore all active states (org.apache.kafka.streams.processor.internals.StoreChangelogReader:156) [2017-05-24 15:26:20,228] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Adding assigned standby tasks {0_2=[us.Trigger-2]} (org.apache.kafka.streams.processor.internals.StreamThread:1336) [2017-05-24 15:26:20,228] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] New standby tasks to be created: {} (org.apache.kafka.streams.processor.internals.StreamThread:1355) [2017-05-24 15:26:20,229] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from ASSIGNING_PARTITIONS to RUNNING. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:26:20,229] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] partition assignment took 84 ms. current active tasks: [0_2] current standby tasks: [] (org.apache.kafka.streams.processor.internals.StreamThread:187) [2017-05-24 15:26:49,654] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing all active tasks [0_2] and standby tasks [] because the commit interval 30000ms has elapsed by 30021ms (org.apache.kafka.streams.processor.internals.StreamThread:767) [2017-05-24 15:26:49,655] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing task StreamTask 0_2 (org.apache.kafka.streams.processor.internals.StreamThread:805) [2017-05-24 15:26:49,656] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:26:49,661] DEBUG task [0_2] Committing offsets (org.apache.kafka.streams.processor.internals.StreamTask:285) [2017-05-24 15:27:19,661] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing all active tasks [0_2] and standby tasks [] because the commit interval 30000ms has elapsed by 30005ms (org.apache.kafka.streams.processor.internals.StreamThread:767) [2017-05-24 15:27:19,661] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing task StreamTask 0_2 (org.apache.kafka.streams.processor.internals.StreamThread:805) [2017-05-24 15:27:19,661] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:27:19,663] DEBUG task [0_2] Committing offsets (org.apache.kafka.streams.processor.internals.StreamTask:285) [2017-05-24 15:27:36,880] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] at state RUNNING: partitions [us.Trigger-2] revoked at the beginning of consumer rebalance. current assigned active tasks: [0_2] current assigned standby tasks: [] (org.apache.kafka.streams.processor.internals.StreamThread:199) [2017-05-24 15:27:36,881] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from RUNNING to PARTITIONS_REVOKED. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:27:36,881] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] suspendTasksAndState: suspending all active tasks [0_2] and standby tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1097) [2017-05-24 15:27:36,881] DEBUG task [0_2] Suspending (org.apache.kafka.streams.processor.internals.StreamTask:351) [2017-05-24 15:27:36,881] DEBUG task [0_2] Closing processor topology (org.apache.kafka.streams.processor.internals.StreamTask:359) [2017-05-24 15:27:36,884] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:27:36,886] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Updating suspended tasks to contain active tasks [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:1391) [2017-05-24 15:27:36,886] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Removing all active tasks [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:1398) [2017-05-24 15:27:36,886] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Removing all standby tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1412) [2017-05-24 15:27:36,886] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] partition revocation took 5 ms. suspended active tasks: [0_2] suspended standby tasks: [] previous active tasks: [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:221) [2017-05-24 15:27:36,887] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] found [us.Trigger, demo.Trigger] topics possibly matching regex (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:258) [2017-05-24 15:27:36,887] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] updating builder with SubscriptionUpdates{updatedTopicSubscriptions=[us.Trigger, demo.Trigger]} topic(s) with possible matching regex subscription(s) (org.apache.kafka.streams.processor.TopologyBuilder:1550) [2017-05-24 15:27:36,887] DEBUG nodeToSourceTopics {KSTREAM-SOURCE-0000000000=[us.Trigger, demo.Trigger]} (org.apache.kafka.streams.processor.TopologyBuilder:1371) [2017-05-24 15:27:37,289] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] at state PARTITIONS_REVOKED: new partitions [us.Trigger-2] assigned at the end of consumer rebalance. assigned active tasks: [0_2] assigned standby tasks: [] current suspended active tasks: [0_2] current suspended standby tasks: [] previous active tasks: [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:154) [2017-05-24 15:27:37,290] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:27:37,290] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Adding assigned tasks as active {0_2=[us.Trigger-2]} (org.apache.kafka.streams.processor.internals.StreamThread:1271) [2017-05-24 15:27:37,290] DEBUG task [0_2] Resuming (org.apache.kafka.streams.processor.internals.StreamTask:157) [2017-05-24 15:27:37,290] DEBUG task [0_2] Initializing processor nodes of the topology (org.apache.kafka.streams.processor.internals.StreamTask:316) [2017-05-24 15:27:37,293] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] New active tasks to be created: {} (org.apache.kafka.streams.processor.internals.StreamThread:1302) [2017-05-24 15:27:37,294] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Starting restoring state stores from changelog topics [] (org.apache.kafka.streams.processor.internals.StoreChangelogReader:121) [2017-05-24 15:27:37,294] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Took 0 ms to restore all active states (org.apache.kafka.streams.processor.internals.StoreChangelogReader:156) [2017-05-24 15:27:37,294] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Adding assigned standby tasks {0_2=[us.Trigger-2]} (org.apache.kafka.streams.processor.internals.StreamThread:1336) [2017-05-24 15:27:37,294] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] New standby tasks to be created: {} (org.apache.kafka.streams.processor.internals.StreamThread:1355) [2017-05-24 15:27:37,294] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from ASSIGNING_PARTITIONS to RUNNING. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:27:37,294] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] partition assignment took 4 ms. current active tasks: [0_2] current standby tasks: [] (org.apache.kafka.streams.processor.internals.StreamThread:187) [2017-05-24 15:27:40,302] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] at state RUNNING: partitions [us.Trigger-2] revoked at the beginning of consumer rebalance. current assigned active tasks: [0_2] current assigned standby tasks: [] (org.apache.kafka.streams.processor.internals.StreamThread:199) [2017-05-24 15:27:40,303] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from RUNNING to PARTITIONS_REVOKED. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:27:40,303] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] suspendTasksAndState: suspending all active tasks [0_2] and standby tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1097) [2017-05-24 15:27:40,303] DEBUG task [0_2] Suspending (org.apache.kafka.streams.processor.internals.StreamTask:351) [2017-05-24 15:27:40,303] DEBUG task [0_2] Closing processor topology (org.apache.kafka.streams.processor.internals.StreamTask:359) [2017-05-24 15:27:40,305] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:27:40,306] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Updating suspended tasks to contain active tasks [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:1391) [2017-05-24 15:27:40,306] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Removing all active tasks [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:1398) [2017-05-24 15:27:40,306] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Removing all standby tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1412) [2017-05-24 15:27:40,306] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] partition revocation took 3 ms. suspended active tasks: [0_2] suspended standby tasks: [] previous active tasks: [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:221) [2017-05-24 15:27:40,307] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] found [us.Trigger, demo.Trigger] topics possibly matching regex (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:258) [2017-05-24 15:27:40,307] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] updating builder with SubscriptionUpdates{updatedTopicSubscriptions=[us.Trigger, demo.Trigger]} topic(s) with possible matching regex subscription(s) (org.apache.kafka.streams.processor.TopologyBuilder:1550) [2017-05-24 15:27:40,307] DEBUG nodeToSourceTopics {KSTREAM-SOURCE-0000000000=[us.Trigger, demo.Trigger]} (org.apache.kafka.streams.processor.TopologyBuilder:1371) [2017-05-24 15:27:40,325] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] at state PARTITIONS_REVOKED: new partitions [us.Trigger-2, demo.Trigger-2] assigned at the end of consumer rebalance. assigned active tasks: [0_2] assigned standby tasks: [] current suspended active tasks: [0_2] current suspended standby tasks: [] previous active tasks: [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:154) [2017-05-24 15:27:40,326] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:27:40,326] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Closing suspended non-assigned active task 0_2 (org.apache.kafka.streams.processor.internals.StreamThread:1189) [2017-05-24 15:27:40,326] DEBUG task [0_2] Closing (org.apache.kafka.streams.processor.internals.StreamTask:398) [2017-05-24 15:27:40,326] DEBUG task [0_2] Suspending (org.apache.kafka.streams.processor.internals.StreamTask:351) [2017-05-24 15:27:40,326] DEBUG task [0_2] Closing processor topology (org.apache.kafka.streams.processor.internals.StreamTask:359) [2017-05-24 15:27:40,326] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:27:40,329] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Released state dir lock for task 0_2 (org.apache.kafka.streams.processor.internals.StateDirectory:191) [2017-05-24 15:27:40,330] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Adding assigned tasks as active {0_2=[us.Trigger-2, demo.Trigger-2]} (org.apache.kafka.streams.processor.internals.StreamThread:1271) [2017-05-24 15:27:40,330] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] New active tasks to be created: {0_2=[us.Trigger-2, demo.Trigger-2]} (org.apache.kafka.streams.processor.internals.StreamThread:1302) [2017-05-24 15:27:40,330] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Creating active task 0_2 with assigned partitions [[us.Trigger-2, demo.Trigger-2]] (org.apache.kafka.streams.processor.internals.StreamThread:1221) [2017-05-24 15:27:40,331] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Acquired state dir lock for task 0_2 (org.apache.kafka.streams.processor.internals.StateDirectory:135) [2017-05-24 15:27:40,331] INFO task [0_2] Created state store manager for task 0_2 with the acquired state dir lock (org.apache.kafka.streams.processor.internals.ProcessorStateManager:122) [2017-05-24 15:27:40,332] DEBUG task [0_2] Initializing (org.apache.kafka.streams.processor.internals.StreamTask:138) [2017-05-24 15:27:40,332] DEBUG task [0_2] Initializing state stores (org.apache.kafka.streams.processor.internals.AbstractTask:194) [2017-05-24 15:27:40,332] DEBUG task [0_2] Updating store offset limits {} (org.apache.kafka.streams.processor.internals.AbstractTask:171) [2017-05-24 15:27:40,332] INFO task [0_2] Register global stores [] (org.apache.kafka.streams.processor.internals.ProcessorStateManager:352) [2017-05-24 15:27:40,333] DEBUG task [0_2] Initializing processor nodes of the topology (org.apache.kafka.streams.processor.internals.StreamTask:316) [2017-05-24 15:27:40,335] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Created active task 0_2 with assigned partitions [us.Trigger-2, demo.Trigger-2] (org.apache.kafka.streams.processor.internals.StreamThread:1240) [2017-05-24 15:27:40,335] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Starting restoring state stores from changelog topics [] (org.apache.kafka.streams.processor.internals.StoreChangelogReader:121) [2017-05-24 15:27:40,335] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Took 0 ms to restore all active states (org.apache.kafka.streams.processor.internals.StoreChangelogReader:156) [2017-05-24 15:27:40,335] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Adding assigned standby tasks {0_2=[us.Trigger-2, demo.Trigger-2]} (org.apache.kafka.streams.processor.internals.StreamThread:1336) [2017-05-24 15:27:40,335] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] New standby tasks to be created: {} (org.apache.kafka.streams.processor.internals.StreamThread:1355) [2017-05-24 15:27:40,335] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from ASSIGNING_PARTITIONS to RUNNING. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:27:40,335] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] partition assignment took 9 ms. current active tasks: [0_2] current standby tasks: [] (org.apache.kafka.streams.processor.internals.StreamThread:187) [2017-05-24 15:27:49,675] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing all active tasks [0_2] and standby tasks [] because the commit interval 30000ms has elapsed by 30012ms (org.apache.kafka.streams.processor.internals.StreamThread:767) [2017-05-24 15:27:49,675] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing task StreamTask 0_2 (org.apache.kafka.streams.processor.internals.StreamThread:805) [2017-05-24 15:27:49,676] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:28:19,728] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing all active tasks [0_2] and standby tasks [] because the commit interval 30000ms has elapsed by 30055ms (org.apache.kafka.streams.processor.internals.StreamThread:767) [2017-05-24 15:28:19,728] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing task StreamTask 0_2 (org.apache.kafka.streams.processor.internals.StreamThread:805) [2017-05-24 15:28:19,729] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:28:19,730] DEBUG task [0_2] Committing offsets (org.apache.kafka.streams.processor.internals.StreamTask:285) [2017-05-24 15:28:49,798] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing all active tasks [0_2] and standby tasks [] because the commit interval 30000ms has elapsed by 30072ms (org.apache.kafka.streams.processor.internals.StreamThread:767) [2017-05-24 15:28:49,798] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing task StreamTask 0_2 (org.apache.kafka.streams.processor.internals.StreamThread:805) [2017-05-24 15:28:49,799] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:28:49,800] DEBUG task [0_2] Committing offsets (org.apache.kafka.streams.processor.internals.StreamTask:285) [2017-05-24 15:29:19,842] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing all active tasks [0_2] and standby tasks [] because the commit interval 30000ms has elapsed by 30040ms (org.apache.kafka.streams.processor.internals.StreamThread:767) [2017-05-24 15:29:19,842] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing task StreamTask 0_2 (org.apache.kafka.streams.processor.internals.StreamThread:805) [2017-05-24 15:29:19,842] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:29:19,844] DEBUG task [0_2] Committing offsets (org.apache.kafka.streams.processor.internals.StreamTask:285) [2017-05-24 15:29:49,942] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing all active tasks [0_2] and standby tasks [] because the commit interval 30000ms has elapsed by 30100ms (org.apache.kafka.streams.processor.internals.StreamThread:767) [2017-05-24 15:29:49,942] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Committing task StreamTask 0_2 (org.apache.kafka.streams.processor.internals.StreamThread:805) [2017-05-24 15:29:49,942] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:29:49,944] DEBUG task [0_2] Committing offsets (org.apache.kafka.streams.processor.internals.StreamTask:285) [2017-05-24 15:30:14,181] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] at state RUNNING: partitions [us.Trigger-2, demo.Trigger-2] revoked at the beginning of consumer rebalance. current assigned active tasks: [0_2] current assigned standby tasks: [] (org.apache.kafka.streams.processor.internals.StreamThread:199) [2017-05-24 15:30:14,181] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from RUNNING to PARTITIONS_REVOKED. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:30:14,181] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] suspendTasksAndState: suspending all active tasks [0_2] and standby tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1097) [2017-05-24 15:30:14,181] DEBUG task [0_2] Suspending (org.apache.kafka.streams.processor.internals.StreamTask:351) [2017-05-24 15:30:14,181] DEBUG task [0_2] Closing processor topology (org.apache.kafka.streams.processor.internals.StreamTask:359) [2017-05-24 15:30:14,182] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:30:14,184] DEBUG task [0_2] Committing offsets (org.apache.kafka.streams.processor.internals.StreamTask:285) [2017-05-24 15:30:14,185] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Updating suspended tasks to contain active tasks [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:1391) [2017-05-24 15:30:14,185] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Removing all active tasks [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:1398) [2017-05-24 15:30:14,185] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Removing all standby tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1412) [2017-05-24 15:30:14,185] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] partition revocation took 4 ms. suspended active tasks: [0_2] suspended standby tasks: [] previous active tasks: [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:221) [2017-05-24 15:30:14,185] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] found [us.Trigger, demo.Trigger] topics possibly matching regex (org.apache.kafka.streams.processor.internals.StreamPartitionAssignor:258) [2017-05-24 15:30:14,186] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] updating builder with SubscriptionUpdates{updatedTopicSubscriptions=[us.Trigger, demo.Trigger]} topic(s) with possible matching regex subscription(s) (org.apache.kafka.streams.processor.TopologyBuilder:1550) [2017-05-24 15:30:14,186] DEBUG nodeToSourceTopics {KSTREAM-SOURCE-0000000000=[us.Trigger, demo.Trigger]} (org.apache.kafka.streams.processor.TopologyBuilder:1371) [2017-05-24 15:30:14,448] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] at state PARTITIONS_REVOKED: new partitions [us.Trigger-2, foo.Trigger-2, demo.Trigger-2] assigned at the end of consumer rebalance. assigned active tasks: [0_2] assigned standby tasks: [] current suspended active tasks: [0_2] current suspended standby tasks: [] previous active tasks: [0_2] (org.apache.kafka.streams.processor.internals.StreamThread:154) [2017-05-24 15:30:14,448] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] State transition from PARTITIONS_REVOKED to ASSIGNING_PARTITIONS. (org.apache.kafka.streams.processor.internals.StreamThread:972) [2017-05-24 15:30:14,449] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Closing suspended non-assigned active task 0_2 (org.apache.kafka.streams.processor.internals.StreamThread:1189) [2017-05-24 15:30:14,449] DEBUG task [0_2] Closing (org.apache.kafka.streams.processor.internals.StreamTask:398) [2017-05-24 15:30:14,449] DEBUG task [0_2] Suspending (org.apache.kafka.streams.processor.internals.StreamTask:351) [2017-05-24 15:30:14,449] DEBUG task [0_2] Closing processor topology (org.apache.kafka.streams.processor.internals.StreamTask:359) [2017-05-24 15:30:14,449] DEBUG task [0_2] Flushing producer (org.apache.kafka.streams.processor.internals.RecordCollectorImpl:134) [2017-05-24 15:30:14,451] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Released state dir lock for task 0_2 (org.apache.kafka.streams.processor.internals.StateDirectory:191) [2017-05-24 15:30:14,452] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Adding assigned tasks as active {0_2=[us.Trigger-2, foo.Trigger-2, demo.Trigger-2]} (org.apache.kafka.streams.processor.internals.StreamThread:1271) [2017-05-24 15:30:14,452] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] New active tasks to be created: {0_2=[us.Trigger-2, foo.Trigger-2, demo.Trigger-2]} (org.apache.kafka.streams.processor.internals.StreamThread:1302) [2017-05-24 15:30:14,452] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Creating active task 0_2 with assigned partitions [[us.Trigger-2, foo.Trigger-2, demo.Trigger-2]] (org.apache.kafka.streams.processor.internals.StreamThread:1221) [2017-05-24 15:30:14,452] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Acquired state dir lock for task 0_2 (org.apache.kafka.streams.processor.internals.StateDirectory:135) [2017-05-24 15:30:14,453] INFO task [0_2] Created state store manager for task 0_2 with the acquired state dir lock (org.apache.kafka.streams.processor.internals.ProcessorStateManager:122) [2017-05-24 15:30:14,453] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Created active task 0_2 with assigned partitions [us.Trigger-2, foo.Trigger-2, demo.Trigger-2] (org.apache.kafka.streams.processor.internals.StreamThread:1240) [2017-05-24 15:30:14,453] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] partition assignment took 5 ms. current active tasks: [] current standby tasks: [] (org.apache.kafka.streams.processor.internals.StreamThread:187) [2017-05-24 15:30:14,454] ERROR User provided listener org.apache.kafka.streams.processor.internals.StreamThread$RebalanceListener for group reballancing-test failed on partition assignment (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator:269) java.lang.NullPointerException at org.apache.kafka.streams.processor.internals.StreamTask.(StreamTask.java:122) at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:1238) at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:286) at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:247) at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:1304) at org.apache.kafka.streams.processor.internals.StreamThread.access$1100(StreamThread.java:72) at org.apache.kafka.streams.processor.internals.StreamThread$RebalanceListener.onPartitionsAssigned(StreamThread.java:177) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:265) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:363) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:310) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:296) at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1046) at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1011) at org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:574) at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:545) at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:519) [2017-05-24 15:30:14,457] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Shutting down (org.apache.kafka.streams.processor.internals.StreamThread:1032) [2017-05-24 15:30:14,457] DEBUG stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] shutdownTasksAndState: shutting downactive tasks [], standby tasks [], suspended tasks [], and suspended standby tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1071) org.apache.kafka.streams.errors.StreamsException: stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Failed to rebalance. at org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:581) at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:545) at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:519) Caused by: java.lang.NullPointerException at org.apache.kafka.streams.processor.internals.StreamTask.(StreamTask.java:122) at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:1238) at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:286) at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:247) at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:1304) at org.apache.kafka.streams.processor.internals.StreamThread.access$1100(StreamThread.java:72) at org.apache.kafka.streams.processor.internals.StreamThread$RebalanceListener.onPartitionsAssigned(StreamThread.java:177) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:265) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:363) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:310) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:296) at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1046) at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1011) at org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:574) ... 2 more [2017-05-24 15:30:14,462] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Removing all active tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1398) [2017-05-24 15:30:14,462] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Removing all standby tasks [] (org.apache.kafka.streams.processor.internals.StreamThread:1412) [2017-05-24 15:30:14,462] INFO stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Stream thread shutdown complete (org.apache.kafka.streams.processor.internals.StreamThread:1064) [2017-05-24 15:30:14,462] WARN stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Unexpected state transition from ASSIGNING_PARTITIONS to NOT_RUNNING. (org.apache.kafka.streams.processor.internals.StreamThread:970) found exception stream-thread [reballancing-test-ad7dab9f-1512-4ff4-9be6-a0059391714f-StreamThread-1] Failed to rebalance. Process finished with exit code 0