===== 1. phase (start 1st client) ===== Group Leader on client-1: [2020-03-31 06:50:36,811] INFO stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer] Assigned tasks to clients as - 59fda4c3-f31e-491d-b2f0-48b0f4858094=[ activeTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) standbyTasks: ([]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([]) prevAssignedTasks: ([]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([]) capacity: 1] Client-1: [2020-03-31 06:50:37,391] INFO [Consumer clientId=EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-0, data-3, data-2, data-4] Current owned partitions: [] Added partitions (assigned - owned): [data-1, data-0, data-3, data-2, data-4] Revoked partitions (owned - assigned): [] [2020-03-31 06:50:37,396] INFO stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1] Handle new assignment with: New active tasks: [0_0, 0_1, 0_2, 0_3, 0_4] New standby tasks: [] Existing active tasks: [] Existing standby tasks: [] ===== 2. phase (start 2nd client) ===== [2020-03-31 06:50:45,869] INFO stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer] Assigned tasks to clients as - 59fda4c3-f31e-491d-b2f0-48b0f4858094=[ activeTasks: ([0_0, 0_1, 0_4]) standbyTasks: ([0_2, 0_3]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevStandbyTasks: ([]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-0, data-3, data-2, data-4]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=-2, 0_2=-2, 0_3=-2, 0_4=-2]) capacity: 1] - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_2, 0_3]) standbyTasks: ([0_0, 0_1, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([]) prevAssignedTasks: ([]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([]) capacity: 1] Client-2: [2020-03-31 06:50:45,918] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [] Current owned partitions: [] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:50:45,922] INFO stream-thread [EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1] Handle new assignment with: New active tasks: [] New standby tasks: [0_0, 0_4, 0_1] Existing active tasks: [] Existing standby tasks: [] Client-1: [2020-03-31 06:50:46,021] INFO [Consumer clientId=EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-0, data-4] Current owned partitions: [data-1, data-0, data-3, data-2, data-4] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [data-3, data-2] [2020-03-31 06:50:46,021] INFO [Consumer clientId=EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer, groupId=EosTest] Revoke previously assigned partitions data-3, data-2 [2020-03-31 06:50:46,022] DEBUG stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1] Current state RUNNING: revoked partitions [data-3, data-2] because of consumer rebalance. currently assigned active tasks: [0_0, 0_1, 0_2, 0_3, 0_4] currently assigned standby tasks: [] [2020-03-31 06:50:46,149] INFO stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1] Handle new assignment with: New active tasks: [0_0, 0_1, 0_4] New standby tasks: [0_2, 0_3] Existing active tasks: [0_0, 0_1, 0_2, 0_3, 0_4] Group Leader on client-1: [2020-03-31 06:50:49,033] INFO stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer] Assigned tasks to clients as - 59fda4c3-f31e-491d-b2f0-48b0f4858094=[ activeTasks: ([0_0, 0_1, 0_3]) standbyTasks: ([0_2, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_1, 0_4]) prevStandbyTasks: ([0_2, 0_3]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-0, data-4]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=-2, 0_2=0, 0_3=0, 0_4=-2]) capacity: 1] - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_2, 0_4]) standbyTasks: ([0_0, 0_1, 0_3]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([0_0, 0_1, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_4]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([0_0=1012, 0_1=1020, 0_4=1026]) capacity: 1] Client-2: [2020-03-31 06:50:49,071] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-2] Current owned partitions: [] Added partitions (assigned - owned): [data-2] Revoked partitions (owned - assigned): [] [2020-03-31 06:50:49,072] INFO stream-thread [EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1] Handle new assignment with: New active tasks: [0_2] New standby tasks: [0_0, 0_1, 0_3] Existing active tasks: [] Existing standby tasks: [0_0, 0_1, 0_4] Client-1: [2020-03-31 06:50:49,141] INFO [Consumer clientId=EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-0, data-3] Current owned partitions: [data-1, data-0, data-4] Added partitions (assigned - owned): [data-3] Revoked partitions (owned - assigned): [data-4] [2020-03-31 06:50:49,141] INFO [Consumer clientId=EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer, groupId=EosTest] Revoke previously assigned partitions data-4 [2020-03-31 06:50:49,141] DEBUG stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1] Current state RUNNING: revoked partitions [data-4] because of consumer rebalance. currently assigned active tasks: [0_0, 0_1, 0_4] currently assigned standby tasks: [0_2, 0_3] [2020-03-31 06:50:49,197] INFO stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1] Handle new assignment with: New active tasks: [0_0, 0_1, 0_3] New standby tasks: [0_4, 0_2] Existing active tasks: [0_0, 0_1, 0_4] Existing standby tasks: [0_2, 0_3] ===== 2. phase not finished (ie, group not stable) and 3. phase (start 3rd client) ===== [2020-03-31 06:50:52,321] INFO stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer] Assigned tasks to clients as - 59fda4c3-f31e-491d-b2f0-48b0f4858094=[ activeTasks: ([0_0, 0_3]) standbyTasks: ([0_1, 0_2, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_1, 0_3]) prevStandbyTasks: ([0_2, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-0, data-3]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=-2, 0_2=1006, 0_3=0, 0_4=0]) capacity: 1] - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_2, 0_4]) standbyTasks: ([0_0, 0_1, 0_3]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_2]) prevStandbyTasks: ([0_0, 0_1, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-2]) changelogOffsetTotalsByTask: ([0_0=1240, 0_1=1304, 0_2=-2, 0_3=1062, 0_4=1024]) capacity: 1] - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_1]) standbyTasks: ([0_0, 0_2, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([]) prevAssignedTasks: ([]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([]) capacity: 1] (-> Missing "Updating assignment" log for client-2 -> not clear why) Client-3: [2020-03-31 06:50:52,310] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [] Current owned partitions: [] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:50:52,314] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Handle new assignment with: New active tasks: [] New standby tasks: [0_0, 0_2, 0_3, 0_4] Existing active tasks: [] Existing standby tasks: [] Client-1: [2020-03-31 06:50:52,337] INFO [Consumer clientId=EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0, data-3] Current owned partitions: [data-1, data-0, data-3] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [data-1] [2020-03-31 06:50:52,337] INFO [Consumer clientId=EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer, groupId=EosTest] Revoke previously assigned partitions data-1 [2020-03-31 06:50:52,337] DEBUG stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1] Current state RUNNING: revoked partitions [data-1] because of consumer rebalance. currently assigned active tasks: [0_0, 0_1, 0_3] currently assigned standby tasks: [0_2, 0_4] [2020-03-31 06:50:52,338] DEBUG [Producer clientId=EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-producer, transactionalId=EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094] Begin adding offsets { data-1=OffsetAndMetadata{offset=622, leaderEpoch=null, metadata='AQAAAXEvW1zO'}} for consumer group GroupMetadata(groupId = EosTest, generationId = 4, memberId = EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer-9e94eeca-1ce9-4aec-84b7-1c9e05714ac3, groupInstanceId = ) to transaction [2020-03-31 06:50:52,362] INFO stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1] Handle new assignment with: New active tasks: [0_0, 0_3] New standby tasks: [0_4, 0_1, 0_2] Existing active tasks: [0_0, 0_1, 0_3] Existing standby tasks: [0_2, 0_4] Group Leader at client-1: [2020-03-31 06:50:55,374] INFO stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer] Assigned tasks to clients as - 59fda4c3-f31e-491d-b2f0-48b0f4858094=[ activeTasks: ([0_0]) standbyTasks: ([0_1, 0_2, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_3]) prevStandbyTasks: ([0_1, 0_2, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-0, data-3]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=0, 0_2=1300, 0_3=-2, 0_4=1298]) capacity: 1]. - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_1, 0_2]) standbyTasks: ([0_0, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_2]) prevStandbyTasks: ([0_0, 0_1, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-2]) changelogOffsetTotalsByTask: ([0_0=1240, 0_1=1304, 0_2=-2, 0_3=1062, 0_4=1024]) capacity: 1] - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_3, 0_4]) standbyTasks: ([0_0, 0_1, 0_2]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([0_0, 0_2, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([0_0=1240, 0_2=1594, 0_3=1062, 0_4=1298]) capacity: 1] Client-3: [2020-03-31 06:50:55,433] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-4] Current owned partitions: [] Added partitions (assigned - owned): [data-4] Revoked partitions (owned - assigned): [] (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2020-03-31 06:50:55,433] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Handle new assignment with: New active tasks: [0_4] New standby tasks: [0_0, 0_1, 0_2] Existing active tasks: [] Existing standby tasks: [0_0, 0_2, 0_3, 0_4] Client-1: [2020-03-31 06:50:55,477] INFO [Consumer clientId=EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0] Current owned partitions: [data-0, data-3] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [data-3] [2020-03-31 06:50:55,477] INFO [Consumer clientId=EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1-consumer, groupId=EosTest] Revoke previously assigned partitions data-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2020-03-31 06:50:55,477] DEBUG stream-thread [EosTest-59fda4c3-f31e-491d-b2f0-48b0f4858094-StreamThread-1] Current state RUNNING: revoked partitions [data-3] because of consumer rebalance. currently assigned active tasks: [0_0, 0_3] currently assigned standby tasks: [0_1, 0_2, 0_4] Client-2: [2020-03-31 06:50:55,514] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-2] Current owned partitions: [data-2] Added partitions (assigned - owned): [data-1] Revoked partitions (owned - assigned): [] [2020-03-31 06:50:55,514] INFO stream-thread [EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1] Handle new assignment with: New active tasks: [0_1, 0_2] New standby tasks: [0_0, 0_4, 0_3] Existing active tasks: [0_2] Existing standby tasks: [0_0, 0_1, 0_3] ===== 4. phase (kill and restart 1st client) ===== Group Leader at client-3: [2020-03-31 06:51:08,823] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer] Assigned tasks to clients as - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_1, 0_2]) standbyTasks: ([0_0, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_1, 0_2]) prevStandbyTasks: ([0_0, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-2]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=-2, 0_2=-2, 0_3=1062, 0_4=2096]) capacity: 1] - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_0, 0_3, 0_4]) standbyTasks: ([0_1, 0_2]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_4]) prevStandbyTasks: ([0_0, 0_1, 0_2, 0_3]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-4]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=2216, 0_2=2176, 0_3=1060, 0_4=-2]) capacity: 1] Client-3: [2020-03-31 06:51:08,930] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0, data-3, data-4] Current owned partitions: [data-4] Added partitions (assigned - owned): [data-0, data-3] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:08,930] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Handle new assignment with: New active tasks: [0_0, 0_3, 0_4] New standby tasks: [0_1, 0_2] Existing active tasks: [0_4] Existing standby tasks: [0_0, 0_1, 0_2] Client-2: [2020-03-31 06:51:08,955] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-2] Current owned partitions: [data-1, data-2] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:08,955] INFO stream-thread [EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1] Handle new assignment with: New active tasks: [0_1, 0_2] New standby tasks: [0_0, 0_4, 0_3] Existing active tasks: [0_1, 0_2] Existing standby tasks: [0_0, 0_3, 0_4] (restart 1st client) Group Leader at client-3: [2020-03-31 06:51:12,113] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer] Assigned tasks to clients as - 555c3a7c-33b8-410f-a686-2e4831cc0edb=[ activeTasks: ([0_2]) standbyTasks: ([0_0, 0_1, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([]) prevAssignedTasks: ([]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([]) capacity: 1] - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_0, 0_3]) standbyTasks: ([0_1, 0_2, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_3, 0_4]) prevStandbyTasks: ([0_1, 0_2]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-0, data-3, data-4]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=3456, 0_2=3352, 0_3=-2, 0_4=-2]) capacity: 1] - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_1, 0_4]) standbyTasks: ([0_0, 0_2, 0_3]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_1, 0_2]) prevStandbyTasks: ([0_0, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-2]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=-2, 0_2=-2, 0_3=3378, 0_4=3238]) capacity: 1] Client-1: [2020-03-31 06:51:12,142] INFO [Consumer clientId=EosTest-555c3a7c-33b8-410f-a686-2e4831cc0edb-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [] Current owned partitions: [] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:12,146] INFO stream-thread [EosTest-555c3a7c-33b8-410f-a686-2e4831cc0edb-StreamThread-1] Handle new assignment with: New active tasks: [] New standby tasks: [0_0, 0_1, 0_3, 0_4] Existing active tasks: [] Existing standby tasks: [] Client-3: [2020-03-31 06:51:12,216] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0, data-3] Current owned partitions: [data-0, data-3, data-4] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [data-4] [2020-03-31 06:51:12,216] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Revoke previously assigned partitions data-4 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2020-03-31 06:51:12,216] DEBUG stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Current state RUNNING: revoked partitions [data-4] because of consumer rebalance. currently assigned active tasks: [0_0, 0_3, 0_4] currently assigned standby tasks: [0_1, 0_2] Client-2: [2020-03-31 06:51:12,243] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1] Current owned partitions: [data-1, data-2] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [data-2] [2020-03-31 06:51:12,243] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Revoke previously assigned partitions data-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2020-03-31 06:51:12,243] DEBUG stream-thread [EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1] Current state RUNNING: revoked partitions [data-2] because of consumer rebalance. currently assigned active tasks: [0_1, 0_2] currently assigned standby tasks: [0_0, 0_3, 0_4] Group Leader at client-3: [2020-03-31 06:51:15,271] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer] Assigned tasks to clients as - 555c3a7c-33b8-410f-a686-2e4831cc0edb=[ activeTasks: ([0_3]) standbyTasks: ([0_0, 0_1, 0_2, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([0_0, 0_1, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=3482, 0_3=3404, 0_4=3258]) capacity: 1] - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_0, 0_2]) standbyTasks: ([0_1, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_3]) prevStandbyTasks: ([0_1, 0_2, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-0, data-3]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=3456, 0_2=3352, 0_3=-2, 0_4=0]) capacity: 1] - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_1, 0_4]) standbyTasks: ([0_0, 0_2, 0_3]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_1]) prevStandbyTasks: ([0_0, 0_2, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=-2, 0_2=0, 0_3=3378, 0_4=3236]) capacity: 1] Client-1: [2020-03-31 06:51:15,297] INFO [Consumer clientId=EosTest-555c3a7c-33b8-410f-a686-2e4831cc0edb-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [] Current owned partitions: [] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:15,298] INFO stream-thread [EosTest-555c3a7c-33b8-410f-a686-2e4831cc0edb-StreamThread-1] Handle new assignment with: New active tasks: [] New standby tasks: [0_0, 0_1, 0_2, 0_4] Existing active tasks: [] Existing standby tasks: [0_0, 0_1, 0_3, 0_4] Client-3: [2020-03-31 06:51:15,374] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0, data-2] Current owned partitions: [data-0, data-3] Added partitions (assigned - owned): [data-2] Revoked partitions (owned - assigned): [data-3] [2020-03-31 06:51:15,374] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Revoke previously assigned partitions data-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2020-03-31 06:51:15,374] DEBUG stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Current state RUNNING: revoked partitions [data-3] because of consumer rebalance. currently assigned active tasks: [0_0, 0_3] currently assigned standby tasks: [0_1, 0_2, 0_4] Client-2: [2020-03-31 06:51:15,393] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-4] Current owned partitions: [data-1] Added partitions (assigned - owned): [data-4] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:15,393] INFO stream-thread [EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1] Handle new assignment with: New active tasks: [0_1, 0_4] New standby tasks: [0_0, 0_2, 0_3] Existing active tasks: [0_1] Existing standby tasks: [0_0, 0_2, 0_3] Group Leader at client-3: [2020-03-31 06:51:18,545] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer] Assigned tasks to clients as - 555c3a7c-33b8-410f-a686-2e4831cc0edb=[ activeTasks: ([0_2]) standbyTasks: ([0_0, 0_1, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=4024, 0_2=3374, 0_3=3402, 0_4=3714]) capacity: 1] - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_0, 0_3]) standbyTasks: ([0_1, 0_2, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_2]) prevStandbyTasks: ([0_1, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-0, data-2]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=3482, 0_2=0, 0_3=0, 0_4=3258]) capacity: 1] - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_1, 0_4]) standbyTasks: ([0_0, 0_2, 0_3]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_1, 0_4]) prevStandbyTasks: ([0_0, 0_2, 0_3]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-4]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=-2, 0_2=3374, 0_3=3668, 0_4=-2]) capacity: 1] (-> Missing "Updating assignment" log for client-2 -> not clear why) Client-3: [2020-03-31 06:51:18,553] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0, data-3] Current owned partitions: [data-0, data-2] Added partitions (assigned - owned): [data-3] Revoked partitions (owned - assigned): [data-2] [2020-03-31 06:51:18,553] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Revoke previously assigned partitions data-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2020-03-31 06:51:18,553] DEBUG stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Current state RUNNING: revoked partitions [data-2] because of consumer rebalance. currently assigned active tasks: [0_0, 0_2] currently assigned standby tasks: [0_1, 0_3, 0_4] Client-1: [2020-03-31 06:51:18,574] INFO [Consumer clientId=EosTest-555c3a7c-33b8-410f-a686-2e4831cc0edb-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [] Current owned partitions: [] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:18,574] INFO stream-thread [EosTest-555c3a7c-33b8-410f-a686-2e4831cc0edb-StreamThread-1] Handle new assignment with: New active tasks: [] New standby tasks: [0_0, 0_1, 0_3, 0_4] Existing active tasks: [] Existing standby tasks: [0_0, 0_1, 0_2, 0_4] Group Leader at client-3: [2020-03-31 06:51:21,612] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer] Assigned tasks to clients as - 555c3a7c-33b8-410f-a686-2e4831cc0edb=[ activeTasks: ([0_2]) standbyTasks: ([0_0, 0_1, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=4092, 0_2=3372, 0_3=3668, 0_4=3772]) capacity: 1] - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_0, 0_3]) standbyTasks: ([0_1, 0_2, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_3]) prevStandbyTasks: ([0_1, 0_2, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-0, data-3]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=3787, 0_2=0, 0_3=0, 0_4=3515]) capacity: 1] - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_1, 0_4]) standbyTasks: ([0_0, 0_2, 0_3]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_1, 0_4]) prevStandbyTasks: ([0_0, 0_2, 0_3]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-4]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=-2, 0_2=3374, 0_3=3668, 0_4=-2]) capacity: 1] Client-1: [2020-03-31 06:51:21,636] INFO [Consumer clientId=EosTest-555c3a7c-33b8-410f-a686-2e4831cc0edb-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-2] Current owned partitions: [] Added partitions (assigned - owned): [data-2] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:21,637] INFO stream-thread [EosTest-555c3a7c-33b8-410f-a686-2e4831cc0edb-StreamThread-1] Handle new assignment with: New active tasks: [0_2] New standby tasks: [0_0, 0_1, 0_3, 0_4] Existing active tasks: [] Existing standby tasks: [0_0, 0_1, 0_3, 0_4] Client-3: [2020-03-31 06:51:21,717] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0, data-3] Current owned partitions: [data-0, data-3] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:21,718] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Handle new assignment with: New active tasks: [0_0, 0_3] New standby tasks: [0_4, 0_1, 0_2] Existing active tasks: [0_0, 0_3] Existing standby tasks: [0_1, 0_2, 0_4] Client-2: [2020-03-31 06:51:21,840] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-4] Current owned partitions: [data-1, data-4] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:21,840] INFO stream-thread [EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1] Handle new assignment with: New active tasks: [0_1, 0_4] New standby tasks: [0_0, 0_2, 0_3] Existing active tasks: [0_1, 0_4] Existing standby tasks: [0_0, 0_2, 0_3] ===== 4. phase (again, kill 1st client and restart) ===== Group Leader at client-3: [2020-03-31 06:51:34,061] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer] Assigned tasks to clients as - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_0, 0_2, 0_3]) standbyTasks: ([0_1, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_3]) prevStandbyTasks: ([0_1, 0_2, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-0, data-3]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=5676, 0_2=3870, 0_3=-2, 0_4=5246]) capacity: 1] - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_1, 0_4]) standbyTasks: ([0_0, 0_2, 0_3]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_1, 0_4]) prevStandbyTasks: ([0_0, 0_2, 0_3]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-4]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=-2, 0_2=3870, 0_3=5330, 0_4=-2]) capacity: 1] Client-3: [2020-03-31 06:51:34,163] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0, data-3, data-2] Current owned partitions: [data-0, data-3] Added partitions (assigned - owned): [data-2] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:34,163] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Handle new assignment with: New active tasks: [0_0, 0_2, 0_3] New standby tasks: [0_4, 0_1] Existing active tasks: [0_0, 0_3] Existing standby tasks: [0_1, 0_2, 0_4] Client-2: [2020-03-31 06:51:34,297] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-4] Current owned partitions: [data-1, data-4] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:34,297] INFO stream-thread [EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1] Handle new assignment with: New active tasks: [0_1, 0_4] New standby tasks: [0_0, 0_2, 0_3] Existing active tasks: [0_1, 0_4] Existing standby tasks: [0_0, 0_2, 0_3] (Restart 1st client) Group Leader at client-3: [2020-03-31 06:51:37,460] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer] Assigned tasks to clients as - c134b571-4ba0-4b32-b38d-ab4d4486fa98=[ activeTasks: ([0_3]) standbyTasks: ([0_0, 0_1, 0_2, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([0_0, 0_1, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([0_0=1784, 0_1=4243, 0_3=3666, 0_4=3905]) capacity: 1] - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_0, 0_2]) standbyTasks: ([0_1, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_2, 0_3]) prevStandbyTasks: ([0_1, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-0, data-3, data-2]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=6020, 0_2=-2, 0_3=-2, 0_4=5572]) capacity: 1] - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_1, 0_4]) standbyTasks: ([0_0, 0_2, 0_3]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_1, 0_4]) prevStandbyTasks: ([0_0, 0_2, 0_3]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-4]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=-2, 0_2=3870, 0_3=5646, 0_4=-2]) capacity: 1] Client-1: [2020-03-31 06:51:37,489] INFO [Consumer clientId=EosTest-c134b571-4ba0-4b32-b38d-ab4d4486fa98-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [] Current owned partitions: [] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:37,494] INFO stream-thread [EosTest-c134b571-4ba0-4b32-b38d-ab4d4486fa98-StreamThread-1] Handle new assignment with: New active tasks: [] New standby tasks: [0_0, 0_1, 0_2, 0_4] Existing active tasks: [] Existing standby tasks: [] Client-3: [2020-03-31 06:51:37,564] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0, data-2] Current owned partitions: [data-0, data-3, data-2] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [data-3] [2020-03-31 06:51:37,564] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Revoke previously assigned partitions data-3 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2020-03-31 06:51:37,564] DEBUG stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Current state RUNNING: revoked partitions [data-3] because of consumer rebalance. currently assigned active tasks: [0_0, 0_2, 0_3] currently assigned standby tasks: [0_1, 0_4] Client-2: [2020-03-31 06:51:37,647] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-4] Current owned partitions: [data-1, data-4] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:37,647] INFO stream-thread [EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1] Handle new assignment with: New active tasks: [0_1, 0_4] New standby tasks: [0_0, 0_2, 0_3] Existing active tasks: [0_1, 0_4] Existing standby tasks: [0_0, 0_2, 0_3] Group Leader at client-3: [2020-03-31 06:51:40,863] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer] Assigned tasks to clients as - c134b571-4ba0-4b32-b38d-ab4d4486fa98=[ activeTasks: ([0_2]) standbyTasks: ([0_0, 0_1, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=6344, 0_2=3870, 0_3=3666, 0_4=5842]) capacity: 1] - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_0, 0_3]) standbyTasks: ([0_1, 0_2, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_2]) prevStandbyTasks: ([0_1, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-0, data-2]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=6054, 0_2=-2, 0_3=0, 0_4=5588]) capacity: 1] - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_1, 0_4]) standbyTasks: ([0_0, 0_2, 0_3]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_1, 0_4]) prevStandbyTasks: ([0_0, 0_2, 0_3]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-4]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=-2, 0_2=3870, 0_3=5678, 0_4=-2]) capacity: 1] Client-1: [2020-03-31 06:51:40,892] INFO [Consumer clientId=EosTest-c134b571-4ba0-4b32-b38d-ab4d4486fa98-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [] Current owned partitions: [] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:40,892] INFO stream-thread [EosTest-c134b571-4ba0-4b32-b38d-ab4d4486fa98-StreamThread-1] Handle new assignment with: New active tasks: [] New standby tasks: [0_0, 0_1, 0_3, 0_4] Existing active tasks: [] Existing standby tasks: [0_0, 0_1, 0_2, 0_4] Client-3: [2020-03-31 06:51:40,969] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0, data-3] Current owned partitions: [data-0, data-2] Added partitions (assigned - owned): [data-3] Revoked partitions (owned - assigned): [data-2] [2020-03-31 06:51:40,969] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Revoke previously assigned partitions data-2 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2020-03-31 06:51:40,970] DEBUG stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Current state RUNNING: revoked partitions [data-2] because of consumer rebalance. currently assigned active tasks: [0_0, 0_2] currently assigned standby tasks: [0_1, 0_3, 0_4] Client-2: [2020-03-31 06:51:41,099] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-4] Current owned partitions: [data-1, data-4] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:41,099] INFO stream-thread [EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1] Handle new assignment with: New active tasks: [0_1, 0_4] New standby tasks: [0_0, 0_2, 0_3] Existing active tasks: [0_1, 0_4] Existing standby tasks: [0_0, 0_2, 0_3] Group Leader at client-3: [2020-03-31 06:51:44,272] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer] Assigned tasks to clients as - c134b571-4ba0-4b32-b38d-ab4d4486fa98=[ activeTasks: ([0_2]) standbyTasks: ([0_0, 0_1, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([]) prevStandbyTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=6706, 0_2=3868, 0_3=5678, 0_4=6190]) capacity: 1] - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_0, 0_3]) standbyTasks: ([0_1, 0_2, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_3]) prevStandbyTasks: ([0_1, 0_2, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-0, data-3]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=6414, 0_2=0, 0_3=0, 0_4=5918]) capacity: 1] - 2de14e93-c296-47ae-94b4-52356266ea5f=[ activeTasks: ([0_1, 0_4]) standbyTasks: ([0_0, 0_2, 0_3]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_1, 0_4]) prevStandbyTasks: ([0_0, 0_2, 0_3]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-4]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=-2, 0_2=3870, 0_3=5678, 0_4=-2]) capacity: 1] Client-3: [2020-03-31 06:51:44,287] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0, data-3] Current owned partitions: [data-0, data-3] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:44,287] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Handle new assignment with: New active tasks: [0_0, 0_3] New standby tasks: [0_4, 0_1, 0_2] Existing active tasks: [0_0, 0_3] Existing standby tasks: [0_1, 0_2, 0_4] Client-1: [2020-03-31 06:51:44,306] INFO [Consumer clientId=EosTest-c134b571-4ba0-4b32-b38d-ab4d4486fa98-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-2] Current owned partitions: [] Added partitions (assigned - owned): [data-2] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:44,307] INFO stream-thread [EosTest-c134b571-4ba0-4b32-b38d-ab4d4486fa98-StreamThread-1] Handle new assignment with: New active tasks: [0_2] New standby tasks: [0_0, 0_1, 0_3, 0_4] Existing active tasks: [] Existing standby tasks: [0_0, 0_1, 0_3, 0_4] Client-2: [2020-03-31 06:51:44,508] INFO [Consumer clientId=EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-4] Current owned partitions: [data-1, data-4] Added partitions (assigned - owned): [] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:44,508] INFO stream-thread [EosTest-2de14e93-c296-47ae-94b4-52356266ea5f-StreamThread-1] Handle new assignment with: New active tasks: [0_1, 0_4] New standby tasks: [0_0, 0_2, 0_3] Existing active tasks: [0_1, 0_4] Existing standby tasks: [0_0, 0_2, 0_3] ===== Shutdown phase (Stop client in order: 2, 3, 1) ===== Group Leader at client-3: [2020-03-31 06:51:56,655] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer] Assigned tasks to clients as - c134b571-4ba0-4b32-b38d-ab4d4486fa98=[ activeTasks: ([0_1, 0_2]) standbyTasks: ([0_0, 0_3, 0_4]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_2]) prevStandbyTasks: ([0_0, 0_1, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-2]) changelogOffsetTotalsByTask: ([0_0=1786, 0_1=6890, 0_2=-2, 0_3=7426, 0_4=6380]) capacity: 1] - 729056a9-7f70-42cf-abbf-23241dfe3952=[ activeTasks: ([0_0, 0_3, 0_4]) standbyTasks: ([0_1, 0_2]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_0, 0_3]) prevStandbyTasks: ([0_1, 0_2, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-0, data-3]) changelogOffsetTotalsByTask: ([0_0=-2, 0_1=6890, 0_2=6202, 0_3=-2, 0_4=6380]) capacity: 1] Client-3: [2020-03-31 06:51:56,757] INFO [Consumer clientId=EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-0, data-3, data-4] Current owned partitions: [data-0, data-3] Added partitions (assigned - owned): [data-4] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:56,757] INFO stream-thread [EosTest-729056a9-7f70-42cf-abbf-23241dfe3952-StreamThread-1] Handle new assignment with: New active tasks: [0_0, 0_3, 0_4] New standby tasks: [0_1, 0_2] Existing active tasks: [0_0, 0_3] Existing standby tasks: [0_1, 0_2, 0_4] Client-1: [2020-03-31 06:51:56,777] INFO [Consumer clientId=EosTest-c134b571-4ba0-4b32-b38d-ab4d4486fa98-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-2] Current owned partitions: [data-2] Added partitions (assigned - owned): [data-1] Revoked partitions (owned - assigned): [] [2020-03-31 06:51:56,778] INFO stream-thread [EosTest-c134b571-4ba0-4b32-b38d-ab4d4486fa98-StreamThread-1] Handle new assignment with: New active tasks: [0_1, 0_2] New standby tasks: [0_0, 0_4, 0_3] Existing active tasks: [0_2] Existing standby tasks: [0_0, 0_1, 0_3, 0_4] Group Leader at client-1: [2020-03-31 06:52:09,112] INFO stream-thread [EosTest-c134b571-4ba0-4b32-b38d-ab4d4486fa98-StreamThread-1-consumer] Assigned tasks to clients as - c134b571-4ba0-4b32-b38d-ab4d4486fa98=[ activeTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) standbyTasks: ([]) assignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevActiveTasks: ([0_1, 0_2]) prevStandbyTasks: ([0_0, 0_3, 0_4]) prevAssignedTasks: ([0_0, 0_1, 0_2, 0_3, 0_4]) prevOwnedPartitionsByConsumerId: ([data-1, data-2]) changelogOffsetTotalsByTask: ([0_0=7677, 0_1=-2, 0_2=-2, 0_3=7564, 0_4=6380]) capacity: 1] Client-1: [2020-03-31 06:52:09,218] INFO [Consumer clientId=EosTest-c134b571-4ba0-4b32-b38d-ab4d4486fa98-StreamThread-1-consumer, groupId=EosTest] Updating assignment with Assigned partitions: [data-1, data-0, data-3, data-2, data-4] Current owned partitions: [data-1, data-2] Added partitions (assigned - owned): [data-0, data-3, data-4] Revoked partitions (owned - assigned): [] [2020-03-31 06:52:09,219] INFO stream-thread [EosTest-c134b571-4ba0-4b32-b38d-ab4d4486fa98-StreamThread-1] Handle new assignment with: New active tasks: [0_0, 0_1, 0_2, 0_3, 0_4] New standby tasks: [] Existing active tasks: [0_1, 0_2] Existing standby tasks: [0_0, 0_3, 0_4]