[2021-09-02 09:01:19,506] INFO [ProducerStateManager partition=search-service-topic-dev-2] Writing producer snapshot at offset 499405 (kafka.log.ProducerStateManager)
[2021-09-02 09:01:19,506] INFO [Log partition=search-service-topic-dev-2, dir=/data/kafka-logs] Rolled new log segment at offset 499405 in 2 ms. (kafka.log.Log)
[2021-09-02 09:01:28,952] INFO [ProducerStateManager partition=search-service-topic-dev-6] Writing producer snapshot at offset 505327 (kafka.log.ProducerStateManager)
[2021-09-02 09:01:28,952] INFO [Log partition=search-service-topic-dev-6, dir=/data/kafka-logs] Rolled new log segment at offset 505327 in 1 ms. (kafka.log.Log)
[2021-09-02 09:01:33,241] INFO [ProducerStateManager partition=search-service-topic-dev-0] Writing producer snapshot at offset 499114 (kafka.log.ProducerStateManager)
[2021-09-02 09:01:33,243] INFO [Log partition=search-service-topic-dev-0, dir=/data/kafka-logs] Rolled new log segment at offset 499114 in 3 ms. (kafka.log.Log)
[2021-09-02 09:02:10,960] INFO [ProducerStateManager partition=search-service-topic-dev-5] Writing producer snapshot at offset 494811 (kafka.log.ProducerStateManager)
[2021-09-02 09:02:10,960] INFO [Log partition=search-service-topic-dev-5, dir=/data/kafka-logs] Rolled new log segment at offset 494811 in 1 ms. (kafka.log.Log)
[2021-09-02 09:04:07,483] INFO [GroupMetadataManager brokerId=0] Removed 0 expired offsets in 1 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
[2021-09-02 09:04:36,197] INFO [Log partition=work-flow-topic-dev-1, dir=/data/kafka-logs] Found deletable segments with base offsets [298714] due to retention time 604800000ms breach (kafka.log.Log)
[2021-09-02 09:04:36,197] INFO [Log partition=work-flow-topic-dev-1, dir=/data/kafka-logs] Scheduling segments for deletion List(LogSegment(baseOffset=298714, size=144166185, lastModifiedTime=1629968562000, largestTime=1629968562130)) (kafka.log.Log)
[2021-09-02 09:04:36,197] INFO [Log partition=work-flow-topic-dev-1, dir=/data/kafka-logs] Incrementing log start offset to 321098 (kafka.log.Log)
[2021-09-02 09:04:36,200] INFO [Log partition=work-flow-topic-dev-2, dir=/data/kafka-logs] Found deletable segments with base offsets [303365] due to retention time 604800000ms breach (kafka.log.Log)
[2021-09-02 09:04:36,200] INFO [Log partition=work-flow-topic-dev-2, dir=/data/kafka-logs] Scheduling segments for deletion List(LogSegment(baseOffset=303365, size=152459379, lastModifiedTime=1629968561000, largestTime=1629968561676)) (kafka.log.Log)
[2021-09-02 09:04:36,200] INFO [Log partition=work-flow-topic-dev-2, dir=/data/kafka-logs] Incrementing log start offset to 326471 (kafka.log.Log)
[2021-09-02 09:04:36,207] INFO [Log partition=work-flow-topic-dev-8, dir=/data/kafka-logs] Found deletable segments with base offsets [295842] due to retention time 604800000ms breach (kafka.log.Log)
[2021-09-02 09:04:36,208] INFO [Log partition=work-flow-topic-dev-8, dir=/data/kafka-logs] Scheduling segments for deletion List(LogSegment(baseOffset=295842, size=145802551, lastModifiedTime=1629968562000, largestTime=1629968562126)) (kafka.log.Log)
[2021-09-02 09:04:36,208] INFO [Log partition=work-flow-topic-dev-8, dir=/data/kafka-logs] Incrementing log start offset to 318271 (kafka.log.Log)
[2021-09-02 09:04:36,210] INFO [Log partition=search-service-topic-dev-6, dir=/data/kafka-logs] Found deletable segments with base offsets [476585] due to retention time 604800000ms breach (kafka.log.Log)
[2021-09-02 09:04:36,211] INFO [Log partition=search-service-topic-dev-6, dir=/data/kafka-logs] Scheduling segments for deletion List(LogSegment(baseOffset=476585, size=1073731280, lastModifiedTime=1629968488000, largestTime=1629968488777)) (kafka.log.Log)
[2021-09-02 09:04:36,211] INFO [Log partition=search-service-topic-dev-6, dir=/data/kafka-logs] Incrementing log start offset to 491318 (kafka.log.Log)
[2021-09-02 09:04:36,215] INFO [Log partition=search-service-topic-dev-5, dir=/data/kafka-logs] Found deletable segments with base offsets [466025] due to retention time 604800000ms breach (kafka.log.Log)
[2021-09-02 09:04:36,216] INFO [Log partition=search-service-topic-dev-5, dir=/data/kafka-logs] Scheduling segments for deletion List(LogSegment(baseOffset=466025, size=1073633168, lastModifiedTime=1629968526000, largestTime=1629968526142)) (kafka.log.Log)
[2021-09-02 09:04:36,216] INFO [Log partition=search-service-topic-dev-5, dir=/data/kafka-logs] Incrementing log start offset to 480870 (kafka.log.Log)
[2021-09-02 09:04:36,219] INFO [Log partition=search-service-topic-dev-3, dir=/data/kafka-logs] Found deletable segments with base offsets [469380] due to retention time 604800000ms breach (kafka.log.Log)
[2021-09-02 09:04:36,220] INFO [Log partition=search-service-topic-dev-3, dir=/data/kafka-logs] Scheduling segments for deletion List(LogSegment(baseOffset=469380, size=1073719877, lastModifiedTime=1629968555000, largestTime=1629968555591)) (kafka.log.Log)
[2021-09-02 09:04:36,220] INFO [Log partition=search-service-topic-dev-3, dir=/data/kafka-logs] Incrementing log start offset to 484241 (kafka.log.Log)
[2021-09-02 09:04:36,223] INFO [Log partition=search-service-topic-dev-2, dir=/data/kafka-logs] Found deletable segments with base offsets [470580] due to retention time 604800000ms breach (kafka.log.Log)
[2021-09-02 09:04:36,224] INFO [Log partition=search-service-topic-dev-2, dir=/data/kafka-logs] Scheduling segments for deletion List(LogSegment(baseOffset=470580, size=1073671154, lastModifiedTime=1629968479000, largestTime=1629968479278)) (kafka.log.Log)
[2021-09-02 09:04:36,224] INFO [Log partition=search-service-topic-dev-2, dir=/data/kafka-logs] Incrementing log start offset to 485518 (kafka.log.Log)
[2021-09-02 09:04:36,226] INFO [Log partition=search-service-topic-dev-0, dir=/data/kafka-logs] Found deletable segments with base offsets [470484] due to retention time 604800000ms breach (kafka.log.Log)
[2021-09-02 09:04:36,228] INFO [Log partition=search-service-topic-dev-0, dir=/data/kafka-logs] Scheduling segments for deletion List(LogSegment(baseOffset=470484, size=1073699770, lastModifiedTime=1629968493000, largestTime=1629968493042)) (kafka.log.Log)
[2021-09-02 09:04:36,228] INFO [Log partition=search-service-topic-dev-0, dir=/data/kafka-logs] Incrementing log start offset to 485294 (kafka.log.Log)
[2021-09-02 09:05:36,197] INFO [Log partition=work-flow-topic-dev-1, dir=/data/kafka-logs] Deleting segments List(LogSegment(baseOffset=298714, size=144166185, lastModifiedTime=1629968562000, largestTime=1629968562130)) (kafka.log.Log)
[2021-09-02 09:05:36,200] INFO [Log partition=work-flow-topic-dev-2, dir=/data/kafka-logs] Deleting segments List(LogSegment(baseOffset=303365, size=152459379, lastModifiedTime=1629968561000, largestTime=1629968561676)) (kafka.log.Log)
[2021-09-02 09:05:36,246] INFO Deleted log /data/kafka-logs/work-flow-topic-dev-2/00000000000000303365.log.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,246] INFO Deleted offset index /data/kafka-logs/work-flow-topic-dev-2/00000000000000303365.index.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,246] INFO Deleted time index /data/kafka-logs/work-flow-topic-dev-2/00000000000000303365.timeindex.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,246] INFO [Log partition=work-flow-topic-dev-8, dir=/data/kafka-logs] Deleting segments List(LogSegment(baseOffset=295842, size=145802551, lastModifiedTime=1629968562000, largestTime=1629968562126)) (kafka.log.Log)
[2021-09-02 09:05:36,258] INFO Deleted log /data/kafka-logs/work-flow-topic-dev-1/00000000000000298714.log.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,259] INFO Deleted offset index /data/kafka-logs/work-flow-topic-dev-1/00000000000000298714.index.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,259] INFO Deleted time index /data/kafka-logs/work-flow-topic-dev-1/00000000000000298714.timeindex.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,259] INFO [Log partition=search-service-topic-dev-6, dir=/data/kafka-logs] Deleting segments List(LogSegment(baseOffset=476585, size=1073731280, lastModifiedTime=1629968488000, largestTime=1629968488777)) (kafka.log.Log)
[2021-09-02 09:05:36,263] INFO [Log partition=search-service-topic-dev-5, dir=/data/kafka-logs] Deleting segments List(LogSegment(baseOffset=466025, size=1073633168, lastModifiedTime=1629968526000, largestTime=1629968526142)) (kafka.log.Log)
[2021-09-02 09:05:36,282] INFO Deleted log /data/kafka-logs/search-service-topic-dev-6/00000000000000476585.log.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,285] INFO Deleted offset index /data/kafka-logs/search-service-topic-dev-6/00000000000000476585.index.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,285] INFO Deleted time index /data/kafka-logs/search-service-topic-dev-6/00000000000000476585.timeindex.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,264] INFO [Log partition=search-service-topic-dev-0, dir=/data/kafka-logs] Deleting segments List(LogSegment(baseOffset=470484, size=1073699770, lastModifiedTime=1629968493000, largestTime=1629968493042)) (kafka.log.Log)
[2021-09-02 09:05:36,263] INFO [Log partition=search-service-topic-dev-2, dir=/data/kafka-logs] Deleting segments List(LogSegment(baseOffset=470580, size=1073671154, lastModifiedTime=1629968479000, largestTime=1629968479278)) (kafka.log.Log)
[2021-09-02 09:05:36,263] INFO [Log partition=search-service-topic-dev-3, dir=/data/kafka-logs] Deleting segments List(LogSegment(baseOffset=469380, size=1073719877, lastModifiedTime=1629968555000, largestTime=1629968555591)) (kafka.log.Log)
[2021-09-02 09:05:36,287] INFO Deleted log /data/kafka-logs/work-flow-topic-dev-8/00000000000000295842.log.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,290] INFO Deleted log /data/kafka-logs/search-service-topic-dev-3/00000000000000469380.log.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,288] INFO Deleted log /data/kafka-logs/search-service-topic-dev-0/00000000000000470484.log.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,287] INFO Deleted log /data/kafka-logs/search-service-topic-dev-2/00000000000000470580.log.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,292] INFO Deleted offset index /data/kafka-logs/work-flow-topic-dev-8/00000000000000295842.index.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,292] INFO Deleted offset index /data/kafka-logs/search-service-topic-dev-0/00000000000000470484.index.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,292] INFO Deleted time index /data/kafka-logs/work-flow-topic-dev-8/00000000000000295842.timeindex.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,292] INFO Deleted time index /data/kafka-logs/search-service-topic-dev-0/00000000000000470484.timeindex.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,292] INFO Deleted offset index /data/kafka-logs/search-service-topic-dev-2/00000000000000470580.index.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,292] INFO Deleted time index /data/kafka-logs/search-service-topic-dev-2/00000000000000470580.timeindex.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,292] INFO Deleted offset index /data/kafka-logs/search-service-topic-dev-3/00000000000000469380.index.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,293] INFO Deleted time index /data/kafka-logs/search-service-topic-dev-3/00000000000000469380.timeindex.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,293] INFO Deleted log /data/kafka-logs/search-service-topic-dev-5/00000000000000466025.log.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,293] INFO Deleted offset index /data/kafka-logs/search-service-topic-dev-5/00000000000000466025.index.deleted. (kafka.log.LogSegment)
[2021-09-02 09:05:36,293] INFO Deleted time index /data/kafka-logs/search-service-topic-dev-5/00000000000000466025.timeindex.deleted. (kafka.log.LogSegment)
[2021-09-02 09:06:01,460] INFO [GroupCoordinator 0]: Member[group.instance.id None, member.id consumer-46-4bc20e29-eb87-4ea1-a7b0-bb27b07c53da] in group search-service-group has left, removing it from the group (kafka.coordinator.group.GroupCoordinator)
[2021-09-02 09:06:01,460] INFO [GroupCoordinator 0]: Preparing to rebalance group search-service-group in state PreparingRebalance with old generation 260 (__consumer_offsets-24) (reason: removing member consumer-46-4bc20e29-eb87-4ea1-a7b0-bb27b07c53da on LeaveGroup) (kafka.coordinator.group.GroupCoordinator)
[2021-09-02 09:06:01,460] INFO [GroupCoordinator 0]: Group search-service-group with generation 261 is now empty (__consumer_offsets-24) (kafka.coordinator.group.GroupCoordinator)
[2021-09-02 09:14:07,481] INFO [GroupMetadataManager brokerId=0] Removed 0 expired offsets in 1 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
[2021-09-02 09:20:36,916] INFO [GroupCoordinator 0]: Member consumer-10-59b5e93c-8f33-4033-9060-ed23e7c33e12 in group commentworkflow has failed, removing it from the group (kafka.coordinator.group.GroupCoordinator)
[2021-09-02 09:20:36,916] INFO [GroupCoordinator 0]: Preparing to rebalance group commentworkflow in state PreparingRebalance with old generation 1005 (__consumer_offsets-26) (reason: removing member consumer-10-59b5e93c-8f33-4033-9060-ed23e7c33e12 on heartbeat expiration) (kafka.coordinator.group.GroupCoordinator)
[2021-09-02 09:20:37,180] INFO [GroupCoordinator 0]: Member consumer-4-37fb669f-56fe-4b87-a402-7bc734e4a97c in group commentworkflow has failed, removing it from the group (kafka.coordinator.group.GroupCoordinator)
[2021-09-02 09:20:37,181] INFO [GroupCoordinator 0]: Member consumer-8-5b18d201-1b5c-402c-a997-1fd3dd25256c in group commentworkflow has failed, removing it from the group (kafka.coordinator.group.GroupCoordinator)
[2021-09-02 09:20:37,613] INFO [GroupCoordinator 0]: Member consumer-2-b712743f-4a2d-49d7-a714-d5cf404e0e5a in group commentworkflow has failed, removing it from the group (kafka.coordinator.group.GroupCoordinator)
[2021-09-02 09:20:39,845] INFO [GroupCoordinator 0]: Member consumer-6-961b3c53-129c-4b0d-8f0d-656e82d96a40 in group commentworkflow has failed, removing it from the group (kafka.coordinator.group.GroupCoordinator)
[2021-09-02 09:20:39,845] INFO [GroupCoordinator 0]: Stabilized group commentworkflow generation 1006 (__consumer_offsets-26) (kafka.coordinator.group.GroupCoordinator)
[2021-09-02 09:20:39,846] INFO [GroupCoordinator 0]: Assignment received from leader for group commentworkflow for generation 1006 (kafka.coordinator.group.GroupCoordinator)
[2021-09-02 09:24:07,481] INFO [GroupMetadataManager brokerId=0] Removed 0 expired offsets in 1 milliseconds. (kafka.coordinator.group.GroupMetadataManager)