[2021-07-14 17:35:09,301] INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$) [2021-07-14 17:35:10,098] INFO Setting -D jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated TLS renegotiation (org.apache.zookeeper.common.X509Util) [2021-07-14 17:35:10,240] INFO Registered signal handlers for TERM, INT, HUP (org.apache.kafka.common.utils.LoggingSignalHandler) [2021-07-14 17:35:10,246] INFO starting (kafka.server.KafkaServer) [2021-07-14 17:35:10,247] INFO Connecting to zookeeper on localhost:2181 (kafka.server.KafkaServer) [2021-07-14 17:35:10,248] DEBUG Checking login config for Zookeeper JAAS context [java.security.auth.login.config=null, zookeeper.sasl.client=default:true, zookeeper.sasl.clientconfig=default:Client] (org.apache.kafka.common.security.JaasUtils) [2021-07-14 17:35:10,273] INFO [ZooKeeperClient Kafka server] Initializing a new session to localhost:2181. (kafka.zookeeper.ZooKeeperClient) [2021-07-14 17:35:10,297] INFO Client environment:zookeeper.version=3.5.8-f439ca583e70862c3068a1f2a7d4d068eec33315, built on 05/04/2020 15:53 GMT (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:host.name=localhost (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:java.version=11 (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:java.home=/home/jdk-11 (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:java.class.path=.:/home/jdk-11/lib/dt.jar:/home/jdk-11/lib/tools.jar:/home/kafka/bin/../libs/activation-1.1.1.jar:/home/kafka/bin/../libs/aopalliance-repackaged-2.5.0.jar:/home/kafka/bin/../libs/argparse4j-0.7.0.jar:/home/kafka/bin/../libs/audience-annotations-0.5.0.jar:/home/kafka/bin/../libs/commons-cli-1.4.jar:/home/kafka/bin/../libs/commons-lang3-3.8.1.jar:/home/kafka/bin/../libs/connect-api-2.6.0.jar:/home/kafka/bin/../libs/connect-basic-auth-extension-2.6.0.jar:/home/kafka/bin/../libs/connect-file-2.6.0.jar:/home/kafka/bin/../libs/connect-json-2.6.0.jar:/home/kafka/bin/../libs/connect-mirror-2.6.0.jar:/home/kafka/bin/../libs/connect-mirror-client-2.6.0.jar:/home/kafka/bin/../libs/connect-runtime-2.6.0.jar:/home/kafka/bin/../libs/connect-transforms-2.6.0.jar:/home/kafka/bin/../libs/hk2-api-2.5.0.jar:/home/kafka/bin/../libs/hk2-locator-2.5.0.jar:/home/kafka/bin/../libs/hk2-utils-2.5.0.jar:/home/kafka/bin/../libs/jackson-annotations-2.10.2.jar:/home/kafka/bin/../libs/jackson-core-2.10.2.jar:/home/kafka/bin/../libs/jackson-databind-2.10.2.jar:/home/kafka/bin/../libs/jackson-dataformat-csv-2.10.2.jar:/home/kafka/bin/../libs/jackson-datatype-jdk8-2.10.2.jar:/home/kafka/bin/../libs/jackson-jaxrs-base-2.10.2.jar:/home/kafka/bin/../libs/jackson-jaxrs-json-provider-2.10.2.jar:/home/kafka/bin/../libs/jackson-module-jaxb-annotations-2.10.2.jar:/home/kafka/bin/../libs/jackson-module-paranamer-2.10.2.jar:/home/kafka/bin/../libs/jackson-module-scala_2.12-2.10.2.jar:/home/kafka/bin/../libs/jakarta.activation-api-1.2.1.jar:/home/kafka/bin/../libs/jakarta.annotation-api-1.3.4.jar:/home/kafka/bin/../libs/jakarta.inject-2.5.0.jar:/home/kafka/bin/../libs/jakarta.ws.rs-api-2.1.5.jar:/home/kafka/bin/../libs/jakarta.xml.bind-api-2.3.2.jar:/home/kafka/bin/../libs/javassist-3.22.0-CR2.jar:/home/kafka/bin/../libs/javassist-3.26.0-GA.jar:/home/kafka/bin/../libs/javax.servlet-api-3.1.0.jar:/home/kafka/bin/../libs/javax.ws.rs-api-2.1.1.jar:/home/kafka/bin/../libs/jaxb-api-2.3.0.jar:/home/kafka/bin/../libs/jersey-client-2.28.jar:/home/kafka/bin/../libs/jersey-common-2.28.jar:/home/kafka/bin/../libs/jersey-container-servlet-2.28.jar:/home/kafka/bin/../libs/jersey-container-servlet-core-2.28.jar:/home/kafka/bin/../libs/jersey-hk2-2.28.jar:/home/kafka/bin/../libs/jersey-media-jaxb-2.28.jar:/home/kafka/bin/../libs/jersey-server-2.28.jar:/home/kafka/bin/../libs/jetty-client-9.4.24.v20191120.jar:/home/kafka/bin/../libs/jetty-continuation-9.4.24.v20191120.jar:/home/kafka/bin/../libs/jetty-http-9.4.24.v20191120.jar:/home/kafka/bin/../libs/jetty-io-9.4.24.v20191120.jar:/home/kafka/bin/../libs/jetty-security-9.4.24.v20191120.jar:/home/kafka/bin/../libs/jetty-server-9.4.24.v20191120.jar:/home/kafka/bin/../libs/jetty-servlet-9.4.24.v20191120.jar:/home/kafka/bin/../libs/jetty-servlets-9.4.24.v20191120.jar:/home/kafka/bin/../libs/jetty-util-9.4.24.v20191120.jar:/home/kafka/bin/../libs/jopt-simple-5.0.4.jar:/home/kafka/bin/../libs/kafka_2.12-2.6.0.jar:/home/kafka/bin/../libs/kafka_2.12-2.6.0-sources.jar:/home/kafka/bin/../libs/kafka-clients-2.6.0.jar:/home/kafka/bin/../libs/kafka-log4j-appender-2.6.0.jar:/home/kafka/bin/../libs/kafka-streams-2.6.0.jar:/home/kafka/bin/../libs/kafka-streams-examples-2.6.0.jar:/home/kafka/bin/../libs/kafka-streams-scala_2.12-2.6.0.jar:/home/kafka/bin/../libs/kafka-streams-test-utils-2.6.0.jar:/home/kafka/bin/../libs/kafka-tools-2.6.0.jar:/home/kafka/bin/../libs/log4j-1.2.17.jar:/home/kafka/bin/../libs/lz4-java-1.7.1.jar:/home/kafka/bin/../libs/maven-artifact-3.6.3.jar:/home/kafka/bin/../libs/metrics-core-2.2.0.jar:/home/kafka/bin/../libs/netty-buffer-4.1.50.Final.jar:/home/kafka/bin/../libs/netty-codec-4.1.50.Final.jar:/home/kafka/bin/../libs/netty-common-4.1.50.Final.jar:/home/kafka/bin/../libs/netty-handler-4.1.50.Final.jar:/home/kafka/bin/../libs/netty-resolver-4.1.50.Final.jar:/home/kafka/bin/../libs/netty-transport-4.1.50.Final.jar:/home/kafka/bin/../libs/netty-transport-native-epoll-4.1.50.Final.jar:/home/kafka/bin/../libs/netty-transport-native-unix-common-4.1.50.Final.jar:/home/kafka/bin/../libs/osgi-resource-locator-1.0.1.jar:/home/kafka/bin/../libs/paranamer-2.8.jar:/home/kafka/bin/../libs/plexus-utils-3.2.1.jar:/home/kafka/bin/../libs/reflections-0.9.12.jar:/home/kafka/bin/../libs/rocksdbjni-5.18.4.jar:/home/kafka/bin/../libs/scala-collection-compat_2.12-2.1.6.jar:/home/kafka/bin/../libs/scala-java8-compat_2.12-0.9.1.jar:/home/kafka/bin/../libs/scala-library-2.12.11.jar:/home/kafka/bin/../libs/scala-logging_2.12-3.9.2.jar:/home/kafka/bin/../libs/scala-reflect-2.12.11.jar:/home/kafka/bin/../libs/slf4j-api-1.7.30.jar:/home/kafka/bin/../libs/slf4j-log4j12-1.7.30.jar:/home/kafka/bin/../libs/snappy-java-1.1.7.3.jar:/home/kafka/bin/../libs/validation-api-2.0.1.Final.jar:/home/kafka/bin/../libs/zookeeper-3.5.8.jar:/home/kafka/bin/../libs/zookeeper-jute-3.5.8.jar:/home/kafka/bin/../libs/zstd-jni-1.4.4-7.jar (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:java.library.path=/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:java.compiler= (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:os.version=3.10.0-1160.11.1.el7.x86_64 (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:user.name=root (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:user.home=/root (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:user.dir=/home/kafka (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:os.memory.free=1013MB (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:os.memory.max=2048MB (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,297] INFO Client environment:os.memory.total=1024MB (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,300] INFO Initiating client connection, connectString=localhost:2181 sessionTimeout=18000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@5cde6747 (org.apache.zookeeper.ZooKeeper) [2021-07-14 17:35:10,305] INFO jute.maxbuffer value is 4194304 Bytes (org.apache.zookeeper.ClientCnxnSocket) [2021-07-14 17:35:10,312] INFO zookeeper.request.timeout value is 0. feature enabled= (org.apache.zookeeper.ClientCnxn) [2021-07-14 17:35:10,314] DEBUG Initializing task scheduler. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:10,316] INFO [ZooKeeperClient Kafka server] Waiting until connected. (kafka.zookeeper.ZooKeeperClient) [2021-07-14 17:35:10,391] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2021-07-14 17:35:10,400] INFO Socket connection established, initiating session, client: /127.0.0.1:47224, server: localhost/127.0.0.1:2181 (org.apache.zookeeper.ClientCnxn) [2021-07-14 17:35:10,441] INFO Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x100aedf5ad5000b, negotiated timeout = 18000 (org.apache.zookeeper.ClientCnxn) [2021-07-14 17:35:10,443] DEBUG [ZooKeeperClient Kafka server] Received event: WatchedEvent state:SyncConnected type:None path:null (kafka.zookeeper.ZooKeeperClient) [2021-07-14 17:35:10,446] INFO [ZooKeeperClient Kafka server] Connected. (kafka.zookeeper.ZooKeeperClient) [2021-07-14 17:35:10,733] INFO Cluster ID = UMZZahX2SEKrpai9kRnziQ (kafka.server.KafkaServer) [2021-07-14 17:35:10,800] INFO KafkaConfig values: advertised.host.name = null advertised.listeners = PLAINTEXT://192.168.1.5:9092 advertised.port = null alter.config.policy.class.name = null alter.log.dirs.replication.quota.window.num = 11 alter.log.dirs.replication.quota.window.size.seconds = 1 authorizer.class.name = auto.create.topics.enable = true auto.leader.rebalance.enable = true background.threads = 10 broker.id = 0 broker.id.generation.enable = true broker.rack = null client.quota.callback.class = null compression.type = producer connection.failed.authentication.delay.ms = 100 connections.max.idle.ms = 600000 connections.max.reauth.ms = 0 control.plane.listener.name = null controlled.shutdown.enable = true controlled.shutdown.max.retries = 3 controlled.shutdown.retry.backoff.ms = 5000 controller.socket.timeout.ms = 30000 create.topic.policy.class.name = null default.replication.factor = 1 delegation.token.expiry.check.interval.ms = 3600000 delegation.token.expiry.time.ms = 86400000 delegation.token.master.key = null delegation.token.max.lifetime.ms = 604800000 delete.records.purgatory.purge.interval.requests = 1 delete.topic.enable = true fetch.max.bytes = 57671680 fetch.purgatory.purge.interval.requests = 1000 group.initial.rebalance.delay.ms = 0 group.max.session.timeout.ms = 1800000 group.max.size = 2147483647 group.min.session.timeout.ms = 6000 host.name = inter.broker.listener.name = null inter.broker.protocol.version = 2.6-IV0 kafka.metrics.polling.interval.secs = 10 kafka.metrics.reporters = [] leader.imbalance.check.interval.seconds = 300 leader.imbalance.per.broker.percentage = 10 listener.security.protocol.map = PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL listeners = null log.cleaner.backoff.ms = 15000 log.cleaner.dedupe.buffer.size = 134217728 log.cleaner.delete.retention.ms = 86400000 log.cleaner.enable = true log.cleaner.io.buffer.load.factor = 0.9 log.cleaner.io.buffer.size = 524288 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308 log.cleaner.max.compaction.lag.ms = 9223372036854775807 log.cleaner.min.cleanable.ratio = 0.5 log.cleaner.min.compaction.lag.ms = 0 log.cleaner.threads = 1 log.cleanup.policy = [delete] log.dir = /tmp/kafka-logs log.dirs = /home/kafka/data/kafka-logs log.flush.interval.messages = 9223372036854775807 log.flush.interval.ms = null log.flush.offset.checkpoint.interval.ms = 60000 log.flush.scheduler.interval.ms = 9223372036854775807 log.flush.start.offset.checkpoint.interval.ms = 60000 log.index.interval.bytes = 4096 log.index.size.max.bytes = 10485760 log.message.downconversion.enable = true log.message.format.version = 2.6-IV0 log.message.timestamp.difference.max.ms = 9223372036854775807 log.message.timestamp.type = CreateTime log.preallocate = false log.retention.bytes = -1 log.retention.check.interval.ms = 300000 log.retention.hours = 168 log.retention.minutes = null log.retention.ms = null log.roll.hours = 168 log.roll.jitter.hours = 0 log.roll.jitter.ms = null log.roll.ms = null log.segment.bytes = 1073741824 log.segment.delete.delay.ms = 60000 max.connections = 2147483647 max.connections.per.ip = 2147483647 max.connections.per.ip.overrides = max.incremental.fetch.session.cache.slots = 1000 message.max.bytes = 1048588 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 min.insync.replicas = 1 num.io.threads = 8 num.network.threads = 3 num.partitions = 1 num.recovery.threads.per.data.dir = 1 num.replica.alter.log.dirs.threads = null num.replica.fetchers = 1 offset.metadata.max.bytes = 4096 offsets.commit.required.acks = -1 offsets.commit.timeout.ms = 5000 offsets.load.buffer.size = 5242880 offsets.retention.check.interval.ms = 600000 offsets.retention.minutes = 10080 offsets.topic.compression.codec = 0 offsets.topic.num.partitions = 50 offsets.topic.replication.factor = 1 offsets.topic.segment.bytes = 104857600 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding password.encoder.iterations = 4096 password.encoder.key.length = 128 password.encoder.keyfactory.algorithm = null password.encoder.old.secret = null password.encoder.secret = null port = 9092 principal.builder.class = null producer.purgatory.purge.interval.requests = 1000 queued.max.request.bytes = -1 queued.max.requests = 500 quota.consumer.default = 9223372036854775807 quota.producer.default = 9223372036854775807 quota.window.num = 11 quota.window.size.seconds = 1 replica.fetch.backoff.ms = 1000 replica.fetch.max.bytes = 1048576 replica.fetch.min.bytes = 1 replica.fetch.response.max.bytes = 10485760 replica.fetch.wait.max.ms = 500 replica.high.watermark.checkpoint.interval.ms = 5000 replica.lag.time.max.ms = 30000 replica.selector.class = null replica.socket.receive.buffer.bytes = 65536 replica.socket.timeout.ms = 30000 replication.quota.window.num = 11 replication.quota.window.size.seconds = 1 request.timeout.ms = 30000 reserved.broker.max.id = 1000 sasl.client.callback.handler.class = null sasl.enabled.mechanisms = [GSSAPI] sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.principal.to.local.rules = [DEFAULT] sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism.inter.broker.protocol = GSSAPI sasl.server.callback.handler.class = null security.inter.broker.protocol = PLAINTEXT security.providers = null socket.receive.buffer.bytes = 102400 socket.request.max.bytes = 104857600 socket.send.buffer.bytes = 102400 ssl.cipher.suites = [] ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2, TLSv1.3] ssl.endpoint.identification.algorithm = https ssl.engine.factory.class = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.principal.mapping.rules = DEFAULT ssl.protocol = TLSv1.3 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.abort.timed.out.transaction.cleanup.interval.ms = 10000 transaction.max.timeout.ms = 900000 transaction.remove.expired.transaction.cleanup.interval.ms = 3600000 transaction.state.log.load.buffer.size = 5242880 transaction.state.log.min.isr = 1 transaction.state.log.num.partitions = 50 transaction.state.log.replication.factor = 1 transaction.state.log.segment.bytes = 104857600 transactional.id.expiration.ms = 604800000 unclean.leader.election.enable = false zookeeper.clientCnxnSocket = null zookeeper.connect = localhost:2181 zookeeper.connection.timeout.ms = 18000 zookeeper.max.in.flight.requests = 10 zookeeper.session.timeout.ms = 18000 zookeeper.set.acl = false zookeeper.ssl.cipher.suites = null zookeeper.ssl.client.enable = false zookeeper.ssl.crl.enable = false zookeeper.ssl.enabled.protocols = null zookeeper.ssl.endpoint.identification.algorithm = HTTPS zookeeper.ssl.keystore.location = null zookeeper.ssl.keystore.password = null zookeeper.ssl.keystore.type = null zookeeper.ssl.ocsp.enable = false zookeeper.ssl.protocol = TLSv1.2 zookeeper.ssl.truststore.location = null zookeeper.ssl.truststore.password = null zookeeper.ssl.truststore.type = null zookeeper.sync.time.ms = 2000 (kafka.server.KafkaConfig) [2021-07-14 17:35:10,812] INFO KafkaConfig values: advertised.host.name = null advertised.listeners = PLAINTEXT://192.168.1.5:9092 advertised.port = null alter.config.policy.class.name = null alter.log.dirs.replication.quota.window.num = 11 alter.log.dirs.replication.quota.window.size.seconds = 1 authorizer.class.name = auto.create.topics.enable = true auto.leader.rebalance.enable = true background.threads = 10 broker.id = 0 broker.id.generation.enable = true broker.rack = null client.quota.callback.class = null compression.type = producer connection.failed.authentication.delay.ms = 100 connections.max.idle.ms = 600000 connections.max.reauth.ms = 0 control.plane.listener.name = null controlled.shutdown.enable = true controlled.shutdown.max.retries = 3 controlled.shutdown.retry.backoff.ms = 5000 controller.socket.timeout.ms = 30000 create.topic.policy.class.name = null default.replication.factor = 1 delegation.token.expiry.check.interval.ms = 3600000 delegation.token.expiry.time.ms = 86400000 delegation.token.master.key = null delegation.token.max.lifetime.ms = 604800000 delete.records.purgatory.purge.interval.requests = 1 delete.topic.enable = true fetch.max.bytes = 57671680 fetch.purgatory.purge.interval.requests = 1000 group.initial.rebalance.delay.ms = 0 group.max.session.timeout.ms = 1800000 group.max.size = 2147483647 group.min.session.timeout.ms = 6000 host.name = inter.broker.listener.name = null inter.broker.protocol.version = 2.6-IV0 kafka.metrics.polling.interval.secs = 10 kafka.metrics.reporters = [] leader.imbalance.check.interval.seconds = 300 leader.imbalance.per.broker.percentage = 10 listener.security.protocol.map = PLAINTEXT:PLAINTEXT,SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,SASL_SSL:SASL_SSL listeners = null log.cleaner.backoff.ms = 15000 log.cleaner.dedupe.buffer.size = 134217728 log.cleaner.delete.retention.ms = 86400000 log.cleaner.enable = true log.cleaner.io.buffer.load.factor = 0.9 log.cleaner.io.buffer.size = 524288 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308 log.cleaner.max.compaction.lag.ms = 9223372036854775807 log.cleaner.min.cleanable.ratio = 0.5 log.cleaner.min.compaction.lag.ms = 0 log.cleaner.threads = 1 log.cleanup.policy = [delete] log.dir = /tmp/kafka-logs log.dirs = /home/kafka/data/kafka-logs log.flush.interval.messages = 9223372036854775807 log.flush.interval.ms = null log.flush.offset.checkpoint.interval.ms = 60000 log.flush.scheduler.interval.ms = 9223372036854775807 log.flush.start.offset.checkpoint.interval.ms = 60000 log.index.interval.bytes = 4096 log.index.size.max.bytes = 10485760 log.message.downconversion.enable = true log.message.format.version = 2.6-IV0 log.message.timestamp.difference.max.ms = 9223372036854775807 log.message.timestamp.type = CreateTime log.preallocate = false log.retention.bytes = -1 log.retention.check.interval.ms = 300000 log.retention.hours = 168 log.retention.minutes = null log.retention.ms = null log.roll.hours = 168 log.roll.jitter.hours = 0 log.roll.jitter.ms = null log.roll.ms = null log.segment.bytes = 1073741824 log.segment.delete.delay.ms = 60000 max.connections = 2147483647 max.connections.per.ip = 2147483647 max.connections.per.ip.overrides = max.incremental.fetch.session.cache.slots = 1000 message.max.bytes = 1048588 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 min.insync.replicas = 1 num.io.threads = 8 num.network.threads = 3 num.partitions = 1 num.recovery.threads.per.data.dir = 1 num.replica.alter.log.dirs.threads = null num.replica.fetchers = 1 offset.metadata.max.bytes = 4096 offsets.commit.required.acks = -1 offsets.commit.timeout.ms = 5000 offsets.load.buffer.size = 5242880 offsets.retention.check.interval.ms = 600000 offsets.retention.minutes = 10080 offsets.topic.compression.codec = 0 offsets.topic.num.partitions = 50 offsets.topic.replication.factor = 1 offsets.topic.segment.bytes = 104857600 password.encoder.cipher.algorithm = AES/CBC/PKCS5Padding password.encoder.iterations = 4096 password.encoder.key.length = 128 password.encoder.keyfactory.algorithm = null password.encoder.old.secret = null password.encoder.secret = null port = 9092 principal.builder.class = null producer.purgatory.purge.interval.requests = 1000 queued.max.request.bytes = -1 queued.max.requests = 500 quota.consumer.default = 9223372036854775807 quota.producer.default = 9223372036854775807 quota.window.num = 11 quota.window.size.seconds = 1 replica.fetch.backoff.ms = 1000 replica.fetch.max.bytes = 1048576 replica.fetch.min.bytes = 1 replica.fetch.response.max.bytes = 10485760 replica.fetch.wait.max.ms = 500 replica.high.watermark.checkpoint.interval.ms = 5000 replica.lag.time.max.ms = 30000 replica.selector.class = null replica.socket.receive.buffer.bytes = 65536 replica.socket.timeout.ms = 30000 replication.quota.window.num = 11 replication.quota.window.size.seconds = 1 request.timeout.ms = 30000 reserved.broker.max.id = 1000 sasl.client.callback.handler.class = null sasl.enabled.mechanisms = [GSSAPI] sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.principal.to.local.rules = [DEFAULT] sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.login.callback.handler.class = null sasl.login.class = null sasl.login.refresh.buffer.seconds = 300 sasl.login.refresh.min.period.seconds = 60 sasl.login.refresh.window.factor = 0.8 sasl.login.refresh.window.jitter = 0.05 sasl.mechanism.inter.broker.protocol = GSSAPI sasl.server.callback.handler.class = null security.inter.broker.protocol = PLAINTEXT security.providers = null socket.receive.buffer.bytes = 102400 socket.request.max.bytes = 104857600 socket.send.buffer.bytes = 102400 ssl.cipher.suites = [] ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2, TLSv1.3] ssl.endpoint.identification.algorithm = https ssl.engine.factory.class = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.principal.mapping.rules = DEFAULT ssl.protocol = TLSv1.3 ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS transaction.abort.timed.out.transaction.cleanup.interval.ms = 10000 transaction.max.timeout.ms = 900000 transaction.remove.expired.transaction.cleanup.interval.ms = 3600000 transaction.state.log.load.buffer.size = 5242880 transaction.state.log.min.isr = 1 transaction.state.log.num.partitions = 50 transaction.state.log.replication.factor = 1 transaction.state.log.segment.bytes = 104857600 transactional.id.expiration.ms = 604800000 unclean.leader.election.enable = false zookeeper.clientCnxnSocket = null zookeeper.connect = localhost:2181 zookeeper.connection.timeout.ms = 18000 zookeeper.max.in.flight.requests = 10 zookeeper.session.timeout.ms = 18000 zookeeper.set.acl = false zookeeper.ssl.cipher.suites = null zookeeper.ssl.client.enable = false zookeeper.ssl.crl.enable = false zookeeper.ssl.enabled.protocols = null zookeeper.ssl.endpoint.identification.algorithm = HTTPS zookeeper.ssl.keystore.location = null zookeeper.ssl.keystore.password = null zookeeper.ssl.keystore.type = null zookeeper.ssl.ocsp.enable = false zookeeper.ssl.protocol = TLSv1.2 zookeeper.ssl.truststore.location = null zookeeper.ssl.truststore.password = null zookeeper.ssl.truststore.type = null zookeeper.sync.time.ms = 2000 (kafka.server.KafkaConfig) [2021-07-14 17:35:10,816] DEBUG Initializing task scheduler. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:10,896] INFO [ThrottledChannelReaper-Fetch]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2021-07-14 17:35:10,896] INFO [ThrottledChannelReaper-Request]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2021-07-14 17:35:10,896] INFO [ThrottledChannelReaper-Produce]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper) [2021-07-14 17:35:11,010] INFO Loading logs from log dirs ArrayBuffer(/home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,012] INFO Attempting recovery for all logs in /home/kafka/data/kafka-logs since no clean shutdown file was found (kafka.log.LogManager) [2021-07-14 17:35:11,015] ERROR Error while reading checkpoint file /home/kafka/data/kafka-logs/log-start-offset-checkpoint (kafka.server.LogDirFailureChannel) java.nio.charset.MalformedInputException: Input length = 1 at java.base/java.nio.charset.CoderResult.throwException(CoderResult.java:274) at java.base/sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:339) at java.base/sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) at java.base/java.io.InputStreamReader.read(InputStreamReader.java:185) at java.base/java.io.BufferedReader.fill(BufferedReader.java:161) at java.base/java.io.BufferedReader.readLine(BufferedReader.java:326) at java.base/java.io.BufferedReader.readLine(BufferedReader.java:392) at kafka.server.checkpoints.CheckpointReadBuffer.read(CheckpointFile.scala:46) at kafka.server.checkpoints.CheckpointFile.liftedTree2$1(CheckpointFile.scala:130) at kafka.server.checkpoints.CheckpointFile.read(CheckpointFile.scala:126) at kafka.server.checkpoints.OffsetCheckpointFile.read(OffsetCheckpointFile.scala:61) at kafka.log.LogManager.$anonfun$loadLogs$2(LogManager.scala:336) at kafka.log.LogManager.$anonfun$loadLogs$2$adapted(LogManager.scala:310) at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62) at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49) at kafka.log.LogManager.loadLogs(LogManager.scala:310) at kafka.log.LogManager.(LogManager.scala:119) at kafka.log.LogManager$.apply(LogManager.scala:1111) at kafka.server.KafkaServer.startup(KafkaServer.scala:273) at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:44) at kafka.Kafka$.main(Kafka.scala:82) at kafka.Kafka.main(Kafka.scala) [2021-07-14 17:35:11,019] WARN Error occurred while reading log-start-offset-checkpoint file of directory /home/kafka/data/kafka-logs, resetting to the base offset of the first segment (kafka.log.LogManager) org.apache.kafka.common.errors.KafkaStorageException: Error while reading checkpoint file /home/kafka/data/kafka-logs/log-start-offset-checkpoint Caused by: java.nio.charset.MalformedInputException: Input length = 1 at java.base/java.nio.charset.CoderResult.throwException(CoderResult.java:274) at java.base/sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:339) at java.base/sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) at java.base/java.io.InputStreamReader.read(InputStreamReader.java:185) at java.base/java.io.BufferedReader.fill(BufferedReader.java:161) at java.base/java.io.BufferedReader.readLine(BufferedReader.java:326) at java.base/java.io.BufferedReader.readLine(BufferedReader.java:392) at kafka.server.checkpoints.CheckpointReadBuffer.read(CheckpointFile.scala:46) at kafka.server.checkpoints.CheckpointFile.liftedTree2$1(CheckpointFile.scala:130) at kafka.server.checkpoints.CheckpointFile.read(CheckpointFile.scala:126) at kafka.server.checkpoints.OffsetCheckpointFile.read(OffsetCheckpointFile.scala:61) at kafka.log.LogManager.$anonfun$loadLogs$2(LogManager.scala:336) at kafka.log.LogManager.$anonfun$loadLogs$2$adapted(LogManager.scala:310) at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62) at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49) at kafka.log.LogManager.loadLogs(LogManager.scala:310) at kafka.log.LogManager.(LogManager.scala:119) at kafka.log.LogManager$.apply(LogManager.scala:1111) at kafka.server.KafkaServer.startup(KafkaServer.scala:273) at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:44) at kafka.Kafka$.main(Kafka.scala:82) at kafka.Kafka.main(Kafka.scala) [2021-07-14 17:35:11,028] DEBUG Loading log /home/kafka/data/kafka-logs/test.network-0 (kafka.log.LogManager) [2021-07-14 17:35:11,133] INFO [Log partition=test.network-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 2 (kafka.log.Log) [2021-07-14 17:35:11,134] INFO [Log partition=test.network-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 2 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,148] INFO [ProducerStateManager partition=test.network-0] Writing producer snapshot at offset 2 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,162] DEBUG Loaded index file /home/kafka/data/kafka-logs/test.network-0/00000000000000000002.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 2, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,162] DEBUG Truncated index /home/kafka/data/kafka-logs/test.network-0/00000000000000000002.index to 0 entries; position is now 0 and last offset is now 2 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,162] DEBUG Index /home/kafka/data/kafka-logs/test.network-0/00000000000000000002.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,164] DEBUG Loaded index file /home/kafka/data/kafka-logs/test.network-0/00000000000000000002.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,2), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,164] DEBUG Truncated index /home/kafka/data/kafka-logs/test.network-0/00000000000000000002.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,2) (kafka.log.TimeIndex) [2021-07-14 17:35:11,164] DEBUG Index /home/kafka/data/kafka-logs/test.network-0/00000000000000000002.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,168] DEBUG Resized /home/kafka/data/kafka-logs/test.network-0/00000000000000000002.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,169] DEBUG Resized /home/kafka/data/kafka-logs/test.network-0/00000000000000000002.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,172] DEBUG Resized /home/kafka/data/kafka-logs/test.network-0/00000000000000000002.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,172] DEBUG Resized /home/kafka/data/kafka-logs/test.network-0/00000000000000000002.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,172] INFO [Log partition=test.network-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 2 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,191] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,195] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/test.network-0, topic=test.network, partition=0, highWatermark=2, lastStableOffset=2, logStartOffset=2, logEndOffset=2) with 1 segments in 158ms (1/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,195] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-0 (kafka.log.LogManager) [2021-07-14 17:35:11,236] INFO [Log partition=__consumer_offsets-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,236] INFO [Log partition=__consumer_offsets-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,241] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,241] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,241] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,242] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1621504775819,141), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,242] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,244] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,247] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,247] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,247] INFO [ProducerStateManager partition=__consumer_offsets-0] Writing producer snapshot at offset 142 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,248] INFO [Log partition=__consumer_offsets-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 142 (kafka.log.Log) [2021-07-14 17:35:11,248] INFO [Log partition=__consumer_offsets-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 142 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,249] INFO [ProducerStateManager partition=__consumer_offsets-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000142.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,252] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000142.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 142, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,252] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000142.index to 0 entries; position is now 0 and last offset is now 142 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,252] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000142.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,253] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000142.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,142), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,253] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000142.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,142) (kafka.log.TimeIndex) [2021-07-14 17:35:11,253] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000142.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,256] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000142.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,258] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000142.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,258] INFO [ProducerStateManager partition=__consumer_offsets-0] Writing producer snapshot at offset 145 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,261] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000142.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,262] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000142.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,366] DEBUG [LeaderEpochCache __consumer_offsets-0] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,366] INFO [Log partition=__consumer_offsets-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 145 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,367] INFO [ProducerStateManager partition=__consumer_offsets-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-0/00000000000000000145.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,371] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,371] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-0, topic=__consumer_offsets, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=145) with 2 segments in 176ms (2/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,371] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-29 (kafka.log.LogManager) [2021-07-14 17:35:11,373] INFO [Log partition=__consumer_offsets-29, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,373] INFO [Log partition=__consumer_offsets-29, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,374] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-29/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,374] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-29/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,374] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-29/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,376] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-29/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,376] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-29/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,376] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-29/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,377] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-29/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,377] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-29/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,378] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-29/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,379] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-29/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,379] INFO [Log partition=__consumer_offsets-29, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,382] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,383] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-29, topic=__consumer_offsets, partition=29, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 12ms (3/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,384] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-48 (kafka.log.LogManager) [2021-07-14 17:35:11,387] INFO [Log partition=__consumer_offsets-48, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,387] INFO [Log partition=__consumer_offsets-48, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,388] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,388] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,388] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,388] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619680959959,185), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,388] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,389] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,390] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,391] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,391] INFO [ProducerStateManager partition=__consumer_offsets-48] Writing producer snapshot at offset 186 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,391] INFO [Log partition=__consumer_offsets-48, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 186 (kafka.log.Log) [2021-07-14 17:35:11,392] INFO [Log partition=__consumer_offsets-48, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 186 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,392] INFO [ProducerStateManager partition=__consumer_offsets-48] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000186.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,393] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000186.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 186, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,393] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000186.index to 0 entries; position is now 0 and last offset is now 186 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,393] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000186.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,393] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000186.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1620285759959,189), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,393] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000186.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,186) (kafka.log.TimeIndex) [2021-07-14 17:35:11,394] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000186.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,394] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000186.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,395] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000186.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,395] INFO [ProducerStateManager partition=__consumer_offsets-48] Writing producer snapshot at offset 190 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,395] INFO [Log partition=__consumer_offsets-48, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 190 (kafka.log.Log) [2021-07-14 17:35:11,395] INFO [Log partition=__consumer_offsets-48, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 190 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,396] INFO [ProducerStateManager partition=__consumer_offsets-48] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000190.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,397] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000190.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 190, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,397] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000190.index to 0 entries; position is now 0 and last offset is now 190 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,397] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000190.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,398] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000190.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,190), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,398] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000190.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,190) (kafka.log.TimeIndex) [2021-07-14 17:35:11,398] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000190.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,399] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000190.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,400] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000190.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,400] INFO [ProducerStateManager partition=__consumer_offsets-48] Writing producer snapshot at offset 193 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,401] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000190.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,402] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000190.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,403] DEBUG [LeaderEpochCache __consumer_offsets-48] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,403] INFO [Log partition=__consumer_offsets-48, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 193 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,404] INFO [ProducerStateManager partition=__consumer_offsets-48] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-48/00000000000000000193.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,407] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,417] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-48, topic=__consumer_offsets, partition=48, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=193) with 3 segments in 33ms (4/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,417] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-10 (kafka.log.LogManager) [2021-07-14 17:35:11,419] INFO [Log partition=__consumer_offsets-10, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,420] INFO [Log partition=__consumer_offsets-10, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,420] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,420] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,420] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,421] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619582344795,2), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,421] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,421] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,422] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,423] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,423] INFO [ProducerStateManager partition=__consumer_offsets-10] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,424] INFO [Log partition=__consumer_offsets-10, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 3 (kafka.log.Log) [2021-07-14 17:35:11,424] INFO [Log partition=__consumer_offsets-10, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,425] INFO [ProducerStateManager partition=__consumer_offsets-10] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,426] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000003.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 3, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,426] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000003.index to 0 entries; position is now 0 and last offset is now 3 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,426] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000003.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,428] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000003.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,3), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,428] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000003.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,3) (kafka.log.TimeIndex) [2021-07-14 17:35:11,428] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000003.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,428] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000003.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,429] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000003.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,429] INFO [ProducerStateManager partition=__consumer_offsets-10] Writing producer snapshot at offset 5 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,430] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000003.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,432] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000003.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,434] DEBUG [LeaderEpochCache __consumer_offsets-10] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,434] INFO [Log partition=__consumer_offsets-10, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 5 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,434] INFO [ProducerStateManager partition=__consumer_offsets-10] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-10/00000000000000000005.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,438] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,438] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-10, topic=__consumer_offsets, partition=10, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=5) with 2 segments in 20ms (5/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,438] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-45 (kafka.log.LogManager) [2021-07-14 17:35:11,452] INFO [Log partition=__consumer_offsets-45, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,452] INFO [Log partition=__consumer_offsets-45, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,453] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,453] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,453] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,453] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1614142098484,2), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,453] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,454] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,454] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,455] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,455] INFO [ProducerStateManager partition=__consumer_offsets-45] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,456] INFO [Log partition=__consumer_offsets-45, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 3 (kafka.log.Log) [2021-07-14 17:35:11,456] INFO [Log partition=__consumer_offsets-45, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,456] INFO [ProducerStateManager partition=__consumer_offsets-45] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,458] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000003.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 3, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,458] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000003.index to 0 entries; position is now 0 and last offset is now 3 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,458] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000003.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,459] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000003.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,3), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,459] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000003.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,3) (kafka.log.TimeIndex) [2021-07-14 17:35:11,459] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000003.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,461] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000003.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,461] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000003.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,462] INFO [ProducerStateManager partition=__consumer_offsets-45] Writing producer snapshot at offset 6 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,462] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000003.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,463] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000003.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,465] DEBUG [LeaderEpochCache __consumer_offsets-45] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,475] INFO [Log partition=__consumer_offsets-45, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 6 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,476] INFO [ProducerStateManager partition=__consumer_offsets-45] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-45/00000000000000000006.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,480] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,482] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-45, topic=__consumer_offsets, partition=45, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=6) with 2 segments in 44ms (6/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,482] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-26 (kafka.log.LogManager) [2021-07-14 17:35:11,485] INFO [Log partition=__consumer_offsets-26, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,485] INFO [Log partition=__consumer_offsets-26, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,486] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-26/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,486] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-26/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,486] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-26/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,487] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-26/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,487] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-26/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,487] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-26/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,488] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-26/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,488] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-26/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,489] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-26/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,489] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-26/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,489] INFO [Log partition=__consumer_offsets-26, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,494] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,494] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-26, topic=__consumer_offsets, partition=26, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 12ms (7/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,494] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-7 (kafka.log.LogManager) [2021-07-14 17:35:11,496] INFO [Log partition=__consumer_offsets-7, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,496] INFO [Log partition=__consumer_offsets-7, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,498] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-7/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,498] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-7/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,498] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-7/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,499] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-7/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,499] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-7/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,499] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-7/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,500] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-7/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,501] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-7/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,501] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-7/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,501] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-7/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,501] INFO [Log partition=__consumer_offsets-7, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,506] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,507] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-7, topic=__consumer_offsets, partition=7, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 13ms (8/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,507] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-42 (kafka.log.LogManager) [2021-07-14 17:35:11,509] INFO [Log partition=__consumer_offsets-42, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,509] INFO [Log partition=__consumer_offsets-42, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,510] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,510] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,510] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,511] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619580171061,20), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,511] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,548] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,548] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,549] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,549] INFO [ProducerStateManager partition=__consumer_offsets-42] Writing producer snapshot at offset 21 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,550] INFO [Log partition=__consumer_offsets-42, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 21 (kafka.log.Log) [2021-07-14 17:35:11,550] INFO [Log partition=__consumer_offsets-42, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 21 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,551] INFO [ProducerStateManager partition=__consumer_offsets-42] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000021.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,552] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000021.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 21, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,552] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000021.index to 0 entries; position is now 0 and last offset is now 21 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,552] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000021.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,553] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000021.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,21), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,554] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000021.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,21) (kafka.log.TimeIndex) [2021-07-14 17:35:11,554] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000021.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,555] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000021.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,557] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000021.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,557] INFO [ProducerStateManager partition=__consumer_offsets-42] Writing producer snapshot at offset 22 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,558] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000021.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,558] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000021.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,560] DEBUG [LeaderEpochCache __consumer_offsets-42] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,560] INFO [Log partition=__consumer_offsets-42, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 22 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,561] INFO [ProducerStateManager partition=__consumer_offsets-42] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-42/00000000000000000022.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,563] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,563] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-42, topic=__consumer_offsets, partition=42, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=22) with 2 segments in 56ms (9/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,563] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-4 (kafka.log.LogManager) [2021-07-14 17:35:11,565] INFO [Log partition=__consumer_offsets-4, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,565] INFO [Log partition=__consumer_offsets-4, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,566] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,566] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,566] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,566] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619580170886,81), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,566] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,587] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,587] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,587] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,587] INFO [ProducerStateManager partition=__consumer_offsets-4] Writing producer snapshot at offset 82 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,588] INFO [Log partition=__consumer_offsets-4, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 82 (kafka.log.Log) [2021-07-14 17:35:11,588] INFO [Log partition=__consumer_offsets-4, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 82 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,588] INFO [ProducerStateManager partition=__consumer_offsets-4] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000082.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,589] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000082.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 82, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,589] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000082.index to 0 entries; position is now 0 and last offset is now 82 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,589] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000082.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,590] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000082.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1620876159957,84), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,590] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000082.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,82) (kafka.log.TimeIndex) [2021-07-14 17:35:11,591] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000082.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,593] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000082.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,593] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000082.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,593] INFO [ProducerStateManager partition=__consumer_offsets-4] Writing producer snapshot at offset 85 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,593] INFO [Log partition=__consumer_offsets-4, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 85 (kafka.log.Log) [2021-07-14 17:35:11,593] INFO [Log partition=__consumer_offsets-4, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 85 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,594] INFO [ProducerStateManager partition=__consumer_offsets-4] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000085.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,596] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000085.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 85, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,596] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000085.index to 0 entries; position is now 0 and last offset is now 85 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,596] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000085.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,597] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000085.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,85), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,597] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000085.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,85) (kafka.log.TimeIndex) [2021-07-14 17:35:11,597] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000085.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,598] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000085.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,598] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000085.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,598] INFO [ProducerStateManager partition=__consumer_offsets-4] Writing producer snapshot at offset 86 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,599] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000085.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,600] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000085.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,601] DEBUG [LeaderEpochCache __consumer_offsets-4] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,602] INFO [Log partition=__consumer_offsets-4, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 86 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,602] INFO [ProducerStateManager partition=__consumer_offsets-4] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-4/00000000000000000086.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,605] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,607] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-4, topic=__consumer_offsets, partition=4, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=86) with 3 segments in 43ms (10/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,607] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-23 (kafka.log.LogManager) [2021-07-14 17:35:11,609] INFO [Log partition=__consumer_offsets-23, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,609] INFO [Log partition=__consumer_offsets-23, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,610] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-23/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,610] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-23/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,610] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-23/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,611] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-23/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,611] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-23/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,611] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-23/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,612] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-23/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,612] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-23/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,612] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-23/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,613] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-23/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,613] INFO [Log partition=__consumer_offsets-23, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,617] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,617] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-23, topic=__consumer_offsets, partition=23, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 10ms (11/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,617] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-1 (kafka.log.LogManager) [2021-07-14 17:35:11,619] INFO [Log partition=__consumer_offsets-1, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,619] INFO [Log partition=__consumer_offsets-1, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,619] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,619] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,619] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,620] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1621245463672,39), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,620] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,621] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,624] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,624] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,624] INFO [ProducerStateManager partition=__consumer_offsets-1] Writing producer snapshot at offset 40 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,625] INFO [Log partition=__consumer_offsets-1, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 40 (kafka.log.Log) [2021-07-14 17:35:11,626] INFO [Log partition=__consumer_offsets-1, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 40 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,626] INFO [ProducerStateManager partition=__consumer_offsets-1] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000040.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,628] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000040.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 40, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,628] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000040.index to 0 entries; position is now 0 and last offset is now 40 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,628] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000040.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,629] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000040.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,40), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,629] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000040.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,40) (kafka.log.TimeIndex) [2021-07-14 17:35:11,629] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000040.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,630] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000040.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,630] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000040.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,630] INFO [ProducerStateManager partition=__consumer_offsets-1] Writing producer snapshot at offset 44 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,631] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000040.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,633] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000040.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,634] DEBUG [LeaderEpochCache __consumer_offsets-1] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,634] INFO [Log partition=__consumer_offsets-1, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 44 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,635] INFO [ProducerStateManager partition=__consumer_offsets-1] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-1/00000000000000000044.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,637] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,638] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-1, topic=__consumer_offsets, partition=1, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=44) with 2 segments in 21ms (12/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,638] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-20 (kafka.log.LogManager) [2021-07-14 17:35:11,640] INFO [Log partition=__consumer_offsets-20, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,640] INFO [Log partition=__consumer_offsets-20, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,642] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-20/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,642] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-20/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,642] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-20/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,643] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-20/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,643] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-20/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,643] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-20/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,659] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-20/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,660] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-20/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,661] INFO [ProducerStateManager partition=__consumer_offsets-20] Writing producer snapshot at offset 6 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,667] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-20/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,668] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-20/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,669] DEBUG [LeaderEpochCache __consumer_offsets-20] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,669] INFO [Log partition=__consumer_offsets-20, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 6 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,669] INFO [ProducerStateManager partition=__consumer_offsets-20] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-20/00000000000000000006.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,671] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,672] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-20, topic=__consumer_offsets, partition=20, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=6) with 1 segments in 33ms (13/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,672] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-39 (kafka.log.LogManager) [2021-07-14 17:35:11,673] INFO [Log partition=__consumer_offsets-39, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,673] INFO [Log partition=__consumer_offsets-39, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,674] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-39/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,674] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-39/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,674] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-39/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,674] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-39/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,674] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-39/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,674] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-39/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,714] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-39/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,714] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-39/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,715] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-39/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,715] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-39/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,715] INFO [Log partition=__consumer_offsets-39, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,719] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,719] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-39, topic=__consumer_offsets, partition=39, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 47ms (14/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,719] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-17 (kafka.log.LogManager) [2021-07-14 17:35:11,721] INFO [Log partition=__consumer_offsets-17, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,721] INFO [Log partition=__consumer_offsets-17, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,722] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-17/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,722] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-17/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,722] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-17/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,723] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-17/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,723] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-17/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,723] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-17/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,723] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-17/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,724] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-17/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,724] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-17/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,724] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-17/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,724] INFO [Log partition=__consumer_offsets-17, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,726] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,727] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-17, topic=__consumer_offsets, partition=17, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 8ms (15/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,727] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-36 (kafka.log.LogManager) [2021-07-14 17:35:11,728] INFO [Log partition=__consumer_offsets-36, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,729] INFO [Log partition=__consumer_offsets-36, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,729] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,729] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,729] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,730] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619580171031,20), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,730] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,734] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,734] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,734] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,734] INFO [ProducerStateManager partition=__consumer_offsets-36] Writing producer snapshot at offset 21 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,737] INFO [Log partition=__consumer_offsets-36, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 21 (kafka.log.Log) [2021-07-14 17:35:11,737] INFO [Log partition=__consumer_offsets-36, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 21 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,737] INFO [ProducerStateManager partition=__consumer_offsets-36] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000021.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,738] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000021.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 21, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,738] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000021.index to 0 entries; position is now 0 and last offset is now 21 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,739] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000021.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,739] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000021.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,21), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,739] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000021.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,21) (kafka.log.TimeIndex) [2021-07-14 17:35:11,739] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000021.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,740] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000021.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,740] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000021.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,740] INFO [ProducerStateManager partition=__consumer_offsets-36] Writing producer snapshot at offset 22 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,741] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000021.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,742] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000021.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,743] DEBUG [LeaderEpochCache __consumer_offsets-36] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,744] INFO [Log partition=__consumer_offsets-36, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 22 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,744] INFO [ProducerStateManager partition=__consumer_offsets-36] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-36/00000000000000000022.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,749] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,749] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-36, topic=__consumer_offsets, partition=36, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=22) with 2 segments in 22ms (16/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,749] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-14 (kafka.log.LogManager) [2021-07-14 17:35:11,751] INFO [Log partition=__consumer_offsets-14, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,752] INFO [Log partition=__consumer_offsets-14, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,752] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,752] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,752] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,752] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1620374620858,36197), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,752] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,754] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,755] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,755] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,755] INFO [ProducerStateManager partition=__consumer_offsets-14] Writing producer snapshot at offset 36198 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,756] INFO [Log partition=__consumer_offsets-14, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 36198 (kafka.log.Log) [2021-07-14 17:35:11,756] INFO [Log partition=__consumer_offsets-14, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 36198 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,757] INFO [ProducerStateManager partition=__consumer_offsets-14] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036198.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,758] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036198.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 36198, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,758] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036198.index to 0 entries; position is now 0 and last offset is now 36198 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,758] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036198.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,758] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036198.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,36198), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,759] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036198.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,36198) (kafka.log.TimeIndex) [2021-07-14 17:35:11,759] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036198.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,759] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036198.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,760] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036198.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,760] INFO [ProducerStateManager partition=__consumer_offsets-14] Writing producer snapshot at offset 36204 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,761] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036198.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,762] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036198.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,764] DEBUG [LeaderEpochCache __consumer_offsets-14] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,764] INFO [Log partition=__consumer_offsets-14, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 36204 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,764] INFO [ProducerStateManager partition=__consumer_offsets-14] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-14/00000000000000036204.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,768] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,768] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-14, topic=__consumer_offsets, partition=14, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=36204) with 2 segments in 19ms (17/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,768] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-33 (kafka.log.LogManager) [2021-07-14 17:35:11,776] INFO [Log partition=__consumer_offsets-33, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,776] INFO [Log partition=__consumer_offsets-33, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,777] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-33/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,777] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-33/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,777] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-33/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,778] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-33/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,778] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-33/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,778] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-33/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,784] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-33/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,784] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-33/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,785] INFO [ProducerStateManager partition=__consumer_offsets-33] Writing producer snapshot at offset 6 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,785] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-33/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,786] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-33/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,787] DEBUG [LeaderEpochCache __consumer_offsets-33] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,788] INFO [Log partition=__consumer_offsets-33, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 6 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,788] INFO [ProducerStateManager partition=__consumer_offsets-33] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-33/00000000000000000006.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,790] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,790] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-33, topic=__consumer_offsets, partition=33, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=6) with 1 segments in 22ms (18/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,790] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-49 (kafka.log.LogManager) [2021-07-14 17:35:11,792] INFO [Log partition=__consumer_offsets-49, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,792] INFO [Log partition=__consumer_offsets-49, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,793] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-49/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,793] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-49/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,794] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-49/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,794] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-49/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,794] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-49/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,794] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-49/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,795] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-49/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,796] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-49/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,796] INFO [ProducerStateManager partition=__consumer_offsets-49] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,862] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-49/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,894] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-49/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,902] DEBUG [LeaderEpochCache __consumer_offsets-49] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,902] INFO [Log partition=__consumer_offsets-49, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,902] INFO [ProducerStateManager partition=__consumer_offsets-49] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-49/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,904] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,905] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-49, topic=__consumer_offsets, partition=49, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=3) with 1 segments in 115ms (19/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,905] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-11 (kafka.log.LogManager) [2021-07-14 17:35:11,906] INFO [Log partition=__consumer_offsets-11, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,906] INFO [Log partition=__consumer_offsets-11, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,907] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,907] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,907] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,907] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619580170881,42), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:11,907] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,910] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,912] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,912] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,913] INFO [ProducerStateManager partition=__consumer_offsets-11] Writing producer snapshot at offset 43 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,914] INFO [Log partition=__consumer_offsets-11, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 43 (kafka.log.Log) [2021-07-14 17:35:11,914] INFO [Log partition=__consumer_offsets-11, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 43 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,915] INFO [ProducerStateManager partition=__consumer_offsets-11] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000043.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,916] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000043.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 43, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,916] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000043.index to 0 entries; position is now 0 and last offset is now 43 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,916] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000043.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,944] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000043.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,43), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,944] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000043.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,43) (kafka.log.TimeIndex) [2021-07-14 17:35:11,945] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000043.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,946] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000043.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,947] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000043.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,948] INFO [ProducerStateManager partition=__consumer_offsets-11] Writing producer snapshot at offset 44 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,948] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000043.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,949] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000043.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,952] DEBUG [LeaderEpochCache __consumer_offsets-11] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,952] INFO [Log partition=__consumer_offsets-11, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 44 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,953] INFO [ProducerStateManager partition=__consumer_offsets-11] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-11/00000000000000000044.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,955] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,955] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-11, topic=__consumer_offsets, partition=11, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=44) with 2 segments in 50ms (20/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,955] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-30 (kafka.log.LogManager) [2021-07-14 17:35:11,957] INFO [Log partition=__consumer_offsets-30, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,957] INFO [Log partition=__consumer_offsets-30, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,959] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-30/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,959] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-30/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,959] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-30/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,960] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-30/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,960] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-30/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,960] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-30/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,961] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-30/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,961] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-30/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,961] INFO [ProducerStateManager partition=__consumer_offsets-30] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,962] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-30/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,965] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-30/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,967] DEBUG [LeaderEpochCache __consumer_offsets-30] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:11,967] INFO [Log partition=__consumer_offsets-30, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,967] INFO [ProducerStateManager partition=__consumer_offsets-30] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-30/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:11,969] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,969] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-30, topic=__consumer_offsets, partition=30, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=3) with 1 segments in 14ms (21/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,969] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-46 (kafka.log.LogManager) [2021-07-14 17:35:11,970] INFO [Log partition=__consumer_offsets-46, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,970] INFO [Log partition=__consumer_offsets-46, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,971] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-46/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,971] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-46/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:11,971] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-46/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,971] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-46/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:11,971] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-46/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:11,971] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-46/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,992] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-46/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,992] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-46/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,993] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-46/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,993] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-46/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:11,993] INFO [Log partition=__consumer_offsets-46, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:11,996] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:11,996] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-46, topic=__consumer_offsets, partition=46, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 27ms (22/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:11,996] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-27 (kafka.log.LogManager) [2021-07-14 17:35:11,997] INFO [Log partition=__consumer_offsets-27, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:11,997] INFO [Log partition=__consumer_offsets-27, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,006] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-27/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,006] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-27/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,007] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-27/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,007] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-27/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,008] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-27/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,008] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-27/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,017] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-27/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,018] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-27/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,018] INFO [ProducerStateManager partition=__consumer_offsets-27] Writing producer snapshot at offset 4 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,019] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-27/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,019] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-27/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,024] DEBUG [LeaderEpochCache __consumer_offsets-27] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,024] INFO [Log partition=__consumer_offsets-27, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 4 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,025] INFO [ProducerStateManager partition=__consumer_offsets-27] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-27/00000000000000000004.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,027] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,027] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-27, topic=__consumer_offsets, partition=27, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=4) with 1 segments in 31ms (23/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,027] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-8 (kafka.log.LogManager) [2021-07-14 17:35:12,028] INFO [Log partition=__consumer_offsets-8, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,029] INFO [Log partition=__consumer_offsets-8, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,030] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-8/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,030] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-8/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,030] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-8/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,031] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-8/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,031] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-8/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,031] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-8/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,031] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-8/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,032] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-8/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,032] INFO [ProducerStateManager partition=__consumer_offsets-8] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,033] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-8/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,033] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-8/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,035] DEBUG [LeaderEpochCache __consumer_offsets-8] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,035] INFO [Log partition=__consumer_offsets-8, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,035] INFO [ProducerStateManager partition=__consumer_offsets-8] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-8/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,038] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,038] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-8, topic=__consumer_offsets, partition=8, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=3) with 1 segments in 11ms (24/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,038] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-24 (kafka.log.LogManager) [2021-07-14 17:35:12,040] INFO [Log partition=__consumer_offsets-24, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,040] INFO [Log partition=__consumer_offsets-24, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,040] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,040] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,044] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,044] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1620374620677,1751), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,044] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,045] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,045] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,045] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,045] INFO [ProducerStateManager partition=__consumer_offsets-24] Writing producer snapshot at offset 1752 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,046] INFO [Log partition=__consumer_offsets-24, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 1752 (kafka.log.Log) [2021-07-14 17:35:12,047] INFO [Log partition=__consumer_offsets-24, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 1752 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,047] INFO [ProducerStateManager partition=__consumer_offsets-24] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001752.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,048] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001752.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 1752, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,048] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001752.index to 0 entries; position is now 0 and last offset is now 1752 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,049] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001752.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,049] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001752.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,1752), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,049] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001752.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,1752) (kafka.log.TimeIndex) [2021-07-14 17:35:12,049] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001752.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,051] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001752.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,052] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001752.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,052] INFO [ProducerStateManager partition=__consumer_offsets-24] Writing producer snapshot at offset 1755 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,053] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001752.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,053] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001752.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,055] DEBUG [LeaderEpochCache __consumer_offsets-24] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,055] INFO [Log partition=__consumer_offsets-24, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 1755 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,055] INFO [ProducerStateManager partition=__consumer_offsets-24] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-24/00000000000000001755.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,057] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,057] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-24, topic=__consumer_offsets, partition=24, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=1755) with 2 segments in 19ms (25/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,057] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-43 (kafka.log.LogManager) [2021-07-14 17:35:12,058] INFO [Log partition=__consumer_offsets-43, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,059] INFO [Log partition=__consumer_offsets-43, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,059] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,059] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,059] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,059] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619769760757,2), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,059] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,062] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,062] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,063] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,063] INFO [ProducerStateManager partition=__consumer_offsets-43] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,064] INFO [Log partition=__consumer_offsets-43, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 3 (kafka.log.Log) [2021-07-14 17:35:12,064] INFO [Log partition=__consumer_offsets-43, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,064] INFO [ProducerStateManager partition=__consumer_offsets-43] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,065] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000003.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 3, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,066] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000003.index to 0 entries; position is now 0 and last offset is now 3 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,066] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000003.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,066] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000003.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,3), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,066] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000003.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,3) (kafka.log.TimeIndex) [2021-07-14 17:35:12,066] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000003.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,067] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000003.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,067] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000003.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,068] INFO [ProducerStateManager partition=__consumer_offsets-43] Writing producer snapshot at offset 5 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,068] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000003.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,070] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000003.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,071] DEBUG [LeaderEpochCache __consumer_offsets-43] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,071] INFO [Log partition=__consumer_offsets-43, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 5 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,072] INFO [ProducerStateManager partition=__consumer_offsets-43] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-43/00000000000000000005.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,074] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,074] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-43, topic=__consumer_offsets, partition=43, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=5) with 2 segments in 17ms (26/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,074] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-5 (kafka.log.LogManager) [2021-07-14 17:35:12,076] INFO [Log partition=__consumer_offsets-5, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,076] INFO [Log partition=__consumer_offsets-5, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,076] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,076] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,076] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,077] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1620374620489,12425), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,077] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,095] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,095] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,095] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,096] INFO [ProducerStateManager partition=__consumer_offsets-5] Writing producer snapshot at offset 12426 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,097] INFO [Log partition=__consumer_offsets-5, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 12426 (kafka.log.Log) [2021-07-14 17:35:12,097] INFO [Log partition=__consumer_offsets-5, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 12426 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,098] INFO [ProducerStateManager partition=__consumer_offsets-5] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012426.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,098] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012426.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 12426, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,099] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012426.index to 0 entries; position is now 0 and last offset is now 12426 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,099] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012426.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,099] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012426.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,12426), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,099] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012426.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,12426) (kafka.log.TimeIndex) [2021-07-14 17:35:12,099] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012426.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,100] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012426.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,100] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012426.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,100] INFO [ProducerStateManager partition=__consumer_offsets-5] Writing producer snapshot at offset 12428 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,102] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012426.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,105] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012426.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,106] DEBUG [LeaderEpochCache __consumer_offsets-5] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,106] INFO [Log partition=__consumer_offsets-5, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 12428 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,107] INFO [ProducerStateManager partition=__consumer_offsets-5] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-5/00000000000000012428.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,109] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,109] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-5, topic=__consumer_offsets, partition=5, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=12428) with 2 segments in 35ms (27/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,109] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-21 (kafka.log.LogManager) [2021-07-14 17:35:12,110] INFO [Log partition=__consumer_offsets-21, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,111] INFO [Log partition=__consumer_offsets-21, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,111] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,111] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,111] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,111] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1614223698484,4), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,112] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,112] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,113] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,113] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,113] INFO [ProducerStateManager partition=__consumer_offsets-21] Writing producer snapshot at offset 6 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,114] INFO [Log partition=__consumer_offsets-21, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 6 (kafka.log.Log) [2021-07-14 17:35:12,114] INFO [Log partition=__consumer_offsets-21, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 6 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,114] INFO [ProducerStateManager partition=__consumer_offsets-21] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000006.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,116] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000006.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 6, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,116] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000006.index to 0 entries; position is now 0 and last offset is now 6 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,116] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000006.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,117] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000006.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,6), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,117] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000006.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,6) (kafka.log.TimeIndex) [2021-07-14 17:35:12,117] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000006.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,117] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000006.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,118] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000006.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,118] INFO [ProducerStateManager partition=__consumer_offsets-21] Writing producer snapshot at offset 9 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,119] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000006.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,121] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000006.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,122] DEBUG [LeaderEpochCache __consumer_offsets-21] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,122] INFO [Log partition=__consumer_offsets-21, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 9 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,123] INFO [ProducerStateManager partition=__consumer_offsets-21] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-21/00000000000000000009.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,125] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,125] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-21, topic=__consumer_offsets, partition=21, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=9) with 2 segments in 16ms (28/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,125] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-40 (kafka.log.LogManager) [2021-07-14 17:35:12,127] INFO [Log partition=__consumer_offsets-40, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,127] INFO [Log partition=__consumer_offsets-40, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,128] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,128] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,130] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,130] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619580170734,48), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,130] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,132] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,132] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,133] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,133] INFO [ProducerStateManager partition=__consumer_offsets-40] Writing producer snapshot at offset 49 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,134] INFO [Log partition=__consumer_offsets-40, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 49 (kafka.log.Log) [2021-07-14 17:35:12,134] INFO [Log partition=__consumer_offsets-40, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 49 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,134] INFO [ProducerStateManager partition=__consumer_offsets-40] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000049.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,135] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000049.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 49, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,136] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000049.index to 0 entries; position is now 0 and last offset is now 49 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,136] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000049.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,136] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000049.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,49), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,136] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000049.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,49) (kafka.log.TimeIndex) [2021-07-14 17:35:12,136] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000049.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,137] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000049.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,137] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000049.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,138] INFO [ProducerStateManager partition=__consumer_offsets-40] Writing producer snapshot at offset 50 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,138] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000049.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,139] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000049.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,140] DEBUG [LeaderEpochCache __consumer_offsets-40] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,140] INFO [Log partition=__consumer_offsets-40, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 50 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,141] INFO [ProducerStateManager partition=__consumer_offsets-40] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-40/00000000000000000050.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,143] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,143] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-40, topic=__consumer_offsets, partition=40, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=50) with 2 segments in 18ms (29/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,143] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-2 (kafka.log.LogManager) [2021-07-14 17:35:12,144] INFO [Log partition=__consumer_offsets-2, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,144] INFO [Log partition=__consumer_offsets-2, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,145] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-2/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,145] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-2/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,145] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-2/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,146] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-2/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,146] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-2/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,146] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-2/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,147] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-2/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,147] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-2/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,147] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-2/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,147] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-2/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,147] INFO [Log partition=__consumer_offsets-2, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,149] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,149] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-2, topic=__consumer_offsets, partition=2, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 6ms (30/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,149] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-37 (kafka.log.LogManager) [2021-07-14 17:35:12,150] INFO [Log partition=__consumer_offsets-37, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,151] INFO [Log partition=__consumer_offsets-37, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,152] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-37/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,152] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-37/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,152] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-37/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,153] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-37/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,153] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-37/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,153] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-37/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,153] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-37/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,154] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-37/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,154] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-37/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,154] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-37/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,154] INFO [Log partition=__consumer_offsets-37, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,156] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,157] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-37, topic=__consumer_offsets, partition=37, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 7ms (31/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,157] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-18 (kafka.log.LogManager) [2021-07-14 17:35:12,158] INFO [Log partition=__consumer_offsets-18, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,158] INFO [Log partition=__consumer_offsets-18, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,159] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,159] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,159] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,159] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619709159957,5), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,159] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,162] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,163] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,163] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,163] INFO [ProducerStateManager partition=__consumer_offsets-18] Writing producer snapshot at offset 6 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,164] INFO [Log partition=__consumer_offsets-18, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 6 (kafka.log.Log) [2021-07-14 17:35:12,164] INFO [Log partition=__consumer_offsets-18, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 6 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,164] INFO [ProducerStateManager partition=__consumer_offsets-18] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000006.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,166] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000006.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 6, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,166] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000006.index to 0 entries; position is now 0 and last offset is now 6 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,166] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000006.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,166] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000006.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,6), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,166] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000006.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,6) (kafka.log.TimeIndex) [2021-07-14 17:35:12,166] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000006.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,168] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000006.index to 8, position is 8 and limit is 8 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,168] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000006.timeindex to 24, position is 24 and limit is 24 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,168] INFO [ProducerStateManager partition=__consumer_offsets-18] Writing producer snapshot at offset 32 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,170] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000006.index to 10485760, position is 8 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,171] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000006.timeindex to 10485756, position is 24 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,172] DEBUG [LeaderEpochCache __consumer_offsets-18] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,172] INFO [Log partition=__consumer_offsets-18, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 32 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,172] INFO [ProducerStateManager partition=__consumer_offsets-18] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-18/00000000000000000032.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,174] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,174] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-18, topic=__consumer_offsets, partition=18, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=32) with 2 segments in 17ms (32/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,174] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-34 (kafka.log.LogManager) [2021-07-14 17:35:12,175] INFO [Log partition=__consumer_offsets-34, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,175] INFO [Log partition=__consumer_offsets-34, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,176] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,176] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,176] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,176] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1620817867199,18), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,176] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,211] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,211] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,211] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,211] INFO [ProducerStateManager partition=__consumer_offsets-34] Writing producer snapshot at offset 19 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,214] INFO [Log partition=__consumer_offsets-34, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 19 (kafka.log.Log) [2021-07-14 17:35:12,214] INFO [Log partition=__consumer_offsets-34, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 19 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,215] INFO [ProducerStateManager partition=__consumer_offsets-34] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000019.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,216] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000019.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 19, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,216] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000019.index to 0 entries; position is now 0 and last offset is now 19 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,216] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000019.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,217] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000019.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,19), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,217] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000019.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,19) (kafka.log.TimeIndex) [2021-07-14 17:35:12,217] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000019.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,218] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000019.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,219] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000019.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,219] INFO [ProducerStateManager partition=__consumer_offsets-34] Writing producer snapshot at offset 25 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,220] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000019.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,221] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000019.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,222] DEBUG [LeaderEpochCache __consumer_offsets-34] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,223] INFO [Log partition=__consumer_offsets-34, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 25 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,223] INFO [ProducerStateManager partition=__consumer_offsets-34] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-34/00000000000000000025.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,224] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,224] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-34, topic=__consumer_offsets, partition=34, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=25) with 2 segments in 50ms (33/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,224] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-15 (kafka.log.LogManager) [2021-07-14 17:35:12,226] INFO [Log partition=__consumer_offsets-15, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,226] INFO [Log partition=__consumer_offsets-15, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,226] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,226] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,226] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,226] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1622082232606,421), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,226] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,228] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,229] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,229] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,229] INFO [ProducerStateManager partition=__consumer_offsets-15] Writing producer snapshot at offset 422 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,230] INFO [Log partition=__consumer_offsets-15, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 422 (kafka.log.Log) [2021-07-14 17:35:12,230] INFO [Log partition=__consumer_offsets-15, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 422 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,230] INFO [ProducerStateManager partition=__consumer_offsets-15] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000422.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,231] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000422.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 422, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,232] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000422.index to 0 entries; position is now 0 and last offset is now 422 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,232] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000422.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,232] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000422.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,422), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,232] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000422.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,422) (kafka.log.TimeIndex) [2021-07-14 17:35:12,232] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000422.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,233] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000422.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,233] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000422.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,234] INFO [ProducerStateManager partition=__consumer_offsets-15] Writing producer snapshot at offset 425 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,234] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000422.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,235] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000422.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,236] DEBUG [LeaderEpochCache __consumer_offsets-15] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,236] INFO [Log partition=__consumer_offsets-15, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 425 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,237] INFO [ProducerStateManager partition=__consumer_offsets-15] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-15/00000000000000000425.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,238] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,238] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-15, topic=__consumer_offsets, partition=15, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=425) with 2 segments in 14ms (34/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,239] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-12 (kafka.log.LogManager) [2021-07-14 17:35:12,240] INFO [Log partition=__consumer_offsets-12, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,240] INFO [Log partition=__consumer_offsets-12, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,241] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,241] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,265] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,267] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1620872559957,2), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,267] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,270] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,270] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,270] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,271] INFO [ProducerStateManager partition=__consumer_offsets-12] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,272] INFO [Log partition=__consumer_offsets-12, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 3 (kafka.log.Log) [2021-07-14 17:35:12,273] INFO [Log partition=__consumer_offsets-12, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,273] INFO [ProducerStateManager partition=__consumer_offsets-12] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,274] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000003.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 3, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,274] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000003.index to 0 entries; position is now 0 and last offset is now 3 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,274] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000003.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,275] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000003.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,3), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,275] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000003.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,3) (kafka.log.TimeIndex) [2021-07-14 17:35:12,275] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000003.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,275] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000003.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,276] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000003.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,276] INFO [ProducerStateManager partition=__consumer_offsets-12] Writing producer snapshot at offset 6 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,276] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000003.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,284] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000003.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,285] DEBUG [LeaderEpochCache __consumer_offsets-12] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,285] INFO [Log partition=__consumer_offsets-12, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 6 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,286] INFO [ProducerStateManager partition=__consumer_offsets-12] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-12/00000000000000000006.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,287] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,287] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-12, topic=__consumer_offsets, partition=12, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=6) with 2 segments in 48ms (35/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,288] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-31 (kafka.log.LogManager) [2021-07-14 17:35:12,289] INFO [Log partition=__consumer_offsets-31, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,290] INFO [Log partition=__consumer_offsets-31, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,290] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,290] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,290] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,290] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1621504775741,553), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,290] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,310] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,310] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,310] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,310] INFO [ProducerStateManager partition=__consumer_offsets-31] Writing producer snapshot at offset 554 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,312] INFO [Log partition=__consumer_offsets-31, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 554 (kafka.log.Log) [2021-07-14 17:35:12,312] INFO [Log partition=__consumer_offsets-31, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 554 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,312] INFO [ProducerStateManager partition=__consumer_offsets-31] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000554.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,318] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000554.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 554, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,318] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000554.index to 0 entries; position is now 0 and last offset is now 554 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,318] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000554.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,319] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000554.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,554), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,319] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000554.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,554) (kafka.log.TimeIndex) [2021-07-14 17:35:12,319] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000554.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,320] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000554.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,320] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000554.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,320] INFO [ProducerStateManager partition=__consumer_offsets-31] Writing producer snapshot at offset 557 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,321] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000554.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,322] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000554.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,324] DEBUG [LeaderEpochCache __consumer_offsets-31] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,324] INFO [Log partition=__consumer_offsets-31, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 557 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,324] INFO [ProducerStateManager partition=__consumer_offsets-31] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-31/00000000000000000557.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,325] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,326] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-31, topic=__consumer_offsets, partition=31, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=557) with 2 segments in 38ms (36/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,326] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-9 (kafka.log.LogManager) [2021-07-14 17:35:12,327] INFO [Log partition=__consumer_offsets-9, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,327] INFO [Log partition=__consumer_offsets-9, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,328] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-9/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,328] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-9/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,328] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-9/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,329] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-9/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,329] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-9/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,329] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-9/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,330] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-9/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,331] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-9/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,331] INFO [ProducerStateManager partition=__consumer_offsets-9] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,331] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-9/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,332] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-9/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,333] DEBUG [LeaderEpochCache __consumer_offsets-9] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,333] INFO [Log partition=__consumer_offsets-9, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,334] INFO [ProducerStateManager partition=__consumer_offsets-9] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-9/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,335] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,335] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-9, topic=__consumer_offsets, partition=9, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=3) with 1 segments in 9ms (37/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,336] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-47 (kafka.log.LogManager) [2021-07-14 17:35:12,337] INFO [Log partition=__consumer_offsets-47, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,337] INFO [Log partition=__consumer_offsets-47, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,338] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-47/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,338] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-47/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,338] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-47/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,339] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-47/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,339] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-47/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,339] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-47/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,339] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-47/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,340] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-47/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,340] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-47/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,340] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-47/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,344] INFO [Log partition=__consumer_offsets-47, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,345] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,346] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-47, topic=__consumer_offsets, partition=47, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 9ms (38/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,346] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-19 (kafka.log.LogManager) [2021-07-14 17:35:12,348] INFO [Log partition=__consumer_offsets-19, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,348] INFO [Log partition=__consumer_offsets-19, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,349] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,349] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,349] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,349] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619582190332,102), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,349] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,350] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,350] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,350] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,350] INFO [ProducerStateManager partition=__consumer_offsets-19] Writing producer snapshot at offset 103 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,350] INFO [Log partition=__consumer_offsets-19, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 103 (kafka.log.Log) [2021-07-14 17:35:12,351] INFO [Log partition=__consumer_offsets-19, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 103 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,351] INFO [ProducerStateManager partition=__consumer_offsets-19] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000103.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,352] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000103.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 103, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,352] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000103.index to 0 entries; position is now 0 and last offset is now 103 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,352] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000103.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,352] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000103.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1620187360034,104), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,352] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000103.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,103) (kafka.log.TimeIndex) [2021-07-14 17:35:12,352] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000103.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,353] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000103.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,353] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000103.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,353] INFO [ProducerStateManager partition=__consumer_offsets-19] Writing producer snapshot at offset 105 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,353] INFO [Log partition=__consumer_offsets-19, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 105 (kafka.log.Log) [2021-07-14 17:35:12,353] INFO [Log partition=__consumer_offsets-19, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 105 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,354] INFO [ProducerStateManager partition=__consumer_offsets-19] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000105.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,355] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000105.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 105, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,355] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000105.index to 0 entries; position is now 0 and last offset is now 105 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,355] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000105.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,356] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000105.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,105), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,356] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000105.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,105) (kafka.log.TimeIndex) [2021-07-14 17:35:12,356] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000105.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,356] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000105.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,357] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000105.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,357] INFO [ProducerStateManager partition=__consumer_offsets-19] Writing producer snapshot at offset 109 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,358] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000105.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,360] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000105.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,362] DEBUG [LeaderEpochCache __consumer_offsets-19] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,362] INFO [Log partition=__consumer_offsets-19, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 109 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,362] INFO [ProducerStateManager partition=__consumer_offsets-19] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-19/00000000000000000109.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,364] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,364] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-19, topic=__consumer_offsets, partition=19, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=109) with 3 segments in 18ms (39/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,364] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-28 (kafka.log.LogManager) [2021-07-14 17:35:12,366] INFO [Log partition=__consumer_offsets-28, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,366] INFO [Log partition=__consumer_offsets-28, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,367] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,367] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,367] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,367] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1621504775604,26186), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,367] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,368] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,368] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,369] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,369] INFO [ProducerStateManager partition=__consumer_offsets-28] Writing producer snapshot at offset 26187 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,370] INFO [Log partition=__consumer_offsets-28, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 26187 (kafka.log.Log) [2021-07-14 17:35:12,370] INFO [Log partition=__consumer_offsets-28, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 26187 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,370] INFO [ProducerStateManager partition=__consumer_offsets-28] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026187.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,371] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026187.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 26187, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,371] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026187.index to 0 entries; position is now 0 and last offset is now 26187 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,371] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026187.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,372] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026187.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,26187), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,372] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026187.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,26187) (kafka.log.TimeIndex) [2021-07-14 17:35:12,372] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026187.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,405] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026187.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,405] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026187.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,405] INFO [ProducerStateManager partition=__consumer_offsets-28] Writing producer snapshot at offset 26189 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,406] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026187.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,411] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026187.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,413] DEBUG [LeaderEpochCache __consumer_offsets-28] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,414] INFO [Log partition=__consumer_offsets-28, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 26189 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,414] INFO [ProducerStateManager partition=__consumer_offsets-28] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-28/00000000000000026189.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,415] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,415] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-28, topic=__consumer_offsets, partition=28, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=26189) with 2 segments in 51ms (40/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,416] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-38 (kafka.log.LogManager) [2021-07-14 17:35:12,417] INFO [Log partition=__consumer_offsets-38, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,417] INFO [Log partition=__consumer_offsets-38, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,418] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-38/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,418] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-38/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,418] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-38/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,419] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-38/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,419] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-38/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,420] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-38/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,420] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-38/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,421] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-38/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,421] INFO [ProducerStateManager partition=__consumer_offsets-38] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,421] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-38/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,424] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-38/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,426] DEBUG [LeaderEpochCache __consumer_offsets-38] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,426] INFO [Log partition=__consumer_offsets-38, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,426] INFO [ProducerStateManager partition=__consumer_offsets-38] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-38/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,428] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,428] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-38, topic=__consumer_offsets, partition=38, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=3) with 1 segments in 12ms (41/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,429] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-35 (kafka.log.LogManager) [2021-07-14 17:35:12,431] INFO [Log partition=__consumer_offsets-35, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,431] INFO [Log partition=__consumer_offsets-35, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,432] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,432] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,432] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,432] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619580170951,51), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,432] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,433] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,433] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,433] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,433] INFO [ProducerStateManager partition=__consumer_offsets-35] Writing producer snapshot at offset 52 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,434] INFO [Log partition=__consumer_offsets-35, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 52 (kafka.log.Log) [2021-07-14 17:35:12,434] INFO [Log partition=__consumer_offsets-35, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 52 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,434] INFO [ProducerStateManager partition=__consumer_offsets-35] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000052.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,435] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000052.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 52, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,435] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000052.index to 0 entries; position is now 0 and last offset is now 52 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,435] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000052.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,436] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000052.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,52), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,436] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000052.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,52) (kafka.log.TimeIndex) [2021-07-14 17:35:12,436] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000052.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,437] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000052.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,437] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000052.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,437] INFO [ProducerStateManager partition=__consumer_offsets-35] Writing producer snapshot at offset 57 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,438] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000052.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,438] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000052.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,440] DEBUG [LeaderEpochCache __consumer_offsets-35] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,440] INFO [Log partition=__consumer_offsets-35, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 57 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,440] INFO [ProducerStateManager partition=__consumer_offsets-35] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-35/00000000000000000057.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,442] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,442] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-35, topic=__consumer_offsets, partition=35, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=57) with 2 segments in 13ms (42/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,442] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-6 (kafka.log.LogManager) [2021-07-14 17:35:12,443] INFO [Log partition=__consumer_offsets-6, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,443] INFO [Log partition=__consumer_offsets-6, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,444] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-6/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,444] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-6/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,444] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-6/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,445] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-6/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,445] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-6/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,445] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-6/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,446] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-6/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,446] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-6/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,446] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-6/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,446] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-6/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,446] INFO [Log partition=__consumer_offsets-6, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,448] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,448] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-6, topic=__consumer_offsets, partition=6, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 6ms (43/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,448] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-44 (kafka.log.LogManager) [2021-07-14 17:35:12,449] INFO [Log partition=__consumer_offsets-44, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,449] INFO [Log partition=__consumer_offsets-44, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,450] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-44/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,450] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-44/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,450] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-44/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,451] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-44/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,451] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-44/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,451] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-44/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,452] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-44/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,452] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-44/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,453] INFO [ProducerStateManager partition=__consumer_offsets-44] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,453] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-44/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,454] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-44/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,456] DEBUG [LeaderEpochCache __consumer_offsets-44] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,456] INFO [Log partition=__consumer_offsets-44, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,456] INFO [ProducerStateManager partition=__consumer_offsets-44] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-44/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,457] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,457] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-44, topic=__consumer_offsets, partition=44, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=3) with 1 segments in 9ms (44/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,457] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-25 (kafka.log.LogManager) [2021-07-14 17:35:12,458] INFO [Log partition=__consumer_offsets-25, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,458] INFO [Log partition=__consumer_offsets-25, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,459] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,459] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,459] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,459] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1620817867249,57), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,459] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,502] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,502] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,502] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,502] INFO [ProducerStateManager partition=__consumer_offsets-25] Writing producer snapshot at offset 58 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,503] INFO [Log partition=__consumer_offsets-25, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 58 (kafka.log.Log) [2021-07-14 17:35:12,504] INFO [Log partition=__consumer_offsets-25, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 58 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,504] INFO [ProducerStateManager partition=__consumer_offsets-25] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000058.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,505] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000058.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 58, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,505] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000058.index to 0 entries; position is now 0 and last offset is now 58 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,505] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000058.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,506] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000058.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,58), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,506] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000058.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,58) (kafka.log.TimeIndex) [2021-07-14 17:35:12,506] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000058.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,539] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000058.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,540] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000058.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,540] INFO [ProducerStateManager partition=__consumer_offsets-25] Writing producer snapshot at offset 65 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,541] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000058.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,542] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000058.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,543] DEBUG [LeaderEpochCache __consumer_offsets-25] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,543] INFO [Log partition=__consumer_offsets-25, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 65 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,544] INFO [ProducerStateManager partition=__consumer_offsets-25] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-25/00000000000000000065.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,552] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,552] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-25, topic=__consumer_offsets, partition=25, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=65) with 2 segments in 95ms (45/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,552] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-16 (kafka.log.LogManager) [2021-07-14 17:35:12,553] INFO [Log partition=__consumer_offsets-16, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,554] INFO [Log partition=__consumer_offsets-16, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,554] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,554] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,554] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,554] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1621242052610,367), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,554] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,555] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,555] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,555] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,555] INFO [ProducerStateManager partition=__consumer_offsets-16] Writing producer snapshot at offset 368 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,557] INFO [Log partition=__consumer_offsets-16, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 368 (kafka.log.Log) [2021-07-14 17:35:12,557] INFO [Log partition=__consumer_offsets-16, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 368 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,557] INFO [ProducerStateManager partition=__consumer_offsets-16] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000368.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,558] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000368.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 368, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,558] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000368.index to 0 entries; position is now 0 and last offset is now 368 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,558] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000368.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,559] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000368.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,368), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,559] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000368.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,368) (kafka.log.TimeIndex) [2021-07-14 17:35:12,559] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000368.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,560] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000368.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,560] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000368.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,560] INFO [ProducerStateManager partition=__consumer_offsets-16] Writing producer snapshot at offset 374 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,561] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000368.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,563] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000368.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,564] DEBUG [LeaderEpochCache __consumer_offsets-16] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,564] INFO [Log partition=__consumer_offsets-16, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 374 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,565] INFO [ProducerStateManager partition=__consumer_offsets-16] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-16/00000000000000000374.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,566] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,566] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-16, topic=__consumer_offsets, partition=16, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=374) with 2 segments in 14ms (46/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,566] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-22 (kafka.log.LogManager) [2021-07-14 17:35:12,568] INFO [Log partition=__consumer_offsets-22, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,568] INFO [Log partition=__consumer_offsets-22, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,568] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,568] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,568] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,568] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1620873159957,5), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,568] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,569] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,569] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,569] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,570] INFO [ProducerStateManager partition=__consumer_offsets-22] Writing producer snapshot at offset 6 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,571] INFO [Log partition=__consumer_offsets-22, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 6 (kafka.log.Log) [2021-07-14 17:35:12,571] INFO [Log partition=__consumer_offsets-22, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 6 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,575] INFO [ProducerStateManager partition=__consumer_offsets-22] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000006.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,577] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000006.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 6, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,578] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000006.index to 0 entries; position is now 0 and last offset is now 6 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,578] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000006.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,578] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000006.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,6), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,578] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000006.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,6) (kafka.log.TimeIndex) [2021-07-14 17:35:12,578] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000006.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,579] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000006.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,579] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000006.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,579] INFO [ProducerStateManager partition=__consumer_offsets-22] Writing producer snapshot at offset 9 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,580] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000006.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,581] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000006.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,583] DEBUG [LeaderEpochCache __consumer_offsets-22] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,583] INFO [Log partition=__consumer_offsets-22, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 9 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,583] INFO [ProducerStateManager partition=__consumer_offsets-22] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-22/00000000000000000009.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,585] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,585] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-22, topic=__consumer_offsets, partition=22, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=9) with 2 segments in 19ms (47/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,585] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-41 (kafka.log.LogManager) [2021-07-14 17:35:12,587] INFO [Log partition=__consumer_offsets-41, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,587] INFO [Log partition=__consumer_offsets-41, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,588] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-41/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,589] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-41/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,589] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-41/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,589] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-41/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,589] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-41/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,589] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-41/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,590] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-41/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,590] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-41/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,590] INFO [ProducerStateManager partition=__consumer_offsets-41] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,591] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-41/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,593] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-41/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,595] DEBUG [LeaderEpochCache __consumer_offsets-41] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,595] INFO [Log partition=__consumer_offsets-41, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,595] INFO [ProducerStateManager partition=__consumer_offsets-41] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-41/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,596] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,597] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-41, topic=__consumer_offsets, partition=41, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=3) with 1 segments in 12ms (48/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,597] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-32 (kafka.log.LogManager) [2021-07-14 17:35:12,598] INFO [Log partition=__consumer_offsets-32, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,598] INFO [Log partition=__consumer_offsets-32, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,599] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,599] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,599] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,599] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1620817867240,41), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,599] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,600] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,601] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,601] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,601] INFO [ProducerStateManager partition=__consumer_offsets-32] Writing producer snapshot at offset 42 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,602] INFO [Log partition=__consumer_offsets-32, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 42 (kafka.log.Log) [2021-07-14 17:35:12,602] INFO [Log partition=__consumer_offsets-32, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 42 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,602] INFO [ProducerStateManager partition=__consumer_offsets-32] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000042.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,604] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000042.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 42, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,604] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000042.index to 0 entries; position is now 0 and last offset is now 42 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,604] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000042.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,605] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000042.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,42), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,605] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000042.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,42) (kafka.log.TimeIndex) [2021-07-14 17:35:12,605] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000042.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,605] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000042.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,605] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000042.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,605] INFO [ProducerStateManager partition=__consumer_offsets-32] Writing producer snapshot at offset 43 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,606] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000042.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,607] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000042.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,608] DEBUG [LeaderEpochCache __consumer_offsets-32] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,609] INFO [Log partition=__consumer_offsets-32, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 43 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,609] INFO [ProducerStateManager partition=__consumer_offsets-32] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-32/00000000000000000043.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,610] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,610] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-32, topic=__consumer_offsets, partition=32, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=43) with 2 segments in 13ms (49/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,610] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-3 (kafka.log.LogManager) [2021-07-14 17:35:12,653] INFO [Log partition=__consumer_offsets-3, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,653] INFO [Log partition=__consumer_offsets-3, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,654] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-3/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,655] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-3/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,655] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-3/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,656] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-3/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,656] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-3/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,656] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-3/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,656] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-3/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,657] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-3/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,657] INFO [ProducerStateManager partition=__consumer_offsets-3] Writing producer snapshot at offset 5 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,657] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-3/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,658] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-3/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,660] DEBUG [LeaderEpochCache __consumer_offsets-3] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,660] INFO [Log partition=__consumer_offsets-3, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 5 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,660] INFO [ProducerStateManager partition=__consumer_offsets-3] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-3/00000000000000000005.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,662] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,662] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-3, topic=__consumer_offsets, partition=3, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=5) with 1 segments in 52ms (50/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,662] DEBUG Loading log /home/kafka/data/kafka-logs/__consumer_offsets-13 (kafka.log.LogManager) [2021-07-14 17:35:12,663] INFO [Log partition=__consumer_offsets-13, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,663] INFO [Log partition=__consumer_offsets-13, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,664] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-13/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,664] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-13/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,664] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-13/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,665] DEBUG Loaded index file /home/kafka/data/kafka-logs/__consumer_offsets-13/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,665] DEBUG Truncated index /home/kafka/data/kafka-logs/__consumer_offsets-13/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,665] DEBUG Index /home/kafka/data/kafka-logs/__consumer_offsets-13/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,665] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-13/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,666] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-13/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,666] INFO [ProducerStateManager partition=__consumer_offsets-13] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,666] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-13/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,667] DEBUG Resized /home/kafka/data/kafka-logs/__consumer_offsets-13/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,668] DEBUG [LeaderEpochCache __consumer_offsets-13] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,668] INFO [Log partition=__consumer_offsets-13, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,668] INFO [ProducerStateManager partition=__consumer_offsets-13] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/__consumer_offsets-13/00000000000000000003.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,670] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,670] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/__consumer_offsets-13, topic=__consumer_offsets, partition=13, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=3) with 1 segments in 8ms (51/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,670] DEBUG Loading log /home/kafka/data/kafka-logs/inner.clickhouse.logitem-0 (kafka.log.LogManager) [2021-07-14 17:35:12,671] INFO [Log partition=inner.clickhouse.logitem-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 3103634 (kafka.log.Log) [2021-07-14 17:35:12,671] INFO [Log partition=inner.clickhouse.logitem-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3103634 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,671] INFO [ProducerStateManager partition=inner.clickhouse.logitem-0] Writing producer snapshot at offset 3103634 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,673] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.logitem-0/00000000000003103634.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 3103634, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,673] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.logitem-0/00000000000003103634.index to 0 entries; position is now 0 and last offset is now 3103634 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,673] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.logitem-0/00000000000003103634.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,673] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.logitem-0/00000000000003103634.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,3103634), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,673] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.logitem-0/00000000000003103634.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,3103634) (kafka.log.TimeIndex) [2021-07-14 17:35:12,673] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.logitem-0/00000000000003103634.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,674] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logitem-0/00000000000003103634.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,674] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logitem-0/00000000000003103634.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,674] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logitem-0/00000000000003103634.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,675] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logitem-0/00000000000003103634.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,675] INFO [Log partition=inner.clickhouse.logitem-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3103634 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,677] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,677] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/inner.clickhouse.logitem-0, topic=inner.clickhouse.logitem, partition=0, highWatermark=3103634, lastStableOffset=3103634, logStartOffset=3103634, logEndOffset=3103634) with 1 segments in 7ms (52/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,677] DEBUG Loading log /home/kafka/data/kafka-logs/inner.clickhouse.role-0 (kafka.log.LogManager) [2021-07-14 17:35:12,681] INFO [Log partition=inner.clickhouse.role-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 1522 (kafka.log.Log) [2021-07-14 17:35:12,681] INFO [Log partition=inner.clickhouse.role-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 1522 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,681] INFO [ProducerStateManager partition=inner.clickhouse.role-0] Writing producer snapshot at offset 1522 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,682] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.role-0/00000000000000001522.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 1522, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,682] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.role-0/00000000000000001522.index to 0 entries; position is now 0 and last offset is now 1522 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,682] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.role-0/00000000000000001522.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,683] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.role-0/00000000000000001522.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,1522), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,683] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.role-0/00000000000000001522.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,1522) (kafka.log.TimeIndex) [2021-07-14 17:35:12,683] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.role-0/00000000000000001522.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,684] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.role-0/00000000000000001522.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,684] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.role-0/00000000000000001522.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,684] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.role-0/00000000000000001522.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,684] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.role-0/00000000000000001522.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,684] INFO [Log partition=inner.clickhouse.role-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 1522 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,686] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,686] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/inner.clickhouse.role-0, topic=inner.clickhouse.role, partition=0, highWatermark=1522, lastStableOffset=1522, logStartOffset=1522, logEndOffset=1522) with 1 segments in 9ms (53/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,686] DEBUG Loading log /home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0 (kafka.log.LogManager) [2021-07-14 17:35:12,687] INFO [Log partition=inner.clickhouse.logcurrency-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 1656862 (kafka.log.Log) [2021-07-14 17:35:12,687] INFO [Log partition=inner.clickhouse.logcurrency-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 1656862 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,688] INFO [ProducerStateManager partition=inner.clickhouse.logcurrency-0] Writing producer snapshot at offset 1656862 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,689] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0/00000000000001656862.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 1656862, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,689] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0/00000000000001656862.index to 0 entries; position is now 0 and last offset is now 1656862 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,689] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0/00000000000001656862.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,689] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0/00000000000001656862.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,1656862), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,689] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0/00000000000001656862.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,1656862) (kafka.log.TimeIndex) [2021-07-14 17:35:12,689] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0/00000000000001656862.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,690] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0/00000000000001656862.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,690] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0/00000000000001656862.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,690] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0/00000000000001656862.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,690] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0/00000000000001656862.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,691] INFO [Log partition=inner.clickhouse.logcurrency-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 1656862 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,692] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,692] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/inner.clickhouse.logcurrency-0, topic=inner.clickhouse.logcurrency, partition=0, highWatermark=1656862, lastStableOffset=1656862, logStartOffset=1656862, logEndOffset=1656862) with 1 segments in 6ms (54/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,692] DEBUG Loading log /home/kafka/data/kafka-logs/inner.clickhouse.logother-0 (kafka.log.LogManager) [2021-07-14 17:35:12,693] INFO [Log partition=inner.clickhouse.logother-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 1048066 (kafka.log.Log) [2021-07-14 17:35:12,694] INFO [Log partition=inner.clickhouse.logother-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 1048066 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,694] INFO [ProducerStateManager partition=inner.clickhouse.logother-0] Writing producer snapshot at offset 1048066 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,695] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.logother-0/00000000000001048066.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 1048066, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,695] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.logother-0/00000000000001048066.index to 0 entries; position is now 0 and last offset is now 1048066 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,695] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.logother-0/00000000000001048066.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,696] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.logother-0/00000000000001048066.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,1048066), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,696] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.logother-0/00000000000001048066.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,1048066) (kafka.log.TimeIndex) [2021-07-14 17:35:12,696] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.logother-0/00000000000001048066.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,696] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logother-0/00000000000001048066.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,697] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logother-0/00000000000001048066.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,697] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logother-0/00000000000001048066.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,697] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logother-0/00000000000001048066.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,697] INFO [Log partition=inner.clickhouse.logother-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 1048066 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,698] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,698] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/inner.clickhouse.logother-0, topic=inner.clickhouse.logother, partition=0, highWatermark=1048066, lastStableOffset=1048066, logStartOffset=1048066, logEndOffset=1048066) with 1 segments in 6ms (55/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,698] DEBUG Loading log /home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0 (kafka.log.LogManager) [2021-07-14 17:35:12,699] INFO [Log partition=inner.clickhouse.logsystem-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 689573 (kafka.log.Log) [2021-07-14 17:35:12,699] INFO [Log partition=inner.clickhouse.logsystem-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 689573 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,700] INFO [ProducerStateManager partition=inner.clickhouse.logsystem-0] Writing producer snapshot at offset 689573 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,701] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0/00000000000000689573.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 689573, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,701] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0/00000000000000689573.index to 0 entries; position is now 0 and last offset is now 689573 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,701] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0/00000000000000689573.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,702] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0/00000000000000689573.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,689573), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,702] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0/00000000000000689573.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,689573) (kafka.log.TimeIndex) [2021-07-14 17:35:12,702] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0/00000000000000689573.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,702] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0/00000000000000689573.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,702] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0/00000000000000689573.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,702] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0/00000000000000689573.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,703] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0/00000000000000689573.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,703] INFO [Log partition=inner.clickhouse.logsystem-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 689573 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,704] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,704] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/inner.clickhouse.logsystem-0, topic=inner.clickhouse.logsystem, partition=0, highWatermark=689573, lastStableOffset=689573, logStartOffset=689573, logEndOffset=689573) with 1 segments in 6ms (56/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,705] DEBUG Loading log /home/kafka/data/kafka-logs/repeat.topic.v1-0 (kafka.log.LogManager) [2021-07-14 17:35:12,705] INFO [Log partition=repeat.topic.v1-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 630000 (kafka.log.Log) [2021-07-14 17:35:12,706] INFO [Log partition=repeat.topic.v1-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 630000 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,706] INFO [ProducerStateManager partition=repeat.topic.v1-0] Writing producer snapshot at offset 630000 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,707] DEBUG Loaded index file /home/kafka/data/kafka-logs/repeat.topic.v1-0/00000000000000630000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 630000, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,707] DEBUG Truncated index /home/kafka/data/kafka-logs/repeat.topic.v1-0/00000000000000630000.index to 0 entries; position is now 0 and last offset is now 630000 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,707] DEBUG Index /home/kafka/data/kafka-logs/repeat.topic.v1-0/00000000000000630000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,707] DEBUG Loaded index file /home/kafka/data/kafka-logs/repeat.topic.v1-0/00000000000000630000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,630000), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,707] DEBUG Truncated index /home/kafka/data/kafka-logs/repeat.topic.v1-0/00000000000000630000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,630000) (kafka.log.TimeIndex) [2021-07-14 17:35:12,707] DEBUG Index /home/kafka/data/kafka-logs/repeat.topic.v1-0/00000000000000630000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,708] DEBUG Resized /home/kafka/data/kafka-logs/repeat.topic.v1-0/00000000000000630000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,709] DEBUG Resized /home/kafka/data/kafka-logs/repeat.topic.v1-0/00000000000000630000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,709] DEBUG Resized /home/kafka/data/kafka-logs/repeat.topic.v1-0/00000000000000630000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,709] DEBUG Resized /home/kafka/data/kafka-logs/repeat.topic.v1-0/00000000000000630000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,709] INFO [Log partition=repeat.topic.v1-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 630000 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,710] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,710] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/repeat.topic.v1-0, topic=repeat.topic.v1, partition=0, highWatermark=630000, lastStableOffset=630000, logStartOffset=630000, logEndOffset=630000) with 1 segments in 5ms (57/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,711] DEBUG Loading log /home/kafka/data/kafka-logs/repeat.topic.v2-0 (kafka.log.LogManager) [2021-07-14 17:35:12,712] INFO [Log partition=repeat.topic.v2-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 100000 (kafka.log.Log) [2021-07-14 17:35:12,712] INFO [Log partition=repeat.topic.v2-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 100000 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,712] INFO [ProducerStateManager partition=repeat.topic.v2-0] Writing producer snapshot at offset 100000 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,713] DEBUG Loaded index file /home/kafka/data/kafka-logs/repeat.topic.v2-0/00000000000000100000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 100000, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,713] DEBUG Truncated index /home/kafka/data/kafka-logs/repeat.topic.v2-0/00000000000000100000.index to 0 entries; position is now 0 and last offset is now 100000 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,713] DEBUG Index /home/kafka/data/kafka-logs/repeat.topic.v2-0/00000000000000100000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,714] DEBUG Loaded index file /home/kafka/data/kafka-logs/repeat.topic.v2-0/00000000000000100000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,100000), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,714] DEBUG Truncated index /home/kafka/data/kafka-logs/repeat.topic.v2-0/00000000000000100000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,100000) (kafka.log.TimeIndex) [2021-07-14 17:35:12,714] DEBUG Index /home/kafka/data/kafka-logs/repeat.topic.v2-0/00000000000000100000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,715] DEBUG Resized /home/kafka/data/kafka-logs/repeat.topic.v2-0/00000000000000100000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,715] DEBUG Resized /home/kafka/data/kafka-logs/repeat.topic.v2-0/00000000000000100000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,715] DEBUG Resized /home/kafka/data/kafka-logs/repeat.topic.v2-0/00000000000000100000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,715] DEBUG Resized /home/kafka/data/kafka-logs/repeat.topic.v2-0/00000000000000100000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,715] INFO [Log partition=repeat.topic.v2-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 100000 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,716] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,717] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/repeat.topic.v2-0, topic=repeat.topic.v2, partition=0, highWatermark=100000, lastStableOffset=100000, logStartOffset=100000, logEndOffset=100000) with 1 segments in 5ms (58/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,717] DEBUG Loading log /home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0 (kafka.log.LogManager) [2021-07-14 17:35:12,718] INFO [Log partition=wordcount-application-counts-store-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 82495 (kafka.log.Log) [2021-07-14 17:35:12,718] INFO [Log partition=wordcount-application-counts-store-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 82495 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,718] INFO [ProducerStateManager partition=wordcount-application-counts-store-repartition-0] Writing producer snapshot at offset 82495 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,719] DEBUG Loaded index file /home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0/00000000000000082495.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 82495, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,720] DEBUG Truncated index /home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0/00000000000000082495.index to 0 entries; position is now 0 and last offset is now 82495 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,720] DEBUG Index /home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0/00000000000000082495.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,720] DEBUG Loaded index file /home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0/00000000000000082495.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,82495), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,720] DEBUG Truncated index /home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0/00000000000000082495.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,82495) (kafka.log.TimeIndex) [2021-07-14 17:35:12,720] DEBUG Index /home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0/00000000000000082495.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,768] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0/00000000000000082495.index to 1656, position is 1656 and limit is 1656 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,769] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0/00000000000000082495.timeindex to 2496, position is 2496 and limit is 2496 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,769] INFO [ProducerStateManager partition=wordcount-application-counts-store-repartition-0] Writing producer snapshot at offset 112089 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,778] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0/00000000000000082495.index to 10485760, position is 1656 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,778] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0/00000000000000082495.timeindex to 10485756, position is 2496 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,778] INFO [Log partition=wordcount-application-counts-store-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 112089 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,779] INFO [ProducerStateManager partition=wordcount-application-counts-store-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0/00000000000000112089.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,780] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,780] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/wordcount-application-counts-store-repartition-0, topic=wordcount-application-counts-store-repartition, partition=0, highWatermark=82495, lastStableOffset=82495, logStartOffset=82495, logEndOffset=112089) with 1 segments in 63ms (59/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,780] DEBUG Loading log /home/kafka/data/kafka-logs/word-count-mv-0 (kafka.log.LogManager) [2021-07-14 17:35:12,781] INFO [Log partition=word-count-mv-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 171 (kafka.log.Log) [2021-07-14 17:35:12,781] INFO [Log partition=word-count-mv-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 171 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,781] INFO [ProducerStateManager partition=word-count-mv-0] Writing producer snapshot at offset 171 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,782] DEBUG Loaded index file /home/kafka/data/kafka-logs/word-count-mv-0/00000000000000000171.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 171, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,782] DEBUG Truncated index /home/kafka/data/kafka-logs/word-count-mv-0/00000000000000000171.index to 0 entries; position is now 0 and last offset is now 171 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,782] DEBUG Index /home/kafka/data/kafka-logs/word-count-mv-0/00000000000000000171.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,784] DEBUG Loaded index file /home/kafka/data/kafka-logs/word-count-mv-0/00000000000000000171.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,171), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,784] DEBUG Truncated index /home/kafka/data/kafka-logs/word-count-mv-0/00000000000000000171.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,171) (kafka.log.TimeIndex) [2021-07-14 17:35:12,784] DEBUG Index /home/kafka/data/kafka-logs/word-count-mv-0/00000000000000000171.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,785] DEBUG Resized /home/kafka/data/kafka-logs/word-count-mv-0/00000000000000000171.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,785] DEBUG Resized /home/kafka/data/kafka-logs/word-count-mv-0/00000000000000000171.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,785] DEBUG Resized /home/kafka/data/kafka-logs/word-count-mv-0/00000000000000000171.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,785] DEBUG Resized /home/kafka/data/kafka-logs/word-count-mv-0/00000000000000000171.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,786] INFO [Log partition=word-count-mv-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 171 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,787] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,787] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/word-count-mv-0, topic=word-count-mv, partition=0, highWatermark=171, lastStableOffset=171, logStartOffset=171, logEndOffset=171) with 1 segments in 7ms (60/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,787] DEBUG Loading log /home/kafka/data/kafka-logs/game.recharge-0 (kafka.log.LogManager) [2021-07-14 17:35:12,789] INFO [Log partition=game.recharge-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,789] INFO [Log partition=game.recharge-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,790] DEBUG Loaded index file /home/kafka/data/kafka-logs/game.recharge-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,790] DEBUG Truncated index /home/kafka/data/kafka-logs/game.recharge-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,790] DEBUG Index /home/kafka/data/kafka-logs/game.recharge-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,791] DEBUG Loaded index file /home/kafka/data/kafka-logs/game.recharge-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,791] DEBUG Truncated index /home/kafka/data/kafka-logs/game.recharge-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,791] DEBUG Index /home/kafka/data/kafka-logs/game.recharge-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,793] DEBUG Resized /home/kafka/data/kafka-logs/game.recharge-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,794] DEBUG Resized /home/kafka/data/kafka-logs/game.recharge-0/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,794] DEBUG Resized /home/kafka/data/kafka-logs/game.recharge-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,794] DEBUG Resized /home/kafka/data/kafka-logs/game.recharge-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,794] INFO [Log partition=game.recharge-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,795] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,795] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/game.recharge-0, topic=game.recharge, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 8ms (61/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,795] DEBUG Loading log /home/kafka/data/kafka-logs/experiment.multi.scalable.data-0 (kafka.log.LogManager) [2021-07-14 17:35:12,796] INFO [Log partition=experiment.multi.scalable.data-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 40 (kafka.log.Log) [2021-07-14 17:35:12,796] INFO [Log partition=experiment.multi.scalable.data-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 40 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,797] INFO [ProducerStateManager partition=experiment.multi.scalable.data-0] Writing producer snapshot at offset 40 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,797] DEBUG Loaded index file /home/kafka/data/kafka-logs/experiment.multi.scalable.data-0/00000000000000000040.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 40, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,797] DEBUG Truncated index /home/kafka/data/kafka-logs/experiment.multi.scalable.data-0/00000000000000000040.index to 0 entries; position is now 0 and last offset is now 40 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,797] DEBUG Index /home/kafka/data/kafka-logs/experiment.multi.scalable.data-0/00000000000000000040.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,798] DEBUG Loaded index file /home/kafka/data/kafka-logs/experiment.multi.scalable.data-0/00000000000000000040.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,40), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,798] DEBUG Truncated index /home/kafka/data/kafka-logs/experiment.multi.scalable.data-0/00000000000000000040.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,40) (kafka.log.TimeIndex) [2021-07-14 17:35:12,798] DEBUG Index /home/kafka/data/kafka-logs/experiment.multi.scalable.data-0/00000000000000000040.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,799] DEBUG Resized /home/kafka/data/kafka-logs/experiment.multi.scalable.data-0/00000000000000000040.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,799] DEBUG Resized /home/kafka/data/kafka-logs/experiment.multi.scalable.data-0/00000000000000000040.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,799] DEBUG Resized /home/kafka/data/kafka-logs/experiment.multi.scalable.data-0/00000000000000000040.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,799] DEBUG Resized /home/kafka/data/kafka-logs/experiment.multi.scalable.data-0/00000000000000000040.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,800] INFO [Log partition=experiment.multi.scalable.data-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 40 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,801] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,801] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/experiment.multi.scalable.data-0, topic=experiment.multi.scalable.data, partition=0, highWatermark=40, lastStableOffset=40, logStartOffset=40, logEndOffset=40) with 1 segments in 6ms (62/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,801] DEBUG Loading log /home/kafka/data/kafka-logs/input-0 (kafka.log.LogManager) [2021-07-14 17:35:12,803] INFO [Log partition=input-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,803] INFO [Log partition=input-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,804] DEBUG Loaded index file /home/kafka/data/kafka-logs/input-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,804] DEBUG Truncated index /home/kafka/data/kafka-logs/input-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,804] DEBUG Index /home/kafka/data/kafka-logs/input-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,805] DEBUG Loaded index file /home/kafka/data/kafka-logs/input-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,805] DEBUG Truncated index /home/kafka/data/kafka-logs/input-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,805] DEBUG Index /home/kafka/data/kafka-logs/input-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,805] DEBUG Resized /home/kafka/data/kafka-logs/input-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,806] DEBUG Resized /home/kafka/data/kafka-logs/input-0/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,806] DEBUG Resized /home/kafka/data/kafka-logs/input-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,806] DEBUG Resized /home/kafka/data/kafka-logs/input-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,806] INFO [Log partition=input-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,808] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,808] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/input-0, topic=input, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 7ms (63/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,808] DEBUG Loading log /home/kafka/data/kafka-logs/prod.clickhouse.client-0 (kafka.log.LogManager) [2021-07-14 17:35:12,809] INFO [Log partition=prod.clickhouse.client-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 3 (kafka.log.Log) [2021-07-14 17:35:12,809] INFO [Log partition=prod.clickhouse.client-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,809] INFO [ProducerStateManager partition=prod.clickhouse.client-0] Writing producer snapshot at offset 3 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,810] DEBUG Loaded index file /home/kafka/data/kafka-logs/prod.clickhouse.client-0/00000000000000000003.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 3, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,810] DEBUG Truncated index /home/kafka/data/kafka-logs/prod.clickhouse.client-0/00000000000000000003.index to 0 entries; position is now 0 and last offset is now 3 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,810] DEBUG Index /home/kafka/data/kafka-logs/prod.clickhouse.client-0/00000000000000000003.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,811] DEBUG Loaded index file /home/kafka/data/kafka-logs/prod.clickhouse.client-0/00000000000000000003.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,3), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,811] DEBUG Truncated index /home/kafka/data/kafka-logs/prod.clickhouse.client-0/00000000000000000003.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,3) (kafka.log.TimeIndex) [2021-07-14 17:35:12,811] DEBUG Index /home/kafka/data/kafka-logs/prod.clickhouse.client-0/00000000000000000003.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,812] DEBUG Resized /home/kafka/data/kafka-logs/prod.clickhouse.client-0/00000000000000000003.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,812] DEBUG Resized /home/kafka/data/kafka-logs/prod.clickhouse.client-0/00000000000000000003.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,812] DEBUG Resized /home/kafka/data/kafka-logs/prod.clickhouse.client-0/00000000000000000003.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,812] DEBUG Resized /home/kafka/data/kafka-logs/prod.clickhouse.client-0/00000000000000000003.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,813] INFO [Log partition=prod.clickhouse.client-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 3 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,814] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,814] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/prod.clickhouse.client-0, topic=prod.clickhouse.client, partition=0, highWatermark=3, lastStableOffset=3, logStartOffset=3, logEndOffset=3) with 1 segments in 6ms (64/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,814] DEBUG Loading log /home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0 (kafka.log.LogManager) [2021-07-14 17:35:12,815] INFO [Log partition=experiment.clickhouse.behavior-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 6 (kafka.log.Log) [2021-07-14 17:35:12,815] INFO [Log partition=experiment.clickhouse.behavior-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 6 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,815] INFO [ProducerStateManager partition=experiment.clickhouse.behavior-0] Writing producer snapshot at offset 6 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,825] DEBUG Loaded index file /home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0/00000000000000000006.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 6, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,825] DEBUG Truncated index /home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0/00000000000000000006.index to 0 entries; position is now 0 and last offset is now 6 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,825] DEBUG Index /home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0/00000000000000000006.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,835] DEBUG Loaded index file /home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0/00000000000000000006.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,6), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,835] DEBUG Truncated index /home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0/00000000000000000006.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,6) (kafka.log.TimeIndex) [2021-07-14 17:35:12,835] DEBUG Index /home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0/00000000000000000006.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,835] DEBUG Resized /home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0/00000000000000000006.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,836] DEBUG Resized /home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0/00000000000000000006.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,836] DEBUG Resized /home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0/00000000000000000006.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,836] DEBUG Resized /home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0/00000000000000000006.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,836] INFO [Log partition=experiment.clickhouse.behavior-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 6 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,838] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,838] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/experiment.clickhouse.behavior-0, topic=experiment.clickhouse.behavior, partition=0, highWatermark=6, lastStableOffset=6, logStartOffset=6, logEndOffset=6) with 1 segments in 24ms (65/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,838] DEBUG Loading log /home/kafka/data/kafka-logs/spring.stream.kafka.topic-0 (kafka.log.LogManager) [2021-07-14 17:35:12,839] INFO [Log partition=spring.stream.kafka.topic-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 10 (kafka.log.Log) [2021-07-14 17:35:12,839] INFO [Log partition=spring.stream.kafka.topic-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 10 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,840] INFO [ProducerStateManager partition=spring.stream.kafka.topic-0] Writing producer snapshot at offset 10 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,841] DEBUG Loaded index file /home/kafka/data/kafka-logs/spring.stream.kafka.topic-0/00000000000000000010.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 10, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,841] DEBUG Truncated index /home/kafka/data/kafka-logs/spring.stream.kafka.topic-0/00000000000000000010.index to 0 entries; position is now 0 and last offset is now 10 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,841] DEBUG Index /home/kafka/data/kafka-logs/spring.stream.kafka.topic-0/00000000000000000010.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,853] DEBUG Loaded index file /home/kafka/data/kafka-logs/spring.stream.kafka.topic-0/00000000000000000010.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,10), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,853] DEBUG Truncated index /home/kafka/data/kafka-logs/spring.stream.kafka.topic-0/00000000000000000010.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,10) (kafka.log.TimeIndex) [2021-07-14 17:35:12,853] DEBUG Index /home/kafka/data/kafka-logs/spring.stream.kafka.topic-0/00000000000000000010.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,854] DEBUG Resized /home/kafka/data/kafka-logs/spring.stream.kafka.topic-0/00000000000000000010.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,854] DEBUG Resized /home/kafka/data/kafka-logs/spring.stream.kafka.topic-0/00000000000000000010.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,854] DEBUG Resized /home/kafka/data/kafka-logs/spring.stream.kafka.topic-0/00000000000000000010.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,854] DEBUG Resized /home/kafka/data/kafka-logs/spring.stream.kafka.topic-0/00000000000000000010.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,854] INFO [Log partition=spring.stream.kafka.topic-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 10 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,856] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,856] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/spring.stream.kafka.topic-0, topic=spring.stream.kafka.topic, partition=0, highWatermark=10, lastStableOffset=10, logStartOffset=10, logEndOffset=10) with 1 segments in 18ms (66/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,856] DEBUG Loading log /home/kafka/data/kafka-logs/pcs-0 (kafka.log.LogManager) [2021-07-14 17:35:12,857] INFO [Log partition=pcs-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 14429 (kafka.log.Log) [2021-07-14 17:35:12,857] INFO [Log partition=pcs-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 14429 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,857] INFO [ProducerStateManager partition=pcs-0] Writing producer snapshot at offset 14429 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,859] DEBUG Loaded index file /home/kafka/data/kafka-logs/pcs-0/00000000000000014429.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 14429, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,859] DEBUG Truncated index /home/kafka/data/kafka-logs/pcs-0/00000000000000014429.index to 0 entries; position is now 0 and last offset is now 14429 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,859] DEBUG Index /home/kafka/data/kafka-logs/pcs-0/00000000000000014429.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,859] DEBUG Loaded index file /home/kafka/data/kafka-logs/pcs-0/00000000000000014429.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,14429), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,860] DEBUG Truncated index /home/kafka/data/kafka-logs/pcs-0/00000000000000014429.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,14429) (kafka.log.TimeIndex) [2021-07-14 17:35:12,860] DEBUG Index /home/kafka/data/kafka-logs/pcs-0/00000000000000014429.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,860] DEBUG Resized /home/kafka/data/kafka-logs/pcs-0/00000000000000014429.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,860] DEBUG Resized /home/kafka/data/kafka-logs/pcs-0/00000000000000014429.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,861] DEBUG Resized /home/kafka/data/kafka-logs/pcs-0/00000000000000014429.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,861] DEBUG Resized /home/kafka/data/kafka-logs/pcs-0/00000000000000014429.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,861] INFO [Log partition=pcs-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 14429 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,862] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,863] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/pcs-0, topic=pcs, partition=0, highWatermark=14429, lastStableOffset=14429, logStartOffset=14429, logEndOffset=14429) with 1 segments in 7ms (67/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,863] DEBUG Loading log /home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0 (kafka.log.LogManager) [2021-07-14 17:35:12,864] INFO [Log partition=analytics-pvin-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 9793 (kafka.log.Log) [2021-07-14 17:35:12,864] INFO [Log partition=analytics-pvin-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 9793 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,864] INFO [ProducerStateManager partition=analytics-pvin-pcmv-repartition-0] Writing producer snapshot at offset 9793 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,865] DEBUG Loaded index file /home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0/00000000000000009793.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 9793, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,865] DEBUG Truncated index /home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0/00000000000000009793.index to 0 entries; position is now 0 and last offset is now 9793 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,865] DEBUG Index /home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0/00000000000000009793.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,866] DEBUG Loaded index file /home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0/00000000000000009793.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,9793), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,866] DEBUG Truncated index /home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0/00000000000000009793.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,9793) (kafka.log.TimeIndex) [2021-07-14 17:35:12,866] DEBUG Index /home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0/00000000000000009793.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,882] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0/00000000000000009793.index to 984, position is 984 and limit is 984 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,883] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0/00000000000000009793.timeindex to 1488, position is 1488 and limit is 1488 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,883] INFO [ProducerStateManager partition=analytics-pvin-pcmv-repartition-0] Writing producer snapshot at offset 12881 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,884] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0/00000000000000009793.index to 10485760, position is 984 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,884] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0/00000000000000009793.timeindex to 10485756, position is 1488 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,885] INFO [Log partition=analytics-pvin-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 12881 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,885] INFO [ProducerStateManager partition=analytics-pvin-pcmv-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0/00000000000000012881.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,886] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,886] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/analytics-pvin-pcmv-repartition-0, topic=analytics-pvin-pcmv-repartition, partition=0, highWatermark=9793, lastStableOffset=9793, logStartOffset=9793, logEndOffset=12881) with 1 segments in 23ms (68/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,886] DEBUG Loading log /home/kafka/data/kafka-logs/TextLineTopic-0 (kafka.log.LogManager) [2021-07-14 17:35:12,887] INFO [Log partition=TextLineTopic-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 26267 (kafka.log.Log) [2021-07-14 17:35:12,887] INFO [Log partition=TextLineTopic-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 26267 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,887] INFO [ProducerStateManager partition=TextLineTopic-0] Writing producer snapshot at offset 26267 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,890] DEBUG Loaded index file /home/kafka/data/kafka-logs/TextLineTopic-0/00000000000000026267.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 26267, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,890] DEBUG Truncated index /home/kafka/data/kafka-logs/TextLineTopic-0/00000000000000026267.index to 0 entries; position is now 0 and last offset is now 26267 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,890] DEBUG Index /home/kafka/data/kafka-logs/TextLineTopic-0/00000000000000026267.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,891] DEBUG Loaded index file /home/kafka/data/kafka-logs/TextLineTopic-0/00000000000000026267.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,26267), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,891] DEBUG Truncated index /home/kafka/data/kafka-logs/TextLineTopic-0/00000000000000026267.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,26267) (kafka.log.TimeIndex) [2021-07-14 17:35:12,891] DEBUG Index /home/kafka/data/kafka-logs/TextLineTopic-0/00000000000000026267.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,892] DEBUG Resized /home/kafka/data/kafka-logs/TextLineTopic-0/00000000000000026267.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,892] DEBUG Resized /home/kafka/data/kafka-logs/TextLineTopic-0/00000000000000026267.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,892] DEBUG Resized /home/kafka/data/kafka-logs/TextLineTopic-0/00000000000000026267.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,892] DEBUG Resized /home/kafka/data/kafka-logs/TextLineTopic-0/00000000000000026267.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,892] INFO [Log partition=TextLineTopic-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 26267 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,893] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,894] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/TextLineTopic-0, topic=TextLineTopic, partition=0, highWatermark=26267, lastStableOffset=26267, logStartOffset=26267, logEndOffset=26267) with 1 segments in 8ms (69/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,894] DEBUG Loading log /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0 (kafka.log.LogManager) [2021-07-14 17:35:12,895] INFO [Log partition=wordcount-application-counts-store-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:12,895] INFO [Log partition=wordcount-application-counts-store-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,895] DEBUG Loaded index file /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,895] DEBUG Truncated index /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,895] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,895] DEBUG Loaded index file /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619748039026,10995), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:12,896] DEBUG Truncated index /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:12,896] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,896] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,896] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,896] INFO [ProducerStateManager partition=wordcount-application-counts-store-changelog-0] Writing producer snapshot at offset 10996 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,897] INFO [Log partition=wordcount-application-counts-store-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 10996 (kafka.log.Log) [2021-07-14 17:35:12,897] INFO [Log partition=wordcount-application-counts-store-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 10996 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,897] INFO [ProducerStateManager partition=wordcount-application-counts-store-changelog-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000010996.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,898] DEBUG Loaded index file /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000010996.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 10996, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,898] DEBUG Truncated index /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000010996.index to 0 entries; position is now 0 and last offset is now 10996 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,898] DEBUG Index /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000010996.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,899] DEBUG Loaded index file /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000010996.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,10996), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,899] DEBUG Truncated index /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000010996.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,10996) (kafka.log.TimeIndex) [2021-07-14 17:35:12,899] DEBUG Index /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000010996.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,902] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000010996.index to 176, position is 176 and limit is 176 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,903] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000010996.timeindex to 276, position is 276 and limit is 276 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,903] INFO [ProducerStateManager partition=wordcount-application-counts-store-changelog-0] Writing producer snapshot at offset 15201 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,951] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000010996.index to 10485760, position is 176 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,952] DEBUG Resized /home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000010996.timeindex to 10485756, position is 276 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,953] DEBUG [LeaderEpochCache wordcount-application-counts-store-changelog-0] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:12,953] INFO [Log partition=wordcount-application-counts-store-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 15201 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,955] INFO [ProducerStateManager partition=wordcount-application-counts-store-changelog-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0/00000000000000015201.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,956] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,956] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/wordcount-application-counts-store-changelog-0, topic=wordcount-application-counts-store-changelog, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=15201) with 2 segments in 62ms (70/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,956] DEBUG Loading log /home/kafka/data/kafka-logs/word-count-mv-v1-0 (kafka.log.LogManager) [2021-07-14 17:35:12,957] INFO [Log partition=word-count-mv-v1-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 5206 (kafka.log.Log) [2021-07-14 17:35:12,957] INFO [Log partition=word-count-mv-v1-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 5206 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,958] INFO [ProducerStateManager partition=word-count-mv-v1-0] Writing producer snapshot at offset 5206 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,965] DEBUG Loaded index file /home/kafka/data/kafka-logs/word-count-mv-v1-0/00000000000000005206.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 5206, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,965] DEBUG Truncated index /home/kafka/data/kafka-logs/word-count-mv-v1-0/00000000000000005206.index to 0 entries; position is now 0 and last offset is now 5206 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,965] DEBUG Index /home/kafka/data/kafka-logs/word-count-mv-v1-0/00000000000000005206.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,966] DEBUG Loaded index file /home/kafka/data/kafka-logs/word-count-mv-v1-0/00000000000000005206.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,5206), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,966] DEBUG Truncated index /home/kafka/data/kafka-logs/word-count-mv-v1-0/00000000000000005206.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,5206) (kafka.log.TimeIndex) [2021-07-14 17:35:12,966] DEBUG Index /home/kafka/data/kafka-logs/word-count-mv-v1-0/00000000000000005206.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,967] DEBUG Resized /home/kafka/data/kafka-logs/word-count-mv-v1-0/00000000000000005206.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,967] DEBUG Resized /home/kafka/data/kafka-logs/word-count-mv-v1-0/00000000000000005206.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,967] DEBUG Resized /home/kafka/data/kafka-logs/word-count-mv-v1-0/00000000000000005206.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,967] DEBUG Resized /home/kafka/data/kafka-logs/word-count-mv-v1-0/00000000000000005206.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,967] INFO [Log partition=word-count-mv-v1-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 5206 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,968] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,968] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/word-count-mv-v1-0, topic=word-count-mv-v1, partition=0, highWatermark=5206, lastStableOffset=5206, logStartOffset=5206, logEndOffset=5206) with 1 segments in 12ms (71/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,968] DEBUG Loading log /home/kafka/data/kafka-logs/experiment.scalable.behaviour-0 (kafka.log.LogManager) [2021-07-14 17:35:12,969] INFO [Log partition=experiment.scalable.behaviour-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 11 (kafka.log.Log) [2021-07-14 17:35:12,969] INFO [Log partition=experiment.scalable.behaviour-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 11 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,969] INFO [ProducerStateManager partition=experiment.scalable.behaviour-0] Writing producer snapshot at offset 11 (kafka.log.ProducerStateManager) [2021-07-14 17:35:12,971] DEBUG Loaded index file /home/kafka/data/kafka-logs/experiment.scalable.behaviour-0/00000000000000000011.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 11, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,971] DEBUG Truncated index /home/kafka/data/kafka-logs/experiment.scalable.behaviour-0/00000000000000000011.index to 0 entries; position is now 0 and last offset is now 11 (kafka.log.OffsetIndex) [2021-07-14 17:35:12,971] DEBUG Index /home/kafka/data/kafka-logs/experiment.scalable.behaviour-0/00000000000000000011.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,975] DEBUG Loaded index file /home/kafka/data/kafka-logs/experiment.scalable.behaviour-0/00000000000000000011.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,11), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:12,975] DEBUG Truncated index /home/kafka/data/kafka-logs/experiment.scalable.behaviour-0/00000000000000000011.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,11) (kafka.log.TimeIndex) [2021-07-14 17:35:12,975] DEBUG Index /home/kafka/data/kafka-logs/experiment.scalable.behaviour-0/00000000000000000011.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,976] DEBUG Resized /home/kafka/data/kafka-logs/experiment.scalable.behaviour-0/00000000000000000011.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,976] DEBUG Resized /home/kafka/data/kafka-logs/experiment.scalable.behaviour-0/00000000000000000011.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,976] DEBUG Resized /home/kafka/data/kafka-logs/experiment.scalable.behaviour-0/00000000000000000011.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,976] DEBUG Resized /home/kafka/data/kafka-logs/experiment.scalable.behaviour-0/00000000000000000011.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:12,977] INFO [Log partition=experiment.scalable.behaviour-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 11 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,978] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:12,978] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/experiment.scalable.behaviour-0, topic=experiment.scalable.behaviour, partition=0, highWatermark=11, lastStableOffset=11, logStartOffset=11, logEndOffset=11) with 1 segments in 10ms (72/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:12,978] DEBUG Loading log /home/kafka/data/kafka-logs/bench_mark.topic-0 (kafka.log.LogManager) [2021-07-14 17:35:12,979] INFO [Log partition=bench_mark.topic-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 127582954 (kafka.log.Log) [2021-07-14 17:35:12,979] INFO [Log partition=bench_mark.topic-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 127582954 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:12,979] INFO [ProducerStateManager partition=bench_mark.topic-0] Writing producer snapshot at offset 127582954 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,010] DEBUG Loaded index file /home/kafka/data/kafka-logs/bench_mark.topic-0/00000000000127582954.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 127582954, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,010] DEBUG Truncated index /home/kafka/data/kafka-logs/bench_mark.topic-0/00000000000127582954.index to 0 entries; position is now 0 and last offset is now 127582954 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,010] DEBUG Index /home/kafka/data/kafka-logs/bench_mark.topic-0/00000000000127582954.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,012] DEBUG Loaded index file /home/kafka/data/kafka-logs/bench_mark.topic-0/00000000000127582954.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,127582954), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,012] DEBUG Truncated index /home/kafka/data/kafka-logs/bench_mark.topic-0/00000000000127582954.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,127582954) (kafka.log.TimeIndex) [2021-07-14 17:35:13,012] DEBUG Index /home/kafka/data/kafka-logs/bench_mark.topic-0/00000000000127582954.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,012] DEBUG Resized /home/kafka/data/kafka-logs/bench_mark.topic-0/00000000000127582954.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,013] DEBUG Resized /home/kafka/data/kafka-logs/bench_mark.topic-0/00000000000127582954.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,013] DEBUG Resized /home/kafka/data/kafka-logs/bench_mark.topic-0/00000000000127582954.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,013] DEBUG Resized /home/kafka/data/kafka-logs/bench_mark.topic-0/00000000000127582954.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,013] INFO [Log partition=bench_mark.topic-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 127582954 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,014] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,014] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/bench_mark.topic-0, topic=bench_mark.topic, partition=0, highWatermark=127582954, lastStableOffset=127582954, logStartOffset=127582954, logEndOffset=127582954) with 1 segments in 36ms (73/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,014] DEBUG Loading log /home/kafka/data/kafka-logs/pvs-0 (kafka.log.LogManager) [2021-07-14 17:35:13,015] INFO [Log partition=pvs-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 36503 (kafka.log.Log) [2021-07-14 17:35:13,015] INFO [Log partition=pvs-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 36503 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,015] INFO [ProducerStateManager partition=pvs-0] Writing producer snapshot at offset 36503 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,016] DEBUG Loaded index file /home/kafka/data/kafka-logs/pvs-0/00000000000000036503.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 36503, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,016] DEBUG Truncated index /home/kafka/data/kafka-logs/pvs-0/00000000000000036503.index to 0 entries; position is now 0 and last offset is now 36503 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,016] DEBUG Index /home/kafka/data/kafka-logs/pvs-0/00000000000000036503.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,017] DEBUG Loaded index file /home/kafka/data/kafka-logs/pvs-0/00000000000000036503.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,36503), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,017] DEBUG Truncated index /home/kafka/data/kafka-logs/pvs-0/00000000000000036503.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,36503) (kafka.log.TimeIndex) [2021-07-14 17:35:13,017] DEBUG Index /home/kafka/data/kafka-logs/pvs-0/00000000000000036503.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,018] DEBUG Resized /home/kafka/data/kafka-logs/pvs-0/00000000000000036503.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,018] DEBUG Resized /home/kafka/data/kafka-logs/pvs-0/00000000000000036503.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,019] DEBUG Resized /home/kafka/data/kafka-logs/pvs-0/00000000000000036503.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,019] DEBUG Resized /home/kafka/data/kafka-logs/pvs-0/00000000000000036503.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,019] INFO [Log partition=pvs-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 36503 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,020] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,021] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/pvs-0, topic=pvs, partition=0, highWatermark=36503, lastStableOffset=36503, logStartOffset=36503, logEndOffset=36503) with 1 segments in 6ms (74/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,021] DEBUG Loading log /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0 (kafka.log.LogManager) [2021-07-14 17:35:13,023] INFO [Log partition=analytics-pvin-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,023] INFO [Log partition=analytics-pvin-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,024] DEBUG Loaded index file /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,024] DEBUG Truncated index /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,024] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,024] DEBUG Loaded index file /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1619748059144,9717), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:13,024] DEBUG Truncated index /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,024] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,025] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,025] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,025] INFO [ProducerStateManager partition=analytics-pvin-pcmv-changelog-0] Writing producer snapshot at offset 9718 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,026] INFO [Log partition=analytics-pvin-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 9718 (kafka.log.Log) [2021-07-14 17:35:13,026] INFO [Log partition=analytics-pvin-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 9718 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,027] INFO [ProducerStateManager partition=analytics-pvin-pcmv-changelog-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000009718.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,030] DEBUG Loaded index file /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000009718.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 9718, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,030] DEBUG Truncated index /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000009718.index to 0 entries; position is now 0 and last offset is now 9718 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,030] DEBUG Index /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000009718.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,031] DEBUG Loaded index file /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000009718.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,9718), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,031] DEBUG Truncated index /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000009718.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,9718) (kafka.log.TimeIndex) [2021-07-14 17:35:13,031] DEBUG Index /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000009718.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,041] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000009718.index to 472, position is 472 and limit is 472 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,041] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000009718.timeindex to 720, position is 720 and limit is 720 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,041] INFO [ProducerStateManager partition=analytics-pvin-pcmv-changelog-0] Writing producer snapshot at offset 12785 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,048] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000009718.index to 10485760, position is 472 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,048] DEBUG Resized /home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000009718.timeindex to 10485756, position is 720 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,050] DEBUG [LeaderEpochCache analytics-pvin-pcmv-changelog-0] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:13,051] INFO [Log partition=analytics-pvin-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 12785 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,052] INFO [ProducerStateManager partition=analytics-pvin-pcmv-changelog-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0/00000000000000012785.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,053] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,053] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/analytics-pvin-pcmv-changelog-0, topic=analytics-pvin-pcmv-changelog, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=12785) with 2 segments in 32ms (75/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,053] DEBUG Loading log /home/kafka/data/kafka-logs/WordWithCountsTopic-0 (kafka.log.LogManager) [2021-07-14 17:35:13,054] INFO [Log partition=WordWithCountsTopic-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 10996 (kafka.log.Log) [2021-07-14 17:35:13,054] INFO [Log partition=WordWithCountsTopic-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 10996 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,055] INFO [ProducerStateManager partition=WordWithCountsTopic-0] Writing producer snapshot at offset 10996 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,056] DEBUG Loaded index file /home/kafka/data/kafka-logs/WordWithCountsTopic-0/00000000000000010996.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 10996, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,056] DEBUG Truncated index /home/kafka/data/kafka-logs/WordWithCountsTopic-0/00000000000000010996.index to 0 entries; position is now 0 and last offset is now 10996 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,056] DEBUG Index /home/kafka/data/kafka-logs/WordWithCountsTopic-0/00000000000000010996.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,061] DEBUG Loaded index file /home/kafka/data/kafka-logs/WordWithCountsTopic-0/00000000000000010996.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,10996), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,061] DEBUG Truncated index /home/kafka/data/kafka-logs/WordWithCountsTopic-0/00000000000000010996.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,10996) (kafka.log.TimeIndex) [2021-07-14 17:35:13,061] DEBUG Index /home/kafka/data/kafka-logs/WordWithCountsTopic-0/00000000000000010996.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,061] DEBUG Resized /home/kafka/data/kafka-logs/WordWithCountsTopic-0/00000000000000010996.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,062] DEBUG Resized /home/kafka/data/kafka-logs/WordWithCountsTopic-0/00000000000000010996.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,062] DEBUG Resized /home/kafka/data/kafka-logs/WordWithCountsTopic-0/00000000000000010996.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,062] DEBUG Resized /home/kafka/data/kafka-logs/WordWithCountsTopic-0/00000000000000010996.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,062] INFO [Log partition=WordWithCountsTopic-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 10996 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,063] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,063] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/WordWithCountsTopic-0, topic=WordWithCountsTopic, partition=0, highWatermark=10996, lastStableOffset=10996, logStartOffset=10996, logEndOffset=10996) with 1 segments in 10ms (76/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,064] DEBUG Loading log /home/kafka/data/kafka-logs/output-0 (kafka.log.LogManager) [2021-07-14 17:35:13,064] INFO [Log partition=output-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,065] INFO [Log partition=output-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,065] DEBUG Loaded index file /home/kafka/data/kafka-logs/output-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,066] DEBUG Truncated index /home/kafka/data/kafka-logs/output-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,066] DEBUG Index /home/kafka/data/kafka-logs/output-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,066] DEBUG Loaded index file /home/kafka/data/kafka-logs/output-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,066] DEBUG Truncated index /home/kafka/data/kafka-logs/output-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,066] DEBUG Index /home/kafka/data/kafka-logs/output-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,067] DEBUG Resized /home/kafka/data/kafka-logs/output-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,067] DEBUG Resized /home/kafka/data/kafka-logs/output-0/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,067] DEBUG Resized /home/kafka/data/kafka-logs/output-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,067] DEBUG Resized /home/kafka/data/kafka-logs/output-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,068] INFO [Log partition=output-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,069] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,069] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/output-0, topic=output, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 5ms (77/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,069] DEBUG Loading log /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0 (kafka.log.LogManager) [2021-07-14 17:35:13,070] INFO [Log partition=PageViewEventSink-process-applicationId-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,071] INFO [Log partition=PageViewEventSink-process-applicationId-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,071] DEBUG Loaded index file /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,071] DEBUG Truncated index /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,071] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,071] DEBUG Loaded index file /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1621477734971,706), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:13,071] DEBUG Truncated index /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,072] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,072] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,072] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,072] INFO [ProducerStateManager partition=PageViewEventSink-process-applicationId-pcmv-changelog-0] Writing producer snapshot at offset 707 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,082] INFO [Log partition=PageViewEventSink-process-applicationId-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 707 (kafka.log.Log) [2021-07-14 17:35:13,083] INFO [Log partition=PageViewEventSink-process-applicationId-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 707 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,083] INFO [ProducerStateManager partition=PageViewEventSink-process-applicationId-pcmv-changelog-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000707.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,084] DEBUG Loaded index file /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000707.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 707, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,084] DEBUG Truncated index /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000707.index to 0 entries; position is now 0 and last offset is now 707 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,084] DEBUG Index /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000707.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,085] DEBUG Loaded index file /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000707.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,707), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,085] DEBUG Truncated index /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000707.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,707) (kafka.log.TimeIndex) [2021-07-14 17:35:13,085] DEBUG Index /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000707.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,118] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000707.index to 24, position is 24 and limit is 24 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,119] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000707.timeindex to 48, position is 48 and limit is 48 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,119] INFO [ProducerStateManager partition=PageViewEventSink-process-applicationId-pcmv-changelog-0] Writing producer snapshot at offset 1186 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,121] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000707.index to 10485760, position is 24 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,127] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000000707.timeindex to 10485756, position is 48 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,128] DEBUG [LeaderEpochCache PageViewEventSink-process-applicationId-pcmv-changelog-0] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:13,128] INFO [Log partition=PageViewEventSink-process-applicationId-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 1186 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,128] INFO [ProducerStateManager partition=PageViewEventSink-process-applicationId-pcmv-changelog-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0/00000000000000001186.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,129] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,130] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-changelog-0, topic=PageViewEventSink-process-applicationId-pcmv-changelog, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=1186) with 2 segments in 60ms (78/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,130] DEBUG Loading log /home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0 (kafka.log.LogManager) [2021-07-14 17:35:13,131] INFO [Log partition=inner.clickhouse.rechargelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 19 (kafka.log.Log) [2021-07-14 17:35:13,131] INFO [Log partition=inner.clickhouse.rechargelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 19 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,131] INFO [ProducerStateManager partition=inner.clickhouse.rechargelog-0] Writing producer snapshot at offset 19 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,132] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0/00000000000000000019.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 19, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,132] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0/00000000000000000019.index to 0 entries; position is now 0 and last offset is now 19 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,132] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0/00000000000000000019.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,133] DEBUG Loaded index file /home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0/00000000000000000019.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,19), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,133] DEBUG Truncated index /home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0/00000000000000000019.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,19) (kafka.log.TimeIndex) [2021-07-14 17:35:13,133] DEBUG Index /home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0/00000000000000000019.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,133] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0/00000000000000000019.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,134] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0/00000000000000000019.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,134] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0/00000000000000000019.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,134] DEBUG Resized /home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0/00000000000000000019.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,134] INFO [Log partition=inner.clickhouse.rechargelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 19 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,136] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,136] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/inner.clickhouse.rechargelog-0, topic=inner.clickhouse.rechargelog, partition=0, highWatermark=19, lastStableOffset=19, logStartOffset=19, logEndOffset=19) with 1 segments in 6ms (79/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,136] DEBUG Loading log /home/kafka/data/kafka-logs/pvout-0 (kafka.log.LogManager) [2021-07-14 17:35:13,137] INFO [Log partition=pvout-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,137] INFO [Log partition=pvout-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,138] DEBUG Loaded index file /home/kafka/data/kafka-logs/pvout-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,138] DEBUG Truncated index /home/kafka/data/kafka-logs/pvout-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,138] DEBUG Index /home/kafka/data/kafka-logs/pvout-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,139] DEBUG Loaded index file /home/kafka/data/kafka-logs/pvout-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,139] DEBUG Truncated index /home/kafka/data/kafka-logs/pvout-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,139] DEBUG Index /home/kafka/data/kafka-logs/pvout-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,172] DEBUG Resized /home/kafka/data/kafka-logs/pvout-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,172] DEBUG Resized /home/kafka/data/kafka-logs/pvout-0/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,176] DEBUG Resized /home/kafka/data/kafka-logs/pvout-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,177] DEBUG Resized /home/kafka/data/kafka-logs/pvout-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,177] INFO [Log partition=pvout-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,178] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,178] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/pvout-0, topic=pvout, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 42ms (80/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,178] DEBUG Loading log /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0 (kafka.log.LogManager) [2021-07-14 17:35:13,179] INFO [Log partition=Kafka-Game-Analytics-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,179] INFO [Log partition=Kafka-Game-Analytics-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,179] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000000000.index with maxEntries = 75, maxIndexSize = 10485760, entries = 75, lastOffset = 4690, file position = 600 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,179] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,180] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,180] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000000000.timeindex with maxEntries = 76, maxIndexSize = 10485760, entries = 76, lastOffset = TimestampOffset(1620871446650,4707), file position = 912 (kafka.log.TimeIndex) [2021-07-14 17:35:13,180] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,181] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,185] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000000000.index to 600, position is 600 and limit is 600 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,186] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000000000.timeindex to 912, position is 912 and limit is 912 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,186] INFO [ProducerStateManager partition=Kafka-Game-Analytics-pcmv-repartition-0] Writing producer snapshot at offset 4708 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,186] INFO [Log partition=Kafka-Game-Analytics-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 4708 (kafka.log.Log) [2021-07-14 17:35:13,187] INFO [Log partition=Kafka-Game-Analytics-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 4708 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,187] INFO [ProducerStateManager partition=Kafka-Game-Analytics-pcmv-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000004708.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,188] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000004708.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 4708, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,188] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000004708.index to 0 entries; position is now 0 and last offset is now 4708 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,188] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000004708.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,188] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000004708.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,4708), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,188] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000004708.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,4708) (kafka.log.TimeIndex) [2021-07-14 17:35:13,188] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000004708.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,189] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000004708.index to 96, position is 96 and limit is 96 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,190] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000004708.timeindex to 156, position is 156 and limit is 156 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,190] INFO [ProducerStateManager partition=Kafka-Game-Analytics-pcmv-repartition-0] Writing producer snapshot at offset 5763 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,192] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000004708.index to 10485760, position is 96 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,192] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000004708.timeindex to 10485756, position is 156 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,192] INFO [Log partition=Kafka-Game-Analytics-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 5763 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,193] INFO [ProducerStateManager partition=Kafka-Game-Analytics-pcmv-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0/00000000000000005763.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,194] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,194] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-repartition-0, topic=Kafka-Game-Analytics-pcmv-repartition, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=5763) with 2 segments in 16ms (81/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,194] DEBUG Loading log /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0 (kafka.log.LogManager) [2021-07-14 17:35:13,196] INFO [Log partition=Kafka-Game-Analytics-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,196] INFO [Log partition=Kafka-Game-Analytics-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,197] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,197] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,197] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,198] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,198] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,198] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,199] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0/00000000000000000000.index to 24, position is 24 and limit is 24 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,200] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0/00000000000000000000.timeindex to 48, position is 48 and limit is 48 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,200] INFO [ProducerStateManager partition=Kafka-Game-Analytics-pcmv-changelog-0] Writing producer snapshot at offset 442 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,206] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0/00000000000000000000.index to 10485760, position is 24 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,206] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0/00000000000000000000.timeindex to 10485756, position is 48 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,208] DEBUG [LeaderEpochCache Kafka-Game-Analytics-pcmv-changelog-0] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:13,208] INFO [Log partition=Kafka-Game-Analytics-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 442 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,209] INFO [ProducerStateManager partition=Kafka-Game-Analytics-pcmv-changelog-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0/00000000000000000442.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,210] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,210] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/Kafka-Game-Analytics-pcmv-changelog-0, topic=Kafka-Game-Analytics-pcmv-changelog, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=442) with 1 segments in 16ms (82/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,210] DEBUG Loading log /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0 (kafka.log.LogManager) [2021-07-14 17:35:13,211] INFO [Log partition=Kafka-Game-Analytics-AppId-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,211] INFO [Log partition=Kafka-Game-Analytics-AppId-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,215] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,215] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,215] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,216] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,216] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,216] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,217] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0/00000000000000000000.index to 24, position is 24 and limit is 24 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,218] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0/00000000000000000000.timeindex to 36, position is 36 and limit is 36 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,218] INFO [ProducerStateManager partition=Kafka-Game-Analytics-AppId-role-login-mv-repartition-0] Writing producer snapshot at offset 408 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,226] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0/00000000000000000000.index to 10485760, position is 24 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,227] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0/00000000000000000000.timeindex to 10485756, position is 36 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,228] DEBUG [LeaderEpochCache Kafka-Game-Analytics-AppId-role-login-mv-repartition-0] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:13,228] INFO [Log partition=Kafka-Game-Analytics-AppId-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 408 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,228] INFO [ProducerStateManager partition=Kafka-Game-Analytics-AppId-role-login-mv-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0/00000000000000000408.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,229] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,229] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-repartition-0, topic=Kafka-Game-Analytics-AppId-role-login-mv-repartition, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=408) with 1 segments in 19ms (83/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,229] DEBUG Loading log /home/kafka/data/kafka-logs/game.analytics.stream-0 (kafka.log.LogManager) [2021-07-14 17:35:13,230] INFO [Log partition=game.analytics.stream-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 44642 (kafka.log.Log) [2021-07-14 17:35:13,230] INFO [Log partition=game.analytics.stream-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 44642 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,230] INFO [ProducerStateManager partition=game.analytics.stream-0] Writing producer snapshot at offset 44642 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,231] DEBUG Loaded index file /home/kafka/data/kafka-logs/game.analytics.stream-0/00000000000000044642.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 44642, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,231] DEBUG Truncated index /home/kafka/data/kafka-logs/game.analytics.stream-0/00000000000000044642.index to 0 entries; position is now 0 and last offset is now 44642 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,231] DEBUG Index /home/kafka/data/kafka-logs/game.analytics.stream-0/00000000000000044642.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,233] DEBUG Loaded index file /home/kafka/data/kafka-logs/game.analytics.stream-0/00000000000000044642.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,44642), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,233] DEBUG Truncated index /home/kafka/data/kafka-logs/game.analytics.stream-0/00000000000000044642.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,44642) (kafka.log.TimeIndex) [2021-07-14 17:35:13,233] DEBUG Index /home/kafka/data/kafka-logs/game.analytics.stream-0/00000000000000044642.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,296] DEBUG Resized /home/kafka/data/kafka-logs/game.analytics.stream-0/00000000000000044642.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,296] DEBUG Resized /home/kafka/data/kafka-logs/game.analytics.stream-0/00000000000000044642.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,297] DEBUG Resized /home/kafka/data/kafka-logs/game.analytics.stream-0/00000000000000044642.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,297] DEBUG Resized /home/kafka/data/kafka-logs/game.analytics.stream-0/00000000000000044642.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,297] INFO [Log partition=game.analytics.stream-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 44642 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,298] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,299] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/game.analytics.stream-0, topic=game.analytics.stream, partition=0, highWatermark=44642, lastStableOffset=44642, logStartOffset=44642, logEndOffset=44642) with 1 segments in 70ms (84/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,299] DEBUG Loading log /home/kafka/data/kafka-logs/game.role.login.count-0 (kafka.log.LogManager) [2021-07-14 17:35:13,300] INFO [Log partition=game.role.login.count-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 1057 (kafka.log.Log) [2021-07-14 17:35:13,300] INFO [Log partition=game.role.login.count-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 1057 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,300] INFO [ProducerStateManager partition=game.role.login.count-0] Writing producer snapshot at offset 1057 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,302] DEBUG Loaded index file /home/kafka/data/kafka-logs/game.role.login.count-0/00000000000000001057.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 1057, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,302] DEBUG Truncated index /home/kafka/data/kafka-logs/game.role.login.count-0/00000000000000001057.index to 0 entries; position is now 0 and last offset is now 1057 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,302] DEBUG Index /home/kafka/data/kafka-logs/game.role.login.count-0/00000000000000001057.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,303] DEBUG Loaded index file /home/kafka/data/kafka-logs/game.role.login.count-0/00000000000000001057.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,1057), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,303] DEBUG Truncated index /home/kafka/data/kafka-logs/game.role.login.count-0/00000000000000001057.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,1057) (kafka.log.TimeIndex) [2021-07-14 17:35:13,303] DEBUG Index /home/kafka/data/kafka-logs/game.role.login.count-0/00000000000000001057.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,303] DEBUG Resized /home/kafka/data/kafka-logs/game.role.login.count-0/00000000000000001057.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,304] DEBUG Resized /home/kafka/data/kafka-logs/game.role.login.count-0/00000000000000001057.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,304] DEBUG Resized /home/kafka/data/kafka-logs/game.role.login.count-0/00000000000000001057.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,304] DEBUG Resized /home/kafka/data/kafka-logs/game.role.login.count-0/00000000000000001057.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,304] INFO [Log partition=game.role.login.count-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 1057 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,305] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,305] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/game.role.login.count-0, topic=game.role.login.count, partition=0, highWatermark=1057, lastStableOffset=1057, logStartOffset=1057, logEndOffset=1057) with 1 segments in 6ms (85/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,305] DEBUG Loading log /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0 (kafka.log.LogManager) [2021-07-14 17:35:13,307] INFO [Log partition=Kafka-Game-Analytics-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,307] INFO [Log partition=Kafka-Game-Analytics-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,308] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,308] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,308] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,309] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,309] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,309] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,310] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0/00000000000000000000.index to 96, position is 96 and limit is 96 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,310] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0/00000000000000000000.timeindex to 156, position is 156 and limit is 156 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,310] INFO [ProducerStateManager partition=Kafka-Game-Analytics-role-login-mv-repartition-0] Writing producer snapshot at offset 481 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,311] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0/00000000000000000000.index to 10485760, position is 96 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,311] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0/00000000000000000000.timeindex to 10485756, position is 156 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,312] INFO [Log partition=Kafka-Game-Analytics-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 481 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,312] INFO [ProducerStateManager partition=Kafka-Game-Analytics-role-login-mv-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0/00000000000000000481.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,314] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,314] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-repartition-0, topic=Kafka-Game-Analytics-role-login-mv-repartition, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=481) with 1 segments in 9ms (86/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,314] DEBUG Loading log /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0 (kafka.log.LogManager) [2021-07-14 17:35:13,315] INFO [Log partition=Kafka-Game-Analytics-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,315] INFO [Log partition=Kafka-Game-Analytics-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,322] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,322] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,322] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,323] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,323] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,323] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,324] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,324] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,324] INFO [ProducerStateManager partition=Kafka-Game-Analytics-role-login-mv-changelog-0] Writing producer snapshot at offset 75 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,325] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,326] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,332] DEBUG [LeaderEpochCache Kafka-Game-Analytics-role-login-mv-changelog-0] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:13,332] INFO [Log partition=Kafka-Game-Analytics-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 75 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,333] INFO [ProducerStateManager partition=Kafka-Game-Analytics-role-login-mv-changelog-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0/00000000000000000075.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,334] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,334] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/Kafka-Game-Analytics-role-login-mv-changelog-0, topic=Kafka-Game-Analytics-role-login-mv-changelog, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=75) with 1 segments in 20ms (87/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,334] DEBUG Loading log /home/kafka/data/kafka-logs/pcout-0 (kafka.log.LogManager) [2021-07-14 17:35:13,336] INFO [Log partition=pcout-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,337] INFO [Log partition=pcout-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,338] DEBUG Loaded index file /home/kafka/data/kafka-logs/pcout-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,338] DEBUG Truncated index /home/kafka/data/kafka-logs/pcout-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,338] DEBUG Index /home/kafka/data/kafka-logs/pcout-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,338] DEBUG Loaded index file /home/kafka/data/kafka-logs/pcout-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,338] DEBUG Truncated index /home/kafka/data/kafka-logs/pcout-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,338] DEBUG Index /home/kafka/data/kafka-logs/pcout-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,339] DEBUG Resized /home/kafka/data/kafka-logs/pcout-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,339] DEBUG Resized /home/kafka/data/kafka-logs/pcout-0/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,340] DEBUG Resized /home/kafka/data/kafka-logs/pcout-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,340] DEBUG Resized /home/kafka/data/kafka-logs/pcout-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,340] INFO [Log partition=pcout-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,341] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,344] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/pcout-0, topic=pcout, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 10ms (88/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,344] DEBUG Loading log /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0 (kafka.log.LogManager) [2021-07-14 17:35:13,345] INFO [Log partition=PageViewEventSink-process-applicationId-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 7153 (kafka.log.Log) [2021-07-14 17:35:13,345] INFO [Log partition=PageViewEventSink-process-applicationId-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 7153 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,345] INFO [ProducerStateManager partition=PageViewEventSink-process-applicationId-pcmv-repartition-0] Writing producer snapshot at offset 7153 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,348] DEBUG Loaded index file /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0/00000000000000007153.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 7153, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,348] DEBUG Truncated index /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0/00000000000000007153.index to 0 entries; position is now 0 and last offset is now 7153 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,348] DEBUG Index /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0/00000000000000007153.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,349] DEBUG Loaded index file /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0/00000000000000007153.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,7153), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,349] DEBUG Truncated index /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0/00000000000000007153.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,7153) (kafka.log.TimeIndex) [2021-07-14 17:35:13,349] DEBUG Index /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0/00000000000000007153.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,352] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0/00000000000000007153.index to 448, position is 448 and limit is 448 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,353] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0/00000000000000007153.timeindex to 672, position is 672 and limit is 672 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,353] INFO [ProducerStateManager partition=PageViewEventSink-process-applicationId-pcmv-repartition-0] Writing producer snapshot at offset 8729 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,354] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0/00000000000000007153.index to 10485760, position is 448 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,355] DEBUG Resized /home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0/00000000000000007153.timeindex to 10485756, position is 672 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,355] INFO [Log partition=PageViewEventSink-process-applicationId-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 8729 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,355] INFO [ProducerStateManager partition=PageViewEventSink-process-applicationId-pcmv-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0/00000000000000008729.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,356] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,356] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/PageViewEventSink-process-applicationId-pcmv-repartition-0, topic=PageViewEventSink-process-applicationId-pcmv-repartition, partition=0, highWatermark=7153, lastStableOffset=7153, logStartOffset=7153, logEndOffset=8729) with 1 segments in 12ms (89/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,357] DEBUG Loading log /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0 (kafka.log.LogManager) [2021-07-14 17:35:13,357] INFO [Log partition=Kafka-Game-Analytics-AppId-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,357] INFO [Log partition=Kafka-Game-Analytics-AppId-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,359] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,359] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,359] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,359] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,360] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,360] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,360] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,360] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,361] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,361] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,361] INFO [Log partition=Kafka-Game-Analytics-AppId-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,362] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,362] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-role-login-mv-changelog-0, topic=Kafka-Game-Analytics-AppId-role-login-mv-changelog, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 5ms (90/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,362] DEBUG Loading log /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0 (kafka.log.LogManager) [2021-07-14 17:35:13,363] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 486 (kafka.log.Log) [2021-07-14 17:35:13,363] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 486 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,364] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0] Writing producer snapshot at offset 486 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,365] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0/00000000000000000486.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 486, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,365] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0/00000000000000000486.index to 0 entries; position is now 0 and last offset is now 486 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,365] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0/00000000000000000486.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,366] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0/00000000000000000486.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,486), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,366] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0/00000000000000000486.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,486) (kafka.log.TimeIndex) [2021-07-14 17:35:13,366] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0/00000000000000000486.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,375] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0/00000000000000000486.index to 504, position is 504 and limit is 504 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,376] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0/00000000000000000486.timeindex to 768, position is 768 and limit is 768 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,376] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0] Writing producer snapshot at offset 2569 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,379] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0/00000000000000000486.index to 10485760, position is 504 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,379] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0/00000000000000000486.timeindex to 10485756, position is 768 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,380] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 2569 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,380] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0/00000000000000002569.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,383] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,383] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition-0, topic=GameAnalyticsStreamSink-process-applicationId-role-login-mv-repartition, partition=0, highWatermark=486, lastStableOffset=486, logStartOffset=486, logEndOffset=2569) with 1 segments in 21ms (91/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,383] DEBUG Loading log /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0 (kafka.log.LogManager) [2021-07-14 17:35:13,384] INFO [Log partition=Kafka-Game-Analytics-AppId-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,384] INFO [Log partition=Kafka-Game-Analytics-AppId-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,387] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000000000.index with maxEntries = 29, maxIndexSize = 10485760, entries = 29, lastOffset = 4471, file position = 232 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,387] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,393] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,393] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000000000.timeindex with maxEntries = 29, maxIndexSize = 10485760, entries = 29, lastOffset = TimestampOffset(1620822605467,4471), file position = 348 (kafka.log.TimeIndex) [2021-07-14 17:35:13,393] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,393] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,394] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000000000.index to 232, position is 232 and limit is 232 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,394] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000000000.timeindex to 348, position is 348 and limit is 348 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,394] INFO [ProducerStateManager partition=Kafka-Game-Analytics-AppId-pcmv-repartition-0] Writing producer snapshot at offset 4472 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,395] INFO [Log partition=Kafka-Game-Analytics-AppId-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 4472 (kafka.log.Log) [2021-07-14 17:35:13,395] INFO [Log partition=Kafka-Game-Analytics-AppId-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 4472 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,395] INFO [ProducerStateManager partition=Kafka-Game-Analytics-AppId-pcmv-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000004472.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,396] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000004472.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 4472, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,397] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000004472.index to 0 entries; position is now 0 and last offset is now 4472 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,397] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000004472.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,397] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000004472.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,4472), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,397] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000004472.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,4472) (kafka.log.TimeIndex) [2021-07-14 17:35:13,397] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000004472.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,399] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000004472.index to 640, position is 640 and limit is 640 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,399] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000004472.timeindex to 132, position is 132 and limit is 132 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,399] INFO [ProducerStateManager partition=Kafka-Game-Analytics-AppId-pcmv-repartition-0] Writing producer snapshot at offset 16260 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,400] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000004472.index to 10485760, position is 640 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,401] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000004472.timeindex to 10485756, position is 132 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,402] DEBUG [LeaderEpochCache Kafka-Game-Analytics-AppId-pcmv-repartition-0] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:13,402] INFO [Log partition=Kafka-Game-Analytics-AppId-pcmv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 16260 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,402] INFO [ProducerStateManager partition=Kafka-Game-Analytics-AppId-pcmv-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0/00000000000000016260.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,403] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,403] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-repartition-0, topic=Kafka-Game-Analytics-AppId-pcmv-repartition, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=16260) with 2 segments in 20ms (92/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,403] DEBUG Loading log /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0 (kafka.log.LogManager) [2021-07-14 17:35:13,405] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,406] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,406] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000000.index with maxEntries = 0, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,406] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,406] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,407] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000000.timeindex with maxEntries = 1, maxIndexSize = 10485760, entries = 1, lastOffset = TimestampOffset(1621477732182,141), file position = 12 (kafka.log.TimeIndex) [2021-07-14 17:35:13,407] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,407] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,407] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,407] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,408] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0] Writing producer snapshot at offset 142 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,411] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 142 (kafka.log.Log) [2021-07-14 17:35:13,411] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 142 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,411] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000142.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,412] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000142.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 142, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,412] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000142.index to 0 entries; position is now 0 and last offset is now 142 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,412] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000142.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,413] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000142.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,142), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,413] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000142.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,142) (kafka.log.TimeIndex) [2021-07-14 17:35:13,413] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000142.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,414] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000142.index to 32, position is 32 and limit is 32 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,414] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000142.timeindex to 48, position is 48 and limit is 48 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,414] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0] Writing producer snapshot at offset 919 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,417] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000142.index to 10485760, position is 32 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,417] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000142.timeindex to 10485756, position is 48 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,418] DEBUG [LeaderEpochCache GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:13,418] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 919 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,419] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0/00000000000000000919.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,420] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,420] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0, topic=GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=919) with 2 segments in 17ms (93/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,420] DEBUG Loading log /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0 (kafka.log.LogManager) [2021-07-14 17:35:13,421] INFO [Log partition=Kafka-Game-Analytics-AppId-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,421] INFO [Log partition=Kafka-Game-Analytics-AppId-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,422] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,422] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,422] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,423] DEBUG Loaded index file /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,423] DEBUG Truncated index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,423] DEBUG Index /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,423] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,424] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0/00000000000000000000.timeindex to 12, position is 12 and limit is 12 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,424] INFO [ProducerStateManager partition=Kafka-Game-Analytics-AppId-pcmv-changelog-0] Writing producer snapshot at offset 16 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,424] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,438] DEBUG Resized /home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0/00000000000000000000.timeindex to 10485756, position is 12 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,440] DEBUG [LeaderEpochCache Kafka-Game-Analytics-AppId-pcmv-changelog-0] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:13,440] INFO [Log partition=Kafka-Game-Analytics-AppId-pcmv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 16 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,440] INFO [ProducerStateManager partition=Kafka-Game-Analytics-AppId-pcmv-changelog-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0/00000000000000000016.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,441] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,441] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/Kafka-Game-Analytics-AppId-pcmv-changelog-0, topic=Kafka-Game-Analytics-AppId-pcmv-changelog, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=16) with 1 segments in 21ms (94/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,441] DEBUG Loading log /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0 (kafka.log.LogManager) [2021-07-14 17:35:13,442] INFO [Log partition=GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,442] INFO [Log partition=GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,443] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,443] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,443] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,444] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,444] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,444] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,444] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0/00000000000000000000.index to 24, position is 24 and limit is 24 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,445] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0/00000000000000000000.timeindex to 48, position is 48 and limit is 48 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,445] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0] Writing producer snapshot at offset 483 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,447] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0/00000000000000000000.index to 10485760, position is 24 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,448] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0/00000000000000000000.timeindex to 10485756, position is 48 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,450] DEBUG [LeaderEpochCache GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0] Cleared entries ArrayBuffer(EpochEntry(epoch=0, startOffset=0)) and rewrote first entry EpochEntry(epoch=0, startOffset=0) after truncating to start offset 0, leaving 1 in the cache. (kafka.server.epoch.LeaderEpochFileCache) [2021-07-14 17:35:13,450] INFO [Log partition=GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 483 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,450] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0/00000000000000000483.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,451] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,451] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition-0, topic=GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-repartition, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=483) with 1 segments in 10ms (95/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,451] DEBUG Loading log /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0 (kafka.log.LogManager) [2021-07-14 17:35:13,452] INFO [Log partition=GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,452] INFO [Log partition=GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,453] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,453] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,453] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,454] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,454] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,454] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,454] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,455] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,455] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,455] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,455] INFO [Log partition=GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,457] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,457] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0, topic=GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 6ms (96/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,457] DEBUG Loading log /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0 (kafka.log.LogManager) [2021-07-14 17:35:13,458] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,458] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,484] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,484] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,484] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,485] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,485] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,485] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,485] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,486] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,486] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,486] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,486] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,487] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,487] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition-0, topic=GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-repartition, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 30ms (97/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,488] DEBUG Loading log /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0 (kafka.log.LogManager) [2021-07-14 17:35:13,489] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,489] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,490] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,490] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,490] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,491] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,491] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,491] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,491] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0/00000000000000000000.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,492] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0/00000000000000000000.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,492] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0/00000000000000000000.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,492] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0/00000000000000000000.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,493] INFO [Log partition=GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,494] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,494] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0, topic=GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=0) with 1 segments in 6ms (98/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,494] DEBUG Loading log /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0 (kafka.log.LogManager) [2021-07-14 17:35:13,495] INFO [Log partition=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 0 (kafka.log.Log) [2021-07-14 17:35:13,495] INFO [Log partition=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 0 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,497] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 0, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,497] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0/00000000000000000000.index to 0 entries; position is now 0 and last offset is now 0 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,497] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0/00000000000000000000.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,498] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0/00000000000000000000.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,0), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,498] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0/00000000000000000000.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,0) (kafka.log.TimeIndex) [2021-07-14 17:35:13,498] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0/00000000000000000000.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,499] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0/00000000000000000000.index to 40, position is 40 and limit is 40 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,499] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0/00000000000000000000.timeindex to 72, position is 72 and limit is 72 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,500] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0] Writing producer snapshot at offset 70 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,501] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0/00000000000000000000.index to 10485760, position is 40 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,501] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0/00000000000000000000.timeindex to 10485756, position is 72 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,501] INFO [Log partition=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 70 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,502] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0] Loading producer state from snapshot file '/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0/00000000000000000070.snapshot' (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,503] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,503] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition-0, topic=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-repartition, partition=0, highWatermark=0, lastStableOffset=0, logStartOffset=0, logEndOffset=70) with 1 segments in 9ms (99/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,504] DEBUG Loading log /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0 (kafka.log.LogManager) [2021-07-14 17:35:13,505] INFO [Log partition=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 63 (kafka.log.Log) [2021-07-14 17:35:13,505] INFO [Log partition=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 63 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,505] INFO [ProducerStateManager partition=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0] Writing producer snapshot at offset 63 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,506] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0/00000000000000000063.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 63, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,506] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0/00000000000000000063.index to 0 entries; position is now 0 and last offset is now 63 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,506] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0/00000000000000000063.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,507] DEBUG Loaded index file /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0/00000000000000000063.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,63), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,507] DEBUG Truncated index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0/00000000000000000063.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,63) (kafka.log.TimeIndex) [2021-07-14 17:35:13,507] DEBUG Index /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0/00000000000000000063.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,507] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0/00000000000000000063.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,508] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0/00000000000000000063.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,508] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0/00000000000000000063.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,508] DEBUG Resized /home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0/00000000000000000063.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,508] INFO [Log partition=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 63 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,509] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,510] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0, topic=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog, partition=0, highWatermark=63, lastStableOffset=63, logStartOffset=63, logEndOffset=63) with 1 segments in 5ms (100/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,510] DEBUG Loading log /home/kafka/data/kafka-logs/game.state.recharge-0 (kafka.log.LogManager) [2021-07-14 17:35:13,511] INFO [Log partition=game.state.recharge-0, dir=/home/kafka/data/kafka-logs] Recovering unflushed segment 63 (kafka.log.Log) [2021-07-14 17:35:13,511] INFO [Log partition=game.state.recharge-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 63 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,511] INFO [ProducerStateManager partition=game.state.recharge-0] Writing producer snapshot at offset 63 (kafka.log.ProducerStateManager) [2021-07-14 17:35:13,512] DEBUG Loaded index file /home/kafka/data/kafka-logs/game.state.recharge-0/00000000000000000063.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 1310720, lastOffset = 63, file position = 10485760 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,512] DEBUG Truncated index /home/kafka/data/kafka-logs/game.state.recharge-0/00000000000000000063.index to 0 entries; position is now 0 and last offset is now 63 (kafka.log.OffsetIndex) [2021-07-14 17:35:13,512] DEBUG Index /home/kafka/data/kafka-logs/game.state.recharge-0/00000000000000000063.index was not resized because it already has size 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,513] DEBUG Loaded index file /home/kafka/data/kafka-logs/game.state.recharge-0/00000000000000000063.timeindex with maxEntries = 873813, maxIndexSize = 10485760, entries = 873813, lastOffset = TimestampOffset(0,63), file position = 10485756 (kafka.log.TimeIndex) [2021-07-14 17:35:13,513] DEBUG Truncated index /home/kafka/data/kafka-logs/game.state.recharge-0/00000000000000000063.timeindex to 0 entries; position is now 0 and last entry is now TimestampOffset(-1,63) (kafka.log.TimeIndex) [2021-07-14 17:35:13,513] DEBUG Index /home/kafka/data/kafka-logs/game.state.recharge-0/00000000000000000063.timeindex was not resized because it already has size 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,513] DEBUG Resized /home/kafka/data/kafka-logs/game.state.recharge-0/00000000000000000063.index to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,514] DEBUG Resized /home/kafka/data/kafka-logs/game.state.recharge-0/00000000000000000063.timeindex to 0, position is 0 and limit is 0 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,514] DEBUG Resized /home/kafka/data/kafka-logs/game.state.recharge-0/00000000000000000063.index to 10485760, position is 0 and limit is 10485760 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,514] DEBUG Resized /home/kafka/data/kafka-logs/game.state.recharge-0/00000000000000000063.timeindex to 10485756, position is 0 and limit is 10485756 (kafka.log.AbstractIndex) [2021-07-14 17:35:13,514] INFO [Log partition=game.state.recharge-0, dir=/home/kafka/data/kafka-logs] Loading producer state till offset 63 with message format version 2 (kafka.log.Log) [2021-07-14 17:35:13,515] DEBUG Scheduling task PeriodicProducerExpirationCheck with initial delay 600000 ms and period 600000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,515] INFO Completed load of Log(dir=/home/kafka/data/kafka-logs/game.state.recharge-0, topic=game.state.recharge, partition=0, highWatermark=63, lastStableOffset=63, logStartOffset=63, logEndOffset=63) with 1 segments in 5ms (101/101 loaded in /home/kafka/data/kafka-logs) (kafka.log.LogManager) [2021-07-14 17:35:13,522] INFO Loaded 101 logs in 2512ms. (kafka.log.LogManager) [2021-07-14 17:35:13,559] INFO Starting log cleanup with a period of 300000 ms. (kafka.log.LogManager) [2021-07-14 17:35:13,559] DEBUG Scheduling task kafka-log-retention with initial delay 30000 ms and period 300000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,560] INFO Starting log flusher with a default period of 9223372036854775807 ms. (kafka.log.LogManager) [2021-07-14 17:35:13,560] DEBUG Scheduling task kafka-log-flusher with initial delay 30000 ms and period 9223372036854775807 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,560] DEBUG Scheduling task kafka-recovery-point-checkpoint with initial delay 30000 ms and period 60000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,561] DEBUG Scheduling task kafka-log-start-offset-checkpoint with initial delay 30000 ms and period 60000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,561] DEBUG Scheduling task kafka-delete-logs with initial delay 30000 ms and period -1 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:13,698] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-13. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,706] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-46. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,710] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-21. Last clean offset=Some(6) now=1626255313649 => firstDirtyOffset=6 firstUncleanableOffset=6 activeSegment.baseOffset=6 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,710] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-30. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,711] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-5. Last clean offset=Some(12426) now=1626255313649 => firstDirtyOffset=12426 firstUncleanableOffset=12426 activeSegment.baseOffset=12426 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,711] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-38. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,711] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-45. Last clean offset=Some(3) now=1626255313649 => firstDirtyOffset=3 firstUncleanableOffset=3 activeSegment.baseOffset=3 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,712] DEBUG Finding range of cleanable offsets for log=Kafka-Game-Analytics-AppId-role-login-mv-changelog-0. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,712] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-12. Last clean offset=Some(3) now=1626255313649 => firstDirtyOffset=3 firstUncleanableOffset=3 activeSegment.baseOffset=3 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,713] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-20. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,713] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-29. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,713] DEBUG Finding range of cleanable offsets for log=GameAnalyticsStreamSink-rechargeProcess-applicationId-recharge-mv-changelog-0. Last clean offset=None now=1626255313649 => firstDirtyOffset=63 firstUncleanableOffset=63 activeSegment.baseOffset=63 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,714] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-37. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,714] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-4. Last clean offset=Some(82) now=1626255313649 => firstDirtyOffset=82 firstUncleanableOffset=85 activeSegment.baseOffset=85 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,715] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-15. Last clean offset=Some(422) now=1626255313649 => firstDirtyOffset=422 firstUncleanableOffset=422 activeSegment.baseOffset=422 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,724] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-48. Last clean offset=Some(186) now=1626255313649 => firstDirtyOffset=186 firstUncleanableOffset=190 activeSegment.baseOffset=190 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,725] DEBUG Finding range of cleanable offsets for log=PageViewEventSink-process-applicationId-pcmv-changelog-0. Last clean offset=Some(707) now=1626255313649 => firstDirtyOffset=707 firstUncleanableOffset=707 activeSegment.baseOffset=707 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,725] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-23. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=Kafka-Game-Analytics-pcmv-changelog-0. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-32. Last clean offset=Some(42) now=1626255313649 => firstDirtyOffset=42 firstUncleanableOffset=42 activeSegment.baseOffset=42 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=GameAnalyticsStreamSink-process-applicationId-role-login-mv-changelog-0. Last clean offset=Some(142) now=1626255313649 => firstDirtyOffset=142 firstUncleanableOffset=142 activeSegment.baseOffset=142 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-7. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-40. Last clean offset=Some(49) now=1626255313649 => firstDirtyOffset=49 firstUncleanableOffset=49 activeSegment.baseOffset=49 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=GameAnalyticsStreamSink-readProcess-applicationId-role-login-mv-changelog-0. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-47. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-14. Last clean offset=Some(36198) now=1626255313649 => firstDirtyOffset=36198 firstUncleanableOffset=36198 activeSegment.baseOffset=36198 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=analytics-pvin-pcmv-changelog-0. Last clean offset=Some(9718) now=1626255313649 => firstDirtyOffset=9718 firstUncleanableOffset=9718 activeSegment.baseOffset=9718 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-22. Last clean offset=Some(6) now=1626255313649 => firstDirtyOffset=6 firstUncleanableOffset=6 activeSegment.baseOffset=6 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-31. Last clean offset=Some(554) now=1626255313649 => firstDirtyOffset=554 firstUncleanableOffset=554 activeSegment.baseOffset=554 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,726] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-39. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,727] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-6. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,727] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-9. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,727] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-42. Last clean offset=Some(21) now=1626255313649 => firstDirtyOffset=21 firstUncleanableOffset=21 activeSegment.baseOffset=21 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,727] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-17. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,727] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-26. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,727] DEBUG Finding range of cleanable offsets for log=GameAnalyticsStreamSink-process-applicationId-KSTREAM-AGGREGATE-STATE-STORE-0000000003-changelog-0. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,727] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-1. Last clean offset=Some(40) now=1626255313649 => firstDirtyOffset=40 firstUncleanableOffset=40 activeSegment.baseOffset=40 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,727] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-34. Last clean offset=Some(19) now=1626255313649 => firstDirtyOffset=19 firstUncleanableOffset=19 activeSegment.baseOffset=19 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,727] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-16. Last clean offset=Some(368) now=1626255313649 => firstDirtyOffset=368 firstUncleanableOffset=368 activeSegment.baseOffset=368 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,727] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-41. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,730] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-24. Last clean offset=Some(1752) now=1626255313649 => firstDirtyOffset=1752 firstUncleanableOffset=1752 activeSegment.baseOffset=1752 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,730] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-49. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,730] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-0. Last clean offset=Some(142) now=1626255313649 => firstDirtyOffset=142 firstUncleanableOffset=142 activeSegment.baseOffset=142 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,730] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-25. Last clean offset=Some(58) now=1626255313649 => firstDirtyOffset=58 firstUncleanableOffset=58 activeSegment.baseOffset=58 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,730] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-8. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,730] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-33. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,730] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-11. Last clean offset=Some(43) now=1626255313649 => firstDirtyOffset=43 firstUncleanableOffset=43 activeSegment.baseOffset=43 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,730] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-44. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,730] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-19. Last clean offset=Some(103) now=1626255313649 => firstDirtyOffset=103 firstUncleanableOffset=105 activeSegment.baseOffset=105 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,731] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-28. Last clean offset=Some(26187) now=1626255313649 => firstDirtyOffset=26187 firstUncleanableOffset=26187 activeSegment.baseOffset=26187 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,731] DEBUG Finding range of cleanable offsets for log=Kafka-Game-Analytics-AppId-pcmv-changelog-0. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,731] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-3. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,731] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-36. Last clean offset=Some(21) now=1626255313649 => firstDirtyOffset=21 firstUncleanableOffset=21 activeSegment.baseOffset=21 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,731] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-43. Last clean offset=Some(3) now=1626255313649 => firstDirtyOffset=3 firstUncleanableOffset=3 activeSegment.baseOffset=3 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,731] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-10. Last clean offset=Some(3) now=1626255313649 => firstDirtyOffset=3 firstUncleanableOffset=3 activeSegment.baseOffset=3 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,732] DEBUG Finding range of cleanable offsets for log=Kafka-Game-Analytics-role-login-mv-changelog-0. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,732] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-18. Last clean offset=Some(6) now=1626255313649 => firstDirtyOffset=6 firstUncleanableOffset=6 activeSegment.baseOffset=6 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,732] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-27. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,732] DEBUG Finding range of cleanable offsets for log=wordcount-application-counts-store-changelog-0. Last clean offset=Some(10996) now=1626255313649 => firstDirtyOffset=10996 firstUncleanableOffset=10996 activeSegment.baseOffset=10996 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,732] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-35. Last clean offset=Some(52) now=1626255313649 => firstDirtyOffset=52 firstUncleanableOffset=52 activeSegment.baseOffset=52 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:13,732] DEBUG Finding range of cleanable offsets for log=__consumer_offsets-2. Last clean offset=None now=1626255313649 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 (kafka.log.LogCleanerManager$) [2021-07-14 17:35:14,073] INFO Awaiting socket connections on 0.0.0.0:9092. (kafka.network.Acceptor) [2021-07-14 17:35:14,119] INFO [SocketServer brokerId=0] Created data-plane acceptor and processors for endpoint : ListenerName(PLAINTEXT) (kafka.network.SocketServer) [2021-07-14 17:35:14,155] INFO [ExpirationReaper-0-Produce]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2021-07-14 17:35:14,155] INFO [ExpirationReaper-0-DeleteRecords]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2021-07-14 17:35:14,156] INFO [ExpirationReaper-0-ElectLeader]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2021-07-14 17:35:14,166] DEBUG Scheduling task isr-expiration with initial delay 0 ms and period 15000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:14,156] INFO [ExpirationReaper-0-Fetch]: Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper) [2021-07-14 17:35:14,166] DEBUG Scheduling task isr-change-propagation with initial delay 0 ms and period 2500 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:14,167] DEBUG Scheduling task shutdown-idle-replica-alter-log-dirs-thread with initial delay 0 ms and period 10000 ms. (kafka.utils.KafkaScheduler) [2021-07-14 17:35:14,171] INFO [LogDirFailureHandler]: Starting (kafka.server.ReplicaManager$LogDirFailureHandler) [2021-07-14 17:35:14,173] WARN [ReplicaManager broker=0] Stopping serving replicas in dir /home/kafka/data/kafka-logs (kafka.server.ReplicaManager) [2021-07-14 17:35:14,189] WARN [ReplicaManager broker=0] Broker 0 stopped fetcher for partitions and stopped moving logs for partitions because they are in the failed log directory /home/kafka/data/kafka-logs. (kafka.server.ReplicaManager) [2021-07-14 17:35:14,189] WARN Stopping serving logs in dir /home/kafka/data/kafka-logs (kafka.log.LogManager) [2021-07-14 17:35:14,192] ERROR Shutdown broker because all log dirs in /home/kafka/data/kafka-logs have failed (kafka.log.LogManager)