2017-06-30 23:00:30 INFO QuorumPeerConfig:316 - clientPortAddress is 0.0.0.0/0.0.0.0:52131 2017-06-30 23:00:30 INFO QuorumPeerConfig:320 - secureClientPort is not set 2017-06-30 23:00:30 INFO TestingZooKeeperMain:225 - Starting server 2017-06-30 23:00:30 DEBUG FileTxnSnapLog:84 - Opening datadir:/private/var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/1498860030371-0 snapDir:/private/var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/1498860030371-0 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:zookeeper.version=3.5.1-alpha-1693007, built on 07/28/2015 07:19 GMT 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:host.name=maclon0156 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:java.version=1.8.0_112 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:java.vendor=Oracle Corporation 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:java.class.path=/Users/pearcem/Library/Application Support/JetBrains/Toolbox/apps/IDEA-U/ch-0/163.10154.41/IntelliJ IDEA.app/Contents/lib/idea_rt.jar:/Users/pearcem/Library/Application Support/JetBrains/Toolbox/apps/IDEA-U/ch-0/163.10154.41/IntelliJ IDEA.app/Contents/plugins/junit/lib/junit-rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/tools.jar:/Users/pearcem/Documents/GitHub/kafka-tests/target/test-classes:/Users/pearcem/Documents/GitHub/kafka-tests/target/classes:/Users/pearcem/.m2/repository/org/apache/kafka/kafka-clients/0.10.2.1/kafka-clients-0.10.2.1.jar:/Users/pearcem/.m2/repository/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar:/Users/pearcem/.m2/repository/org/xerial/snappy/snappy-java/1.1.2.6/snappy-java-1.1.2.6.jar:/Users/pearcem/.m2/repository/org/slf4j/slf4j-api/1.7.21/slf4j-api-1.7.21.jar:/Users/pearcem/.m2/repository/com/github/charithe/kafka-junit/3.0.2/kafka-junit-3.0.2.jar:/Users/pearcem/.m2/repository/com/google/guava/guava/21.0/guava-21.0.jar:/Users/pearcem/.m2/repository/org/apache/curator/curator-test/3.3.0/curator-test-3.3.0.jar:/Users/pearcem/.m2/repository/org/apache/zookeeper/zookeeper/3.5.1-alpha/zookeeper-3.5.1-alpha.jar:/Users/pearcem/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/Users/pearcem/.m2/repository/log4j/log4j/1.2.16/log4j-1.2.16.jar:/Users/pearcem/.m2/repository/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar:/Users/pearcem/.m2/repository/net/java/dev/javacc/javacc/5.0/javacc-5.0.jar:/Users/pearcem/.m2/repository/org/apache/kafka/kafka_2.11/0.10.2.1/kafka_2.11-0.10.2.1.jar:/Users/pearcem/.m2/repository/net/sf/jopt-simple/jopt-simple/5.0.3/jopt-simple-5.0.3.jar:/Users/pearcem/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/Users/pearcem/.m2/repository/org/scala-lang/scala-library/2.11.8/scala-library-2.11.8.jar:/Users/pearcem/.m2/repository/org/slf4j/slf4j-log4j12/1.7.21/slf4j-log4j12-1.7.21.jar:/Users/pearcem/.m2/repository/com/101tec/zkclient/0.10/zkclient-0.10.jar:/Users/pearcem/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.4/scala-parser-combinators_2.11-1.0.4.jar:/Users/pearcem/.m2/repository/junit/junit/4.12/junit-4.12.jar:/Users/pearcem/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:java.library.path=/Users/pearcem/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:. 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:java.io.tmpdir=/var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/ 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:java.compiler= 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:os.name=Mac OS X 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:os.arch=x86_64 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:os.version=10.12.5 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:user.name=pearcem 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:user.home=/Users/pearcem 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:user.dir=/Users/pearcem/Documents/GitHub/kafka-tests 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:os.memory.free=226MB 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:os.memory.max=3641MB 2017-06-30 23:00:30 INFO ZooKeeperServer:109 - Server environment:os.memory.total=245MB 2017-06-30 23:00:30 INFO ZooKeeperServer:858 - minSessionTimeout set to 6000 2017-06-30 23:00:30 INFO ZooKeeperServer:867 - maxSessionTimeout set to 60000 2017-06-30 23:00:30 INFO ZooKeeperServer:156 - Created server with tickTime 3000 minSessionTimeout 6000 maxSessionTimeout 60000 datadir /private/var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/1498860030371-0/version-2 snapdir /private/var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/1498860030371-0/version-2 2017-06-30 23:00:30 INFO NIOServerCnxnFactory:673 - Configuring NIO connection handler with 10s sessionless connection timeout, 2 selector thread(s), 16 worker threads, and 64 kB direct buffers. 2017-06-30 23:00:30 INFO NIOServerCnxnFactory:686 - binding to port 0.0.0.0/0.0.0.0:52131 2017-06-30 23:00:30 INFO FileTxnSnapLog:298 - Snapshotting: 0x0 to /private/var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/1498860030371-0/version-2/snapshot.0 2017-06-30 23:00:30 INFO ContainerManager:64 - Using checkIntervalMs=60000 maxPerMinute=10000 2017-06-30 23:00:30 INFO KafkaConfig:180 - KafkaConfig values: advertised.host.name = null advertised.listeners = PLAINTEXT://localhost:52135 advertised.port = null authorizer.class.name = auto.create.topics.enable = true auto.leader.rebalance.enable = true background.threads = 10 broker.id = 1 broker.id.generation.enable = true broker.rack = null compression.type = producer connections.max.idle.ms = 600000 controlled.shutdown.enable = true controlled.shutdown.max.retries = 3 controlled.shutdown.retry.backoff.ms = 5000 controller.socket.timeout.ms = 30000 create.topic.policy.class.name = null default.replication.factor = 1 delete.topic.enable = false fetch.purgatory.purge.interval.requests = 1000 group.max.session.timeout.ms = 300000 group.min.session.timeout.ms = 100 host.name = inter.broker.listener.name = null inter.broker.protocol.version = 0.10.2-IV0 leader.imbalance.check.interval.seconds = 1 leader.imbalance.per.broker.percentage = 10 listener.security.protocol.map = SSL:SSL,SASL_PLAINTEXT:SASL_PLAINTEXT,TRACE:TRACE,SASL_SSL:SASL_SSL,PLAINTEXT:PLAINTEXT listeners = PLAINTEXT://0.0.0.0:52135 log.cleaner.backoff.ms = 15000 log.cleaner.dedupe.buffer.size = 134217728 log.cleaner.delete.retention.ms = 86400000 log.cleaner.enable = true log.cleaner.io.buffer.load.factor = 0.9 log.cleaner.io.buffer.size = 524288 log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308 log.cleaner.min.cleanable.ratio = 0.5 log.cleaner.min.compaction.lag.ms = 0 log.cleaner.threads = 1 log.cleanup.policy = [delete] log.dir = /tmp/kafka-logs log.dirs = /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832 log.flush.interval.messages = 9223372036854775807 log.flush.interval.ms = null log.flush.offset.checkpoint.interval.ms = 60000 log.flush.scheduler.interval.ms = 9223372036854775807 log.index.interval.bytes = 4096 log.index.size.max.bytes = 10485760 log.message.format.version = 0.10.2-IV0 log.message.timestamp.difference.max.ms = 9223372036854775807 log.message.timestamp.type = CreateTime log.preallocate = false log.retention.bytes = -1 log.retention.check.interval.ms = 300000 log.retention.hours = 168 log.retention.minutes = null log.retention.ms = null log.roll.hours = 168 log.roll.jitter.hours = 0 log.roll.jitter.ms = null log.roll.ms = null log.segment.bytes = 1073741824 log.segment.delete.delay.ms = 60000 max.connections.per.ip = 2147483647 max.connections.per.ip.overrides = message.max.bytes = 1000012 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 min.insync.replicas = 1 num.io.threads = 8 num.network.threads = 3 num.partitions = 1 num.recovery.threads.per.data.dir = 1 num.replica.fetchers = 1 offset.metadata.max.bytes = 4096 offsets.commit.required.acks = -1 offsets.commit.timeout.ms = 5000 offsets.load.buffer.size = 5242880 offsets.retention.check.interval.ms = 600000 offsets.retention.minutes = 1440 offsets.topic.compression.codec = 0 offsets.topic.num.partitions = 1 offsets.topic.replication.factor = 1 offsets.topic.segment.bytes = 104857600 port = 52135 principal.builder.class = class org.apache.kafka.common.security.auth.DefaultPrincipalBuilder producer.purgatory.purge.interval.requests = 1000 queued.max.requests = 500 quota.consumer.default = 9223372036854775807 quota.producer.default = 9223372036854775807 quota.window.num = 11 quota.window.size.seconds = 1 replica.fetch.backoff.ms = 1000 replica.fetch.max.bytes = 1048576 replica.fetch.min.bytes = 1 replica.fetch.response.max.bytes = 10485760 replica.fetch.wait.max.ms = 500 replica.high.watermark.checkpoint.interval.ms = 5000 replica.lag.time.max.ms = 10000 replica.socket.receive.buffer.bytes = 65536 replica.socket.timeout.ms = 30000 replication.quota.window.num = 11 replication.quota.window.size.seconds = 1 request.timeout.ms = 30000 reserved.broker.max.id = 1000 sasl.enabled.mechanisms = [GSSAPI] sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.principal.to.local.rules = [DEFAULT] sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.mechanism.inter.broker.protocol = GSSAPI security.inter.broker.protocol = PLAINTEXT socket.receive.buffer.bytes = 102400 socket.request.max.bytes = 104857600 socket.send.buffer.bytes = 102400 ssl.cipher.suites = null ssl.client.auth = none ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS unclean.leader.election.enable = true zookeeper.connect = 127.0.0.1:52131 zookeeper.connection.timeout.ms = null zookeeper.session.timeout.ms = 6000 zookeeper.set.acl = false zookeeper.sync.time.ms = 2000 2017-06-30 23:00:30 INFO EphemeralKafkaBroker:134 - Starting Kafka server with config: {offsets.topic.replication.factor=1, advertised.listeners=PLAINTEXT://localhost:52135, default.replication.factor=1, offsets.topic.num.partitions=1, port=52135, log.dirs=/var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832, group.min.session.timeout.ms=100, zookeeper.connect=127.0.0.1:52131, leader.imbalance.check.interval.seconds=1, broker.id=1, num.partitions=1, listeners=PLAINTEXT://0.0.0.0:52135} 2017-06-30 23:00:31 INFO KafkaServer:70 - starting 2017-06-30 23:00:31 DEBUG KafkaScheduler:54 - Initializing task scheduler. 2017-06-30 23:00:31 INFO KafkaServer:70 - Connecting to zookeeper on 127.0.0.1:52131 2017-06-30 23:00:31 DEBUG ZkConnection:69 - Creating new ZookKeeper instance to connect to 127.0.0.1:52131. 2017-06-30 23:00:31 INFO ZkEventThread:65 - Starting ZkClient event thread. 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:zookeeper.version=3.5.1-alpha-1693007, built on 07/28/2015 07:19 GMT 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:host.name=maclon0156 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:java.version=1.8.0_112 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:java.vendor=Oracle Corporation 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:java.class.path=/Users/pearcem/Library/Application Support/JetBrains/Toolbox/apps/IDEA-U/ch-0/163.10154.41/IntelliJ IDEA.app/Contents/lib/idea_rt.jar:/Users/pearcem/Library/Application Support/JetBrains/Toolbox/apps/IDEA-U/ch-0/163.10154.41/IntelliJ IDEA.app/Contents/plugins/junit/lib/junit-rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/deploy.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/jfxrt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/javaws.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/jfr.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/jfxswt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/plugin.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/ant-javafx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/javafx-mx.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/packager.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/jdk1.8.0_112.jdk/Contents/Home/lib/tools.jar:/Users/pearcem/Documents/GitHub/kafka-tests/target/test-classes:/Users/pearcem/Documents/GitHub/kafka-tests/target/classes:/Users/pearcem/.m2/repository/org/apache/kafka/kafka-clients/0.10.2.1/kafka-clients-0.10.2.1.jar:/Users/pearcem/.m2/repository/net/jpountz/lz4/lz4/1.3.0/lz4-1.3.0.jar:/Users/pearcem/.m2/repository/org/xerial/snappy/snappy-java/1.1.2.6/snappy-java-1.1.2.6.jar:/Users/pearcem/.m2/repository/org/slf4j/slf4j-api/1.7.21/slf4j-api-1.7.21.jar:/Users/pearcem/.m2/repository/com/github/charithe/kafka-junit/3.0.2/kafka-junit-3.0.2.jar:/Users/pearcem/.m2/repository/com/google/guava/guava/21.0/guava-21.0.jar:/Users/pearcem/.m2/repository/org/apache/curator/curator-test/3.3.0/curator-test-3.3.0.jar:/Users/pearcem/.m2/repository/org/apache/zookeeper/zookeeper/3.5.1-alpha/zookeeper-3.5.1-alpha.jar:/Users/pearcem/.m2/repository/commons-cli/commons-cli/1.2/commons-cli-1.2.jar:/Users/pearcem/.m2/repository/log4j/log4j/1.2.16/log4j-1.2.16.jar:/Users/pearcem/.m2/repository/io/netty/netty/3.7.0.Final/netty-3.7.0.Final.jar:/Users/pearcem/.m2/repository/net/java/dev/javacc/javacc/5.0/javacc-5.0.jar:/Users/pearcem/.m2/repository/org/apache/kafka/kafka_2.11/0.10.2.1/kafka_2.11-0.10.2.1.jar:/Users/pearcem/.m2/repository/net/sf/jopt-simple/jopt-simple/5.0.3/jopt-simple-5.0.3.jar:/Users/pearcem/.m2/repository/com/yammer/metrics/metrics-core/2.2.0/metrics-core-2.2.0.jar:/Users/pearcem/.m2/repository/org/scala-lang/scala-library/2.11.8/scala-library-2.11.8.jar:/Users/pearcem/.m2/repository/org/slf4j/slf4j-log4j12/1.7.21/slf4j-log4j12-1.7.21.jar:/Users/pearcem/.m2/repository/com/101tec/zkclient/0.10/zkclient-0.10.jar:/Users/pearcem/.m2/repository/org/scala-lang/modules/scala-parser-combinators_2.11/1.0.4/scala-parser-combinators_2.11-1.0.4.jar:/Users/pearcem/.m2/repository/junit/junit/4.12/junit-4.12.jar:/Users/pearcem/.m2/repository/org/hamcrest/hamcrest-core/1.3/hamcrest-core-1.3.jar 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:java.library.path=/Users/pearcem/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:. 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:java.io.tmpdir=/var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/ 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:java.compiler= 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:os.name=Mac OS X 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:os.arch=x86_64 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:os.version=10.12.5 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:user.name=pearcem 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:user.home=/Users/pearcem 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:user.dir=/Users/pearcem/Documents/GitHub/kafka-tests 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:os.memory.free=185MB 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:os.memory.max=3641MB 2017-06-30 23:00:31 INFO ZooKeeper:109 - Client environment:os.memory.total=245MB 2017-06-30 23:00:31 INFO ZooKeeper:716 - Initiating client connection, connectString=127.0.0.1:52131 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@397e3eb 2017-06-30 23:00:31 DEBUG ClientCnxn:124 - zookeeper.disableAutoWatchReset is false 2017-06-30 23:00:31 DEBUG ZkClient:1230 - Awaiting connection to Zookeeper server 2017-06-30 23:00:31 INFO ZkClient:936 - Waiting for keeper state SyncConnected 2017-06-30 23:00:31 INFO ClientCnxn:1138 - Opening socket connection to server 127.0.0.1/127.0.0.1:52131. Will not attempt to authenticate using SASL (unknown error) 2017-06-30 23:00:31 INFO ClientCnxn:980 - Socket connection established, initiating session, client: /127.0.0.1:52137, server: 127.0.0.1/127.0.0.1:52131 2017-06-30 23:00:31 INFO NIOServerCnxnFactory:296 - Accepted socket connection from /127.0.0.1:52137 2017-06-30 23:00:31 DEBUG ClientCnxn:1048 - Session establishment request sent on 127.0.0.1/127.0.0.1:52131 2017-06-30 23:00:31 DEBUG ZooKeeperServer:914 - Session establishment request from client /127.0.0.1:52137 client's lastZxid is 0x0 2017-06-30 23:00:31 INFO ZooKeeperServer:964 - Client attempting to establish new session at /127.0.0.1:52137 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:269 - Adding session 0x10000f6eb680000 2017-06-30 23:00:31 TRACE SessionTrackerImpl:71 - SessionTrackerImpl --- Adding session 0x10000f6eb680000 6000 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:createSession cxid:0x0 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:31 TRACE SessionTrackerImpl:71 - SessionTrackerImpl --- Existing session 0x10000f6eb680000 6000 2017-06-30 23:00:31 INFO FileTxnLog:200 - Creating new log file: log.1 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:createSession cxid:0x0 zxid:0x1 txntype:-10 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:createSession cxid:0x0 zxid:0x1 txntype:-10 reqpath:n/a 2017-06-30 23:00:31 TRACE SessionTrackerImpl:71 - SessionTrackerImpl --- Existing session 0x10000f6eb680000 6000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:createSession cxid:0x0 zxid:0x1 txntype:-10 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 INFO ZooKeeperServer:678 - Established session 0x10000f6eb680000 with negotiated timeout 6000 for client /127.0.0.1:52137 2017-06-30 23:00:31 TRACE ClientCnxnSocket:128 - readConnectResult 37 0x[0,0,0,0,0,0,17,70,1,0,0,fffffff6,ffffffeb,68,0,0,0,0,0,10,2a,6a,ffffffd9,ffffff8c,6f,21,41,65,18,ffffffc2,19,5d,ffffffd0,7c,1b,1c,0,] 2017-06-30 23:00:31 INFO ClientCnxn:1400 - Session establishment complete on server 127.0.0.1/127.0.0.1:52131, sessionid = 0x10000f6eb680000, negotiated timeout = 6000 2017-06-30 23:00:31 DEBUG ZkClient:615 - Received event: WatchedEvent state:SyncConnected type:None path:null 2017-06-30 23:00:31 INFO ZkClient:713 - zookeeper state changed (SyncConnected) 2017-06-30 23:00:31 DEBUG ZkClient:659 - Leaving process event 2017-06-30 23:00:31 DEBUG ZkClient:950 - State is SyncConnected 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:/consumers 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:/consumers 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:/consumers 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x1 zxid:0xfffffffffffffffe txntype:unknown reqpath:/consumers 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 1,3 replyHeader:: 1,1,-101 request:: '/consumers,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:/ 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:/ 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:/ 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x2 zxid:0xfffffffffffffffe txntype:unknown reqpath:/ 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 2,3 replyHeader:: 2,1,0 request:: '/,F response:: s{0,0,0,0,0,-1,0,0,0,1,0} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x3 zxid:0xfffffffffffffffe txntype:unknown reqpath:/consumers 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x3 zxid:0x2 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x3 zxid:0x2 txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x3 zxid:0x2 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 3,1 replyHeader:: 3,2,0 request:: '/consumers,,v{s{31,s{'world,'anyone}}},0 response:: '/consumers 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x4 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 4,3 replyHeader:: 4,2,-101 request:: '/brokers/ids,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x5 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x5 zxid:0x3 txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode = NoNode for /brokers 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x5 zxid:0x3 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x5 zxid:0x3 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 5,1 replyHeader:: 5,3,-101 request:: '/brokers/ids,,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x6 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x6 zxid:0x4 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x6 zxid:0x4 txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x6 zxid:0x4 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 6,1 replyHeader:: 6,4,0 request:: '/brokers,,v{s{31,s{'world,'anyone}}},0 response:: '/brokers 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x7 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x7 zxid:0x5 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x7 zxid:0x5 txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x7 zxid:0x5 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 7,1 replyHeader:: 7,5,0 request:: '/brokers/ids,,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/ids 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x8 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 8,3 replyHeader:: 8,5,-101 request:: '/brokers/topics,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x9 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x9 zxid:0x6 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x9 zxid:0x6 txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x9 zxid:0x6 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 9,1 replyHeader:: 9,6,0 request:: '/brokers/topics,,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0xa zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 10,3 replyHeader:: 10,6,-101 request:: '/config/changes,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0xb zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0xb zxid:0x7 txntype:-1 reqpath:n/a Error Path:/config Error:KeeperErrorCode = NoNode for /config 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0xb zxid:0x7 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0xb zxid:0x7 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 11,1 replyHeader:: 11,7,-101 request:: '/config/changes,,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0xc zxid:0xfffffffffffffffe txntype:unknown reqpath:/config 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0xc zxid:0x8 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0xc zxid:0x8 txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0xc zxid:0x8 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 12,1 replyHeader:: 12,8,0 request:: '/config,,v{s{31,s{'world,'anyone}}},0 response:: '/config 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0xd zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0xd zxid:0x9 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0xd zxid:0x9 txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0xd zxid:0x9 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 13,1 replyHeader:: 13,9,0 request:: '/config/changes,,v{s{31,s{'world,'anyone}}},0 response:: '/config/changes 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0xe zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 14,3 replyHeader:: 14,9,-101 request:: '/config/topics,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0xf zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0xf zxid:0xa txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0xf zxid:0xa txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0xf zxid:0xa txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 15,1 replyHeader:: 15,10,0 request:: '/config/topics,,v{s{31,s{'world,'anyone}}},0 response:: '/config/topics 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/clients 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/clients 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/clients 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x10 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/clients 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 16,3 replyHeader:: 16,10,-101 request:: '/config/clients,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x11 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/clients 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x11 zxid:0xb txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x11 zxid:0xb txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x11 zxid:0xb txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 17,1 replyHeader:: 17,11,0 request:: '/config/clients,,v{s{31,s{'world,'anyone}}},0 response:: '/config/clients 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x12 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x12 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x12 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x12 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 18,3 replyHeader:: 18,11,-101 request:: '/admin/delete_topics,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x13 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x13 zxid:0xc txntype:-1 reqpath:n/a Error Path:/admin Error:KeeperErrorCode = NoNode for /admin 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x13 zxid:0xc txntype:-1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x13 zxid:0xc txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 19,1 replyHeader:: 19,12,-101 request:: '/admin/delete_topics,,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x14 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x14 zxid:0xd txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x14 zxid:0xd txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x14 zxid:0xd txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 20,1 replyHeader:: 20,13,0 request:: '/admin,,v{s{31,s{'world,'anyone}}},0 response:: '/admin 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x15 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x15 zxid:0xe txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x15 zxid:0xe txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x15 zxid:0xe txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 21,1 replyHeader:: 21,14,0 request:: '/admin/delete_topics,,v{s{31,s{'world,'anyone}}},0 response:: '/admin/delete_topics 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x16 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/seqid 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x16 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/seqid 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x16 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/seqid 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x16 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/seqid 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 22,3 replyHeader:: 22,14,-101 request:: '/brokers/seqid,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x17 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/seqid 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x17 zxid:0xf txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x17 zxid:0xf txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x17 zxid:0xf txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 23,1 replyHeader:: 23,15,0 request:: '/brokers/seqid,,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/seqid 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x18 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 24,3 replyHeader:: 24,15,-101 request:: '/isr_change_notification,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x19 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x19 zxid:0x10 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x19 zxid:0x10 txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x19 zxid:0x10 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 25,1 replyHeader:: 25,16,0 request:: '/isr_change_notification,,v{s{31,s{'world,'anyone}}},0 response:: '/isr_change_notification 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x1a zxid:0xfffffffffffffffe txntype:unknown reqpath:/cluster/id 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x1a zxid:0xfffffffffffffffe txntype:unknown reqpath:/cluster/id 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x1a zxid:0xfffffffffffffffe txntype:unknown reqpath:/cluster/id 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x1a zxid:0xfffffffffffffffe txntype:unknown reqpath:/cluster/id 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 26,4 replyHeader:: 26,16,-101 request:: '/cluster/id,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x1b zxid:0xfffffffffffffffe txntype:unknown reqpath:/cluster/id 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x1b zxid:0x11 txntype:-1 reqpath:n/a Error Path:/cluster Error:KeeperErrorCode = NoNode for /cluster 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x1b zxid:0x11 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x1b zxid:0x11 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 27,1 replyHeader:: 27,17,-101 request:: '/cluster/id,#7b2276657273696f6e223a2231222c226964223a224c787332506c314953364b5a38497963323447554f67227d,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x1c zxid:0xfffffffffffffffe txntype:unknown reqpath:/cluster 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x1c zxid:0x12 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x1c zxid:0x12 txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x1c zxid:0x12 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 28,1 replyHeader:: 28,18,0 request:: '/cluster,,v{s{31,s{'world,'anyone}}},0 response:: '/cluster 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x1d zxid:0xfffffffffffffffe txntype:unknown reqpath:/cluster/id 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x1d zxid:0x13 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x1d zxid:0x13 txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x1d zxid:0x13 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 29,1 replyHeader:: 29,19,0 request:: '/cluster/id,#7b2276657273696f6e223a2231222c226964223a224c787332506c314953364b5a38497963323447554f67227d,v{s{31,s{'world,'anyone}}},0 response:: '/cluster/id 2017-06-30 23:00:31 INFO KafkaServer:70 - Cluster ID = Lxs2Pl1IS6KZ8Iyc24GUOg 2017-06-30 23:00:31 WARN BrokerMetadataCheckpoint:85 - No meta.properties file under dir /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/meta.properties 2017-06-30 23:00:31 INFO ClientQuotaManager$ThrottledRequestReaper:70 - [ThrottledRequestReaper-Fetch], Starting 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name Fetch-delayQueue 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name Produce-delayQueue 2017-06-30 23:00:31 INFO ClientQuotaManager$ThrottledRequestReaper:70 - [ThrottledRequestReaper-Produce], Starting 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x1e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x1e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x1e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x1e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 30,8 replyHeader:: 30,19,0 request:: '/brokers/topics,F response:: v{} 2017-06-30 23:00:31 TRACE FileLock:36 - Acquiring lock on /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/.lock 2017-06-30 23:00:31 INFO LogManager:70 - Loading logs. 2017-06-30 23:00:31 INFO LogManager:70 - Logs loading complete in 5 ms. 2017-06-30 23:00:31 INFO LogManager:70 - Starting log cleanup with a period of 300000 ms. 2017-06-30 23:00:31 DEBUG KafkaScheduler:54 - Scheduling task kafka-log-retention with initial delay 30000 ms and period 300000 ms. 2017-06-30 23:00:31 INFO LogManager:70 - Starting log flusher with a default period of 9223372036854775807 ms. 2017-06-30 23:00:31 DEBUG KafkaScheduler:54 - Scheduling task kafka-log-flusher with initial delay 30000 ms and period 9223372036854775807 ms. 2017-06-30 23:00:31 DEBUG KafkaScheduler:54 - Scheduling task kafka-recovery-point-checkpoint with initial delay 30000 ms and period 60000 ms. 2017-06-30 23:00:31 DEBUG KafkaScheduler:54 - Scheduling task kafka-delete-logs with initial delay 30000 ms and period 60000 ms. 2017-06-30 23:00:31 INFO LogCleaner:70 - Starting the log cleaner 2017-06-30 23:00:31 INFO LogCleaner:70 - [kafka-log-cleaner-thread-0], Starting 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-closed:networkProcessor-0 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-created:networkProcessor-0 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent-received:networkProcessor-0 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent:networkProcessor-0 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-received:networkProcessor-0 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name select-time:networkProcessor-0 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name io-time:networkProcessor-0 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-closed:networkProcessor-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-created:networkProcessor-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent-received:networkProcessor-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent:networkProcessor-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-received:networkProcessor-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name select-time:networkProcessor-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name io-time:networkProcessor-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-closed:networkProcessor-2 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-created:networkProcessor-2 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent-received:networkProcessor-2 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent:networkProcessor-2 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-received:networkProcessor-2 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name select-time:networkProcessor-2 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name io-time:networkProcessor-2 2017-06-30 23:00:31 INFO Acceptor:70 - Awaiting socket connections on 0.0.0.0:52135. 2017-06-30 23:00:31 INFO SocketServer:70 - [Socket Server on Broker 1], Started 1 acceptor threads 2017-06-30 23:00:31 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Starting 2017-06-30 23:00:31 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Starting 2017-06-30 23:00:31 DEBUG KafkaScheduler:54 - Scheduling task isr-expiration with initial delay 0 ms and period 5000 ms. 2017-06-30 23:00:31 DEBUG KafkaScheduler:54 - Scheduling task isr-change-propagation with initial delay 0 ms and period 2500 ms. 2017-06-30 23:00:31 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:31 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:31 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Evaluating ISR list of partitions to see which replicas can be removed from the ISR 2017-06-30 23:00:31 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:31 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Controller starting up 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x1f zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x1f zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x1f zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x1f zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 31,3 replyHeader:: 31,19,-101 request:: '/controller,T response:: 2017-06-30 23:00:31 DEBUG ZkClient:196 - Subscribed data changes for /controller 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x20 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x20 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x20 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x20 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 32,4 replyHeader:: 32,19,-101 request:: '/controller,T response:: 2017-06-30 23:00:31 DEBUG ZKCheckedEphemeral:54 - Path: /controller, Prefix: /controller, Suffix: 2017-06-30 23:00:31 INFO ZKCheckedEphemeral:70 - Creating /controller (is it secure? false) 2017-06-30 23:00:31 DEBUG ZKCheckedEphemeral:54 - Path: /controller, Prefix: /controller, Suffix: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x21 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x21 zxid:0x14 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x21 zxid:0x14 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x21 zxid:0x14 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:867 - Got notification sessionid:0x10000f6eb680000 2017-06-30 23:00:31 DEBUG ClientCnxn:889 - Got WatchedEvent state:SyncConnected type:NodeCreated path:/controller for sessionid 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG ZkClient:615 - Received event: WatchedEvent state:SyncConnected type:NodeCreated path:/controller 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:/controller serverPath:/controller finished:false header:: 33,1 replyHeader:: 33,20,0 request:: '/controller,#7b2276657273696f6e223a312c2262726f6b65726964223a312c2274696d657374616d70223a2231343938383630303331353638227d,v{s{31,s{'world,'anyone}}},1 response:: '/controller 2017-06-30 23:00:31 DEBUG ZkEventThread:89 - New event: ZkEvent[Data of /controller changed sent to kafka.server.ZookeeperLeaderElector$LeaderChangeListener@502c8f54] 2017-06-30 23:00:31 DEBUG ZkClient:659 - Leaving process event 2017-06-30 23:00:31 DEBUG ZkEventThread:70 - Delivering event #1 ZkEvent[Data of /controller changed sent to kafka.server.ZookeeperLeaderElector$LeaderChangeListener@502c8f54] 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x22 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x22 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x22 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x22 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 34,3 replyHeader:: 34,20,0 request:: '/controller,T response:: s{20,20,1498860031573,1498860031573,0,0,0,72058654549344256,54,0,20} 2017-06-30 23:00:31 INFO ZKCheckedEphemeral:70 - Result of znode creation is: OK 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x23 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x23 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x23 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x23 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 INFO ZookeeperLeaderElector:70 - 1 successfully elected as leader 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Broker 1 starting become controller state transition 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 35,4 replyHeader:: 35,20,0 request:: '/controller,T response:: #7b2276657273696f6e223a312c2262726f6b65726964223a312c2274696d657374616d70223a2231343938383630303331353638227d,s{20,20,1498860031573,1498860031573,0,0,0,72058654549344256,54,0,20} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x24 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller_epoch 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x24 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller_epoch 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x24 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller_epoch 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x24 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller_epoch 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 36,3 replyHeader:: 36,20,-101 request:: '/controller_epoch,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:setData cxid:0x25 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller_epoch 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:setData cxid:0x25 zxid:0x15 txntype:-1 reqpath:n/a Error Path:/controller_epoch Error:KeeperErrorCode = NoNode for /controller_epoch 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:setData cxid:0x25 zxid:0x15 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:setData cxid:0x25 zxid:0x15 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 37,5 replyHeader:: 37,21,-101 request:: '/controller_epoch,#31,0 response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x26 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller_epoch 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x26 zxid:0x16 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x26 zxid:0x16 txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x26 zxid:0x16 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 38,1 replyHeader:: 38,22,0 request:: '/controller_epoch,#31,v{s{31,s{'world,'anyone}}},0 response:: '/controller_epoch 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Controller 1 incremented epoch to 1 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x27 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/reassign_partitions 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x27 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/reassign_partitions 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x27 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/reassign_partitions 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x27 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/reassign_partitions 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 39,3 replyHeader:: 39,22,-101 request:: '/admin/reassign_partitions,T response:: 2017-06-30 23:00:31 DEBUG ZkClient:196 - Subscribed data changes for /admin/reassign_partitions 2017-06-30 23:00:31 DEBUG KafkaController:54 - [Controller 1]: Registering IsrChangeNotificationListener 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x28 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x28 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x28 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x28 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 40,3 replyHeader:: 40,22,0 request:: '/isr_change_notification,T response:: s{16,16,1498860031243,1498860031243,0,0,0,0,0,0,16} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x29 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x29 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x29 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x29 zxid:0xfffffffffffffffe txntype:unknown reqpath:/isr_change_notification 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 41,8 replyHeader:: 41,22,0 request:: '/isr_change_notification,T response:: v{} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x2a zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/preferred_replica_election 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x2a zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/preferred_replica_election 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x2a zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/preferred_replica_election 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x2a zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/preferred_replica_election 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 42,3 replyHeader:: 42,22,-101 request:: '/admin/preferred_replica_election,T response:: 2017-06-30 23:00:31 DEBUG ZkClient:196 - Subscribed data changes for /admin/preferred_replica_election 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x2b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x2b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x2b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x2b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 43,3 replyHeader:: 43,22,0 request:: '/brokers/topics,T response:: s{6,6,1498860031196,1498860031196,0,0,0,0,0,0,6} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x2c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 44,8 replyHeader:: 44,22,0 request:: '/brokers/topics,T response:: v{} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x2d zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x2d zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x2d zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x2d zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 45,3 replyHeader:: 45,22,0 request:: '/admin/delete_topics,T response:: s{14,14,1498860031232,1498860031232,0,0,0,0,0,0,14} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x2e zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x2e zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x2e zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x2e zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 46,8 replyHeader:: 46,22,0 request:: '/admin/delete_topics,T response:: v{} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x2f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x2f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x2f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x2f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 47,3 replyHeader:: 47,22,0 request:: '/brokers/ids,T response:: s{5,5,1498860031189,1498860031189,0,0,0,0,0,0,5} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x30 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x30 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x30 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x30 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 48,8 replyHeader:: 48,22,0 request:: '/brokers/ids,T response:: v{} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x31 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x31 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x31 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x31 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 49,8 replyHeader:: 49,22,0 request:: '/brokers/ids,T response:: v{} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x32 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x32 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x32 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x32 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 50,8 replyHeader:: 50,22,0 request:: '/brokers/topics,T response:: v{} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x33 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/preferred_replica_election 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x33 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/preferred_replica_election 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x33 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/preferred_replica_election 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x33 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/preferred_replica_election 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 51,4 replyHeader:: 51,22,-101 request:: '/admin/preferred_replica_election,T response:: 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Partitions undergoing preferred replica election: 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Partitions that completed preferred replica election: 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Resuming preferred replica election for partitions: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x34 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/reassign_partitions 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x34 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/reassign_partitions 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x34 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/reassign_partitions 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x34 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/reassign_partitions 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 52,4 replyHeader:: 52,22,-101 request:: '/admin/reassign_partitions,T response:: 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Partitions being reassigned: Map() 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Partitions already reassigned: Set() 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Resuming reassignment of partitions: Map() 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x35 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x35 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x35 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x35 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/delete_topics 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 53,8 replyHeader:: 53,22,0 request:: '/admin/delete_topics,T response:: v{} 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: List of topics to be deleted: 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: List of topics ineligible for deletion: 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Currently active brokers in the cluster: Set() 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Currently shutting brokers in the cluster: Set() 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Current list of topics in the cluster: Set() 2017-06-30 23:00:31 INFO ReplicaStateMachine:70 - [Replica state machine on controller 1]: Started replica state machine with initial state -> Map() 2017-06-30 23:00:31 INFO PartitionStateMachine:70 - [Partition state machine on Controller 1]: Started partition state machine with initial state -> Map() 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Broker 1 is ready to serve as the new controller with epoch 1 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Starting preferred replica leader election for partitions 2017-06-30 23:00:31 INFO PartitionStateMachine:70 - [Partition state machine on Controller 1]: Invoking state change to OnlinePartition for partitions 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:delete cxid:0x36 zxid:0xfffffffffffffffe txntype:unknown reqpath:/admin/preferred_replica_election 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:delete cxid:0x36 zxid:0x17 txntype:-1 reqpath:n/a Error Path:/admin/preferred_replica_election Error:KeeperErrorCode = NoNode for /admin/preferred_replica_election 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:delete cxid:0x36 zxid:0x17 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:delete cxid:0x36 zxid:0x17 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 54,2 replyHeader:: 54,23,-101 request:: '/admin/preferred_replica_election,-1 response:: null 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: starting the partition rebalance scheduler 2017-06-30 23:00:31 DEBUG KafkaScheduler:54 - Initializing task scheduler. 2017-06-30 23:00:31 DEBUG KafkaScheduler:54 - Scheduling task partition-rebalance-thread with initial delay 5000 ms and period 1000 ms. 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: Controller startup complete 2017-06-30 23:00:31 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Starting 2017-06-30 23:00:31 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Starting 2017-06-30 23:00:31 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Starting 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x37 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x37 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x37 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x37 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 55,4 replyHeader:: 55,23,-101 request:: '/brokers/topics/__consumer_offsets,F response:: 2017-06-30 23:00:31 DEBUG ZkUtils:54 - Partition map for /brokers/topics/__consumer_offsets is Map() 2017-06-30 23:00:31 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Starting up. 2017-06-30 23:00:31 DEBUG KafkaScheduler:54 - Initializing task scheduler. 2017-06-30 23:00:31 DEBUG KafkaScheduler:54 - Scheduling task delete-expired-group-metadata with initial delay 0 ms and period 600000 ms. 2017-06-30 23:00:31 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'delete-expired-group-metadata'. 2017-06-30 23:00:31 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Startup complete. 2017-06-30 23:00:31 INFO GroupMetadataManager:70 - [Group Metadata Manager on Broker 1]: Removed 0 expired offsets in 1 milliseconds. 2017-06-30 23:00:31 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'delete-expired-group-metadata'. 2017-06-30 23:00:31 DEBUG Mx4jLoader$:54 - Will try to load MX4j now, if it's in the classpath 2017-06-30 23:00:31 INFO Mx4jLoader$:70 - Will not load MX4J, mx4j-tools.jar is not in the classpath 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x38 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x38 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x38 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x38 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 56,3 replyHeader:: 56,23,0 request:: '/config/changes,F response:: s{9,9,1498860031209,1498860031209,0,0,0,0,0,0,9} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x39 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x39 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x39 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x39 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 57,3 replyHeader:: 57,23,0 request:: '/config/changes,T response:: s{9,9,1498860031209,1498860031209,0,0,0,0,0,0,9} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x3a zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x3a zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x3a zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x3a zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 58,8 replyHeader:: 58,23,0 request:: '/config/changes,T response:: v{} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x3b zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x3b zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x3b zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x3b zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/changes 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 59,8 replyHeader:: 59,23,0 request:: '/config/changes,T response:: v{} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x3c zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x3c zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x3c zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x3c zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 60,8 replyHeader:: 60,23,0 request:: '/config/topics,F response:: v{} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x3d zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/clients 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x3d zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/clients 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x3d zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/clients 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x3d zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/clients 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 61,8 replyHeader:: 61,23,0 request:: '/config/clients,F response:: v{} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x3e zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/users 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x3e zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/users 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x3e zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/users 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x3e zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/users 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 62,8 replyHeader:: 62,23,-101 request:: '/config/users,F response:: v{} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x3f zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/users 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x3f zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/users 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x3f zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/users 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x3f zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/users 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 63,8 replyHeader:: 63,23,-101 request:: '/config/users,F response:: v{} 2017-06-30 23:00:31 INFO ZookeeperLeaderElector$LeaderChangeListener:70 - New leader is 1 2017-06-30 23:00:31 DEBUG ZkEventThread:80 - Delivering event #1 done 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x40 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/brokers 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x40 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/brokers 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x40 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/brokers 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x40 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/brokers 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 64,8 replyHeader:: 64,23,-101 request:: '/config/brokers,F response:: v{} 2017-06-30 23:00:31 DEBUG ZKCheckedEphemeral:54 - Path: /brokers/ids/1, Prefix: /brokers, Suffix: /ids/1 2017-06-30 23:00:31 INFO ZKCheckedEphemeral:70 - Creating /brokers/ids/1 (is it secure? false) 2017-06-30 23:00:31 DEBUG ZKCheckedEphemeral:54 - Path: /brokers/ids/1, Prefix: /brokers, Suffix: /ids/1 2017-06-30 23:00:31 DEBUG ZKCheckedEphemeral:54 - Path: /brokers/ids/1, Prefix: /brokers/ids, Suffix: /1 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x41 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG ZKCheckedEphemeral:54 - Path: /brokers/ids/1, Prefix: /brokers/ids/1, Suffix: 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x41 zxid:0x18 txntype:-1 reqpath:n/a Error Path:/brokers Error:KeeperErrorCode = NodeExists for /brokers 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x42 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x41 zxid:0x18 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x41 zxid:0x18 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -110 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x42 zxid:0x19 txntype:-1 reqpath:n/a Error Path:/brokers/ids Error:KeeperErrorCode = NodeExists for /brokers/ids 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x43 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x42 zxid:0x19 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:/brokers serverPath:/brokers finished:false header:: 65,1 replyHeader:: 65,24,-110 request:: '/brokers,,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x42 zxid:0x19 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -110 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x43 zxid:0x1a txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x43 zxid:0x1a txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:/brokers/ids serverPath:/brokers/ids finished:false header:: 66,1 replyHeader:: 66,25,-110 request:: '/brokers/ids,,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x43 zxid:0x1a txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:867 - Got notification sessionid:0x10000f6eb680000 2017-06-30 23:00:31 DEBUG ClientCnxn:889 - Got WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/ids for sessionid 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG ZkClient:615 - Received event: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/ids 2017-06-30 23:00:31 DEBUG ZkEventThread:89 - New event: ZkEvent[Children of /brokers/ids changed sent to kafka.controller.ReplicaStateMachine$BrokerChangeListener@44d4ede9] 2017-06-30 23:00:31 DEBUG ZkClient:659 - Leaving process event 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:/brokers/ids/1 serverPath:/brokers/ids/1 finished:false header:: 67,1 replyHeader:: 67,26,0 request:: '/brokers/ids/1,#7b226c697374656e65725f73656375726974795f70726f746f636f6c5f6d6170223a7b22504c41494e54455854223a22504c41494e54455854227d2c22656e64706f696e7473223a5b22504c41494e544558543a2f2f6c6f63616c686f73743a3532313335225d2c226a6d785f706f7274223a2d312c22686f7374223a226c6f63616c686f7374222c2274696d657374616d70223a2231343938383630303331383130222c22706f7274223a35323133352c2276657273696f6e223a347d,v{s{31,s{'world,'anyone}}},1 response:: '/brokers/ids/1 2017-06-30 23:00:31 DEBUG ZkEventThread:70 - Delivering event #2 ZkEvent[Children of /brokers/ids changed sent to kafka.controller.ReplicaStateMachine$BrokerChangeListener@44d4ede9] 2017-06-30 23:00:31 INFO ZKCheckedEphemeral:70 - Result of znode creation is: OK 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x44 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x44 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x44 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x44 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 INFO ZkUtils:70 - Registered broker 1 at path /brokers/ids/1 with addresses: EndPoint(localhost,52135,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 68,3 replyHeader:: 68,26,0 request:: '/brokers/ids,T response:: s{5,5,1498860031189,1498860031189,0,1,0,0,0,1,26} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x45 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 WARN BrokerMetadataCheckpoint:85 - No meta.properties file under dir /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/meta.properties 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x45 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x45 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x45 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 69,8 replyHeader:: 69,26,0 request:: '/brokers/ids,T response:: v{'1} 2017-06-30 23:00:31 INFO ReplicaStateMachine$BrokerChangeListener:70 - [BrokerChangeListener on Controller 1]: Broker change listener fired for path /brokers/ids with children 1 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x46 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x46 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x46 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x46 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 70,4 replyHeader:: 70,26,0 request:: '/brokers/ids/1,F response:: #7b226c697374656e65725f73656375726974795f70726f746f636f6c5f6d6170223a7b22504c41494e54455854223a22504c41494e54455854227d2c22656e64706f696e7473223a5b22504c41494e544558543a2f2f6c6f63616c686f73743a3532313335225d2c226a6d785f706f7274223a2d312c22686f7374223a226c6f63616c686f7374222c2274696d657374616d70223a2231343938383630303331383130222c22706f7274223a35323133352c2276657273696f6e223a347d,s{26,26,1498860031814,1498860031814,0,0,0,72058654549344256,190,0,26} 2017-06-30 23:00:31 INFO ReplicaStateMachine$BrokerChangeListener:70 - [BrokerChangeListener on Controller 1]: Newly added brokers: 1, deleted brokers: , all live brokers: 1 2017-06-30 23:00:31 DEBUG ControllerChannelManager:54 - [Channel manager on controller 1]: Controller 1 trying to connect to broker 1 2017-06-30 23:00:31 INFO AppInfoParser:83 - Kafka version : 0.10.2.1 2017-06-30 23:00:31 INFO AppInfoParser:84 - Kafka commitId : e89bffd6b2eff799 2017-06-30 23:00:31 INFO KafkaServer:70 - [Kafka Server 1], started 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-closed:broker-id-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-created:broker-id-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent-received:broker-id-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent:broker-id-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-received:broker-id-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name select-time:broker-id-1 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name io-time:broker-id-1 2017-06-30 23:00:31 INFO RequestSendThread:70 - [Controller-1-to-broker-1-send-thread], Starting 2017-06-30 23:00:31 INFO KafkaController:70 - [Controller 1]: New broker startup callback for 1 2017-06-30 23:00:31 INFO ProducerConfig:180 - ProducerConfig values: acks = 1 batch.size = 16384 block.on.buffer.full = false bootstrap.servers = [localhost:52135] buffer.memory = 33554432 client.id = compression.type = none connections.max.idle.ms = 540000 interceptor.classes = null key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer linger.ms = 0 max.block.ms = 60000 max.in.flight.requests.per.connection = 5 max.request.size = 1048576 metadata.fetch.timeout.ms = 60000 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.sample.window.ms = 30000 partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner receive.buffer.bytes = 32768 reconnect.backoff.ms = 50 request.timeout.ms = 30000 retries = 0 retry.backoff.ms = 100 sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS timeout.ms = 30000 value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer 2017-06-30 23:00:31 TRACE KafkaProducer:211 - Starting the Kafka producer 2017-06-30 23:00:31 DEBUG NetworkClient:627 - Initiating connection to node 1 at localhost:52135. 2017-06-30 23:00:31 DEBUG ZkEventThread:80 - Delivering event #2 done 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bufferpool-wait-time 2017-06-30 23:00:31 DEBUG Acceptor:54 - Accepted connection from /127.0.0.1:52138 on /127.0.0.1:52135 and assigned it to processor 0, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [375636|102400] 2017-06-30 23:00:31 DEBUG Selector:339 - Created socket with SO_RCVBUF = 408300, SO_SNDBUF = 146988, SO_TIMEOUT = 0 to node 1 2017-06-30 23:00:31 DEBUG NetworkClient:593 - Completed connection to node 1. Ready. 2017-06-30 23:00:31 DEBUG Processor:54 - Processor 0 listening to new connection from /127.0.0.1:52138 2017-06-30 23:00:31 INFO RequestSendThread:70 - [Controller-1-to-broker-1-send-thread], Controller 1 connected to localhost:52135 (id: 1 rack: null) for sending state change requests 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name buffer-exhausted-records 2017-06-30 23:00:31 DEBUG Metadata:249 - Updated cluster metadata version 1 to Cluster(id = null, nodes = [localhost:52135 (id: -1 rack: null)], partitions = []) 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-closed: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-created: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent-received: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-received: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name select-time: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name io-time: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name batch-size 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name compression-rate 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name queue-time 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name request-time 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name produce-throttle-time 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name records-per-request 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name record-retries 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name errors 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name record-size-max 2017-06-30 23:00:31 DEBUG Sender:121 - Starting Kafka producer I/O thread. 2017-06-30 23:00:31 TRACE NetworkClient:316 - Sending {controller_id=1,controller_epoch=1,partition_states=[],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} to node 1. 2017-06-30 23:00:31 WARN ProducerConfig:188 - The configuration 'enable.auto.commit' was supplied but isn't a known config. 2017-06-30 23:00:31 WARN ProducerConfig:188 - The configuration 'group.id' was supplied but isn't a known config. 2017-06-30 23:00:31 WARN ProducerConfig:188 - The configuration 'auto.offset.reset' was supplied but isn't a known config. 2017-06-30 23:00:31 INFO AppInfoParser:83 - Kafka version : 0.10.2.1 2017-06-30 23:00:31 INFO AppInfoParser:84 - Kafka commitId : e89bffd6b2eff799 2017-06-30 23:00:31 DEBUG KafkaProducer:336 - Kafka producer started 2017-06-30 23:00:31 INFO ConsumerConfig:180 - ConsumerConfig values: auto.commit.interval.ms = 5000 auto.offset.reset = latest bootstrap.servers = [localhost:52135] check.crcs = true client.id = connections.max.idle.ms = 540000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = test-group heartbeat.interval.ms = 3000 interceptor.classes = null key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.ms = 50 request.timeout.ms = 305000 retry.backoff.ms = 100 sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 session.timeout.ms = 10000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer 2017-06-30 23:00:31 INFO ConsumerConfig:180 - ConsumerConfig values: auto.commit.interval.ms = 5000 auto.offset.reset = latest bootstrap.servers = [localhost:52135] check.crcs = true client.id = connections.max.idle.ms = 540000 enable.auto.commit = false exclude.internal.topics = true fetch.max.bytes = 52428800 fetch.max.wait.ms = 500 fetch.min.bytes = 1 group.id = test-group heartbeat.interval.ms = 3000 interceptor.classes = null key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer max.partition.fetch.bytes = 1048576 max.poll.interval.ms = 300000 max.poll.records = 500 metadata.max.age.ms = 300000 metric.reporters = [] metrics.num.samples = 2 metrics.recording.level = INFO metrics.sample.window.ms = 30000 partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor] receive.buffer.bytes = 65536 reconnect.backoff.ms = 50 request.timeout.ms = 305000 retry.backoff.ms = 100 sasl.jaas.config = null sasl.kerberos.kinit.cmd = /usr/bin/kinit sasl.kerberos.min.time.before.relogin = 60000 sasl.kerberos.service.name = null sasl.kerberos.ticket.renew.jitter = 0.05 sasl.kerberos.ticket.renew.window.factor = 0.8 sasl.mechanism = GSSAPI security.protocol = PLAINTEXT send.buffer.bytes = 131072 session.timeout.ms = 10000 ssl.cipher.suites = null ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1] ssl.endpoint.identification.algorithm = null ssl.key.password = null ssl.keymanager.algorithm = SunX509 ssl.keystore.location = null ssl.keystore.password = null ssl.keystore.type = JKS ssl.protocol = TLS ssl.provider = null ssl.secure.random.implementation = null ssl.trustmanager.algorithm = PKIX ssl.truststore.location = null ssl.truststore.password = null ssl.truststore.type = JKS value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer 2017-06-30 23:00:31 DEBUG KafkaConsumer:607 - Starting the Kafka consumer 2017-06-30 23:00:31 DEBUG KafkaConsumer:607 - Starting the Kafka consumer 2017-06-30 23:00:31 DEBUG Metadata:249 - Updated cluster metadata version 1 to Cluster(id = null, nodes = [localhost:52135 (id: -1 rack: null)], partitions = []) 2017-06-30 23:00:31 DEBUG Metadata:249 - Updated cluster metadata version 1 to Cluster(id = null, nodes = [localhost:52135 (id: -1 rack: null)], partitions = []) 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-closed: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-closed: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-created: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name connections-created: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent-received: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent-received: 2017-06-30 23:00:31 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=0,api_version=2,correlation_id=0,client_id=} -- {acks=0,timeout=0,partitionSizes=[]} 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-sent: 2017-06-30 23:00:31 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=6,api_version=3,correlation_id=0,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-received: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-received: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name select-time: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name select-time: 2017-06-30 23:00:31 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52138,Session(User:ANONYMOUS,/127.0.0.1),null,1498860031890,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name io-time: 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name io-time: 2017-06-30 23:00:31 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=6,api_version=3,correlation_id=0,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} from connection 127.0.0.1:52135-127.0.0.1:52138;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name heartbeat-latency 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name heartbeat-latency 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name join-latency 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name join-latency 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name sync-latency 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name sync-latency 2017-06-30 23:00:31 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52138,Session(User:ANONYMOUS,/127.0.0.1),null,1498860031890,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@3065eafd,SendAction) 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name commit-latency 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name commit-latency 2017-06-30 23:00:31 TRACE NetworkClient:534 - Completed receive from node 1, for key 6, received {error_code=0} 2017-06-30 23:00:31 TRACE logger:36 - Controller 1 epoch 1 received response {error_code=0} for a request sent to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-fetched 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name bytes-fetched 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name records-fetched 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name records-fetched 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name fetch-latency 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name fetch-latency 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name records-lag 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name records-lag 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name fetch-throttle-time 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name fetch-throttle-time 2017-06-30 23:00:31 INFO AppInfoParser:83 - Kafka version : 0.10.2.1 2017-06-30 23:00:31 INFO AppInfoParser:84 - Kafka commitId : e89bffd6b2eff799 2017-06-30 23:00:31 INFO AppInfoParser:83 - Kafka version : 0.10.2.1 2017-06-30 23:00:31 INFO AppInfoParser:84 - Kafka commitId : e89bffd6b2eff799 2017-06-30 23:00:31 DEBUG KafkaConsumer:711 - Kafka consumer created 2017-06-30 23:00:31 DEBUG KafkaConsumer:711 - Kafka consumer created 2017-06-30 23:00:31 DEBUG KafkaConsumer:824 - Subscribed to topic(s): topic 2017-06-30 23:00:31 DEBUG KafkaConsumer:824 - Subscribed to topic(s): topic 2017-06-30 23:00:31 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:31 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:31 DEBUG AbstractCoordinator:561 - Sending GroupCoordinator request for group test-group to broker localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:31 DEBUG AbstractCoordinator:561 - Sending GroupCoordinator request for group test-group to broker localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:31 DEBUG NetworkClient:627 - Initiating connection to node -1 at localhost:52135. 2017-06-30 23:00:31 DEBUG NetworkClient:627 - Initiating connection to node -1 at localhost:52135. 2017-06-30 23:00:31 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:31 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name node--1.bytes-sent 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name node--1.bytes-sent 2017-06-30 23:00:31 DEBUG Acceptor:54 - Accepted connection from /127.0.0.1:52139 on /127.0.0.1:52135 and assigned it to processor 1, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [375636|102400] 2017-06-30 23:00:31 DEBUG Processor:54 - Processor 1 listening to new connection from /127.0.0.1:52139 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name node--1.bytes-received 2017-06-30 23:00:31 DEBUG Acceptor:54 - Accepted connection from /127.0.0.1:52140 on /127.0.0.1:52135 and assigned it to processor 2, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [375636|102400] 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name node--1.bytes-received 2017-06-30 23:00:31 DEBUG Processor:54 - Processor 2 listening to new connection from /127.0.0.1:52140 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name node--1.latency 2017-06-30 23:00:31 DEBUG Metrics:335 - Added sensor with name node--1.latency 2017-06-30 23:00:31 DEBUG Selector:339 - Created socket with SO_RCVBUF = 342972, SO_SNDBUF = 146988, SO_TIMEOUT = 0 to node -1 2017-06-30 23:00:31 DEBUG Selector:339 - Created socket with SO_RCVBUF = 342972, SO_SNDBUF = 146988, SO_TIMEOUT = 0 to node -1 2017-06-30 23:00:31 DEBUG NetworkClient:590 - Completed connection to node -1. Fetching API versions. 2017-06-30 23:00:31 DEBUG NetworkClient:590 - Completed connection to node -1. Fetching API versions. 2017-06-30 23:00:31 DEBUG NetworkClient:603 - Initiating API versions fetch from node -1. 2017-06-30 23:00:31 DEBUG NetworkClient:603 - Initiating API versions fetch from node -1. 2017-06-30 23:00:31 TRACE NetworkClient:292 - No version information found when sending message of type API_VERSIONS to node -1. Assuming version 0. 2017-06-30 23:00:31 TRACE NetworkClient:292 - No version information found when sending message of type API_VERSIONS to node -1. Assuming version 0. 2017-06-30 23:00:31 TRACE NetworkClient:316 - Sending {} to node -1. 2017-06-30 23:00:31 TRACE NetworkClient:316 - Sending {} to node -1. 2017-06-30 23:00:31 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:31 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:31 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:31 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:31 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=18,api_version=0,correlation_id=1,client_id=consumer-1} -- {} 2017-06-30 23:00:31 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=18,api_version=0,correlation_id=1,client_id=consumer-2} -- {} 2017-06-30 23:00:31 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52140,Session(User:ANONYMOUS,/127.0.0.1),null,1498860031920,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:31 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52139,Session(User:ANONYMOUS,/127.0.0.1),null,1498860031920,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:31 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=18,api_version=0,correlation_id=1,client_id=consumer-1} -- {} from connection 127.0.0.1:52135-127.0.0.1:52140;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:31 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=18,api_version=0,correlation_id=1,client_id=consumer-2} -- {} from connection 127.0.0.1:52135-127.0.0.1:52139;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:31 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52140,Session(User:ANONYMOUS,/127.0.0.1),null,1498860031920,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@10f7e967,SendAction) 2017-06-30 23:00:31 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52139,Session(User:ANONYMOUS,/127.0.0.1),null,1498860031920,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@3c25ec7b,SendAction) 2017-06-30 23:00:31 TRACE NetworkClient:534 - Completed receive from node -1, for key 18, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=2},{api_key=1,min_version=0,max_version=3},{api_key=2,min_version=0,max_version=1},{api_key=3,min_version=0,max_version=2},{api_key=4,min_version=0,max_version=0},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=3},{api_key=7,min_version=1,max_version=1},{api_key=8,min_version=0,max_version=2},{api_key=9,min_version=0,max_version=2},{api_key=10,min_version=0,max_version=0},{api_key=11,min_version=0,max_version=1},{api_key=12,min_version=0,max_version=0},{api_key=13,min_version=0,max_version=0},{api_key=14,min_version=0,max_version=0},{api_key=15,min_version=0,max_version=0},{api_key=16,min_version=0,max_version=0},{api_key=17,min_version=0,max_version=0},{api_key=18,min_version=0,max_version=0},{api_key=19,min_version=0,max_version=1},{api_key=20,min_version=0,max_version=0}]} 2017-06-30 23:00:31 TRACE NetworkClient:534 - Completed receive from node -1, for key 18, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=2},{api_key=1,min_version=0,max_version=3},{api_key=2,min_version=0,max_version=1},{api_key=3,min_version=0,max_version=2},{api_key=4,min_version=0,max_version=0},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=3},{api_key=7,min_version=1,max_version=1},{api_key=8,min_version=0,max_version=2},{api_key=9,min_version=0,max_version=2},{api_key=10,min_version=0,max_version=0},{api_key=11,min_version=0,max_version=1},{api_key=12,min_version=0,max_version=0},{api_key=13,min_version=0,max_version=0},{api_key=14,min_version=0,max_version=0},{api_key=15,min_version=0,max_version=0},{api_key=16,min_version=0,max_version=0},{api_key=17,min_version=0,max_version=0},{api_key=18,min_version=0,max_version=0},{api_key=19,min_version=0,max_version=1},{api_key=20,min_version=0,max_version=0}]} 2017-06-30 23:00:31 DEBUG NetworkClient:558 - Recorded API versions for node -1: (Produce(0): 0 to 2 [usable: 2], Fetch(1): 0 to 3 [usable: 3], Offsets(2): 0 to 1 [usable: 1], Metadata(3): 0 to 2 [usable: 2], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 2 [usable: 2], OffsetFetch(9): 0 to 2 [usable: 2], GroupCoordinator(10): 0 [usable: 0], JoinGroup(11): 0 to 1 [usable: 1], Heartbeat(12): 0 [usable: 0], LeaveGroup(13): 0 [usable: 0], SyncGroup(14): 0 [usable: 0], DescribeGroups(15): 0 [usable: 0], ListGroups(16): 0 [usable: 0], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 [usable: 0], CreateTopics(19): 0 to 1 [usable: 1], DeleteTopics(20): 0 [usable: 0]) 2017-06-30 23:00:31 DEBUG NetworkClient:558 - Recorded API versions for node -1: (Produce(0): 0 to 2 [usable: 2], Fetch(1): 0 to 3 [usable: 3], Offsets(2): 0 to 1 [usable: 1], Metadata(3): 0 to 2 [usable: 2], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 2 [usable: 2], OffsetFetch(9): 0 to 2 [usable: 2], GroupCoordinator(10): 0 [usable: 0], JoinGroup(11): 0 to 1 [usable: 1], Heartbeat(12): 0 [usable: 0], LeaveGroup(13): 0 [usable: 0], SyncGroup(14): 0 [usable: 0], DescribeGroups(15): 0 [usable: 0], ListGroups(16): 0 [usable: 0], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 [usable: 0], CreateTopics(19): 0 to 1 [usable: 1], DeleteTopics(20): 0 [usable: 0]) 2017-06-30 23:00:31 TRACE NetworkClient:430 - Found least loaded node localhost:52135 (id: -1 rack: null) connected with no in-flight requests 2017-06-30 23:00:31 TRACE NetworkClient:430 - Found least loaded node localhost:52135 (id: -1 rack: null) connected with no in-flight requests 2017-06-30 23:00:31 DEBUG NetworkClient:751 - Sending metadata request (type=MetadataRequest, topics=topic) to node -1 2017-06-30 23:00:31 DEBUG NetworkClient:751 - Sending metadata request (type=MetadataRequest, topics=topic) to node -1 2017-06-30 23:00:31 TRACE NetworkClient:316 - Sending {topics=[topic]} to node -1. 2017-06-30 23:00:31 TRACE NetworkClient:316 - Sending {topics=[topic]} to node -1. 2017-06-30 23:00:31 TRACE NetworkClient:316 - Sending {group_id=test-group} to node -1. 2017-06-30 23:00:31 TRACE NetworkClient:316 - Sending {group_id=test-group} to node -1. 2017-06-30 23:00:31 TRACE logger:157 - Completed request:{api_key=18,api_version=0,correlation_id=1,client_id=consumer-2} -- {} from connection 127.0.0.1:52135-127.0.0.1:52139;totalTime:2,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:31 TRACE logger:157 - Completed request:{api_key=18,api_version=0,correlation_id=1,client_id=consumer-1} -- {} from connection 127.0.0.1:52135-127.0.0.1:52140;totalTime:2,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:31 TRACE logger:157 - Completed request:{api_key=6,api_version=3,correlation_id=0,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} from connection 127.0.0.1:52135-127.0.0.1:52138;totalTime:17,requestQueueTime:3,localTime:13,remoteTime:0,responseQueueTime:1,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:31 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=3,api_version=2,correlation_id=2,client_id=consumer-1} -- {topics=[topic]} 2017-06-30 23:00:31 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=3,api_version=2,correlation_id=2,client_id=consumer-2} -- {topics=[topic]} 2017-06-30 23:00:31 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52140,Session(User:ANONYMOUS,/127.0.0.1),null,1498860031952,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:31 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52139,Session(User:ANONYMOUS,/127.0.0.1),null,1498860031952,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:31 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=3,api_version=2,correlation_id=2,client_id=consumer-1} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52140;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:31 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=3,api_version=2,correlation_id=2,client_id=consumer-2} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52139;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x47 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x48 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x47 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x47 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x47 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x48 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x48 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x48 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 71,8 replyHeader:: 71,26,0 request:: '/brokers/ids,T response:: v{'1} 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 72,8 replyHeader:: 72,26,0 request:: '/brokers/ids,T response:: v{'1} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x49 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x49 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x49 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x4a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x49 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x4a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x4a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x4a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 73,4 replyHeader:: 73,26,0 request:: '/brokers/ids/1,F response:: #7b226c697374656e65725f73656375726974795f70726f746f636f6c5f6d6170223a7b22504c41494e54455854223a22504c41494e54455854227d2c22656e64706f696e7473223a5b22504c41494e544558543a2f2f6c6f63616c686f73743a3532313335225d2c226a6d785f706f7274223a2d312c22686f7374223a226c6f63616c686f7374222c2274696d657374616d70223a2231343938383630303331383130222c22706f7274223a35323133352c2276657273696f6e223a347d,s{26,26,1498860031814,1498860031814,0,0,0,72058654549344256,190,0,26} 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 74,4 replyHeader:: 74,26,0 request:: '/brokers/ids/1,F response:: #7b226c697374656e65725f73656375726974795f70726f746f636f6c5f6d6170223a7b22504c41494e54455854223a22504c41494e54455854227d2c22656e64706f696e7473223a5b22504c41494e544558543a2f2f6c6f63616c686f73743a3532313335225d2c226a6d785f706f7274223a2d312c22686f7374223a226c6f63616c686f7374222c2274696d657374616d70223a2231343938383630303331383130222c22706f7274223a35323133352c2276657273696f6e223a347d,s{26,26,1498860031814,1498860031814,0,0,0,72058654549344256,190,0,26} 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x4b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x4b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x4b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x4b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 75,3 replyHeader:: 75,26,-101 request:: '/brokers/topics/topic,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x4c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x4c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x4c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x4c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 76,3 replyHeader:: 76,26,-101 request:: '/brokers/topics/topic,F response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:setData cxid:0x4d zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/topic 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:setData cxid:0x4d zxid:0x1b txntype:-1 reqpath:n/a Error Path:/config/topics/topic Error:KeeperErrorCode = NoNode for /config/topics/topic 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:setData cxid:0x4e zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/topic 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:setData cxid:0x4d zxid:0x1b txntype:-1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:setData cxid:0x4d zxid:0x1b txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:setData cxid:0x4e zxid:0x1c txntype:-1 reqpath:n/a Error Path:/config/topics/topic Error:KeeperErrorCode = NoNode for /config/topics/topic 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:setData cxid:0x4e zxid:0x1c txntype:-1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:setData cxid:0x4e zxid:0x1c txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 77,5 replyHeader:: 77,27,-101 request:: '/config/topics/topic,#7b2276657273696f6e223a312c22636f6e666967223a7b7d7d,-1 response:: 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 78,5 replyHeader:: 78,28,-101 request:: '/config/topics/topic,#7b2276657273696f6e223a312c22636f6e666967223a7b7d7d,-1 response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x4f zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x4f zxid:0x1d txntype:-1 reqpath:n/a Error Path:/config/topics Error:KeeperErrorCode = NodeExists for /config/topics 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x50 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x4f zxid:0x1d txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x4f zxid:0x1d txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -110 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x50 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/config/topics Error:KeeperErrorCode = NodeExists for /config/topics 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x50 zxid:0x1e txntype:-1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x50 zxid:0x1e txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 79,1 replyHeader:: 79,29,-110 request:: '/config/topics,,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -110 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 80,1 replyHeader:: 80,30,-110 request:: '/config/topics,,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x51 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/topic 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x52 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/topic 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x51 zxid:0x1f txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x51 zxid:0x1f txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x51 zxid:0x1f txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x52 zxid:0x20 txntype:-1 reqpath:n/a Error Path:/config/topics/topic Error:KeeperErrorCode = NodeExists for /config/topics/topic 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x52 zxid:0x20 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x52 zxid:0x20 txntype:-1 reqpath:n/a 2017-06-30 23:00:31 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -110 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 81,1 replyHeader:: 81,31,0 request:: '/config/topics/topic,#7b2276657273696f6e223a312c22636f6e666967223a7b7d7d,v{s{31,s{'world,'anyone}}},0 response:: '/config/topics/topic 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 82,1 replyHeader:: 82,32,-110 request:: '/config/topics/topic,#7b2276657273696f6e223a312c22636f6e666967223a7b7d7d,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:setData cxid:0x53 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/topic 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 2 2017-06-30 23:00:31 INFO AdminUtils$:70 - Topic creation {"version":1,"partitions":{"0":[1]}} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x54 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:setData cxid:0x53 zxid:0x21 txntype:5 reqpath:n/a 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:setData cxid:0x53 zxid:0x21 txntype:5 reqpath:n/a 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:setData cxid:0x53 zxid:0x21 txntype:5 reqpath:n/a 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x54 zxid:0x22 txntype:1 reqpath:n/a 2017-06-30 23:00:31 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x54 zxid:0x22 txntype:1 reqpath:n/a 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 83,5 replyHeader:: 83,33,0 request:: '/config/topics/topic,#7b2276657273696f6e223a312c22636f6e666967223a7b7d7d,-1 response:: s{31,33,1498860031992,1498860031995,1,0,0,0,25,0,31} 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x54 zxid:0x22 txntype:1 reqpath:n/a 2017-06-30 23:00:31 INFO AdminUtils$:70 - Topic creation {"version":1,"partitions":{"0":[1]}} 2017-06-30 23:00:31 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:31 DEBUG ClientCnxn:867 - Got notification sessionid:0x10000f6eb680000 2017-06-30 23:00:31 DEBUG ClientCnxn:889 - Got WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/topics for sessionid 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG ZkClient:615 - Received event: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/topics 2017-06-30 23:00:31 DEBUG ZkEventThread:89 - New event: ZkEvent[Children of /brokers/topics changed sent to kafka.controller.PartitionStateMachine$TopicChangeListener@488f317f] 2017-06-30 23:00:31 DEBUG ZkClient:659 - Leaving process event 2017-06-30 23:00:31 DEBUG ZkEventThread:70 - Delivering event #3 ZkEvent[Children of /brokers/topics changed sent to kafka.controller.PartitionStateMachine$TopicChangeListener@488f317f] 2017-06-30 23:00:31 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 84,1 replyHeader:: 84,34,0 request:: '/brokers/topics/topic,#7b2276657273696f6e223a312c22706172746974696f6e73223a7b2230223a5b315d7d7d,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics/topic 2017-06-30 23:00:31 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x55 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:31 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:31 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:31 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x55 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/brokers/topics/topic Error:KeeperErrorCode = NodeExists for /brokers/topics/topic 2017-06-30 23:00:32 DEBUG AdminUtils$:54 - Updated path /brokers/topics/topic with {"version":1,"partitions":{"0":[1]}} for replica assignment 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x56 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x55 zxid:0x23 txntype:-1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x55 zxid:0x23 txntype:-1 reqpath:n/a 2017-06-30 23:00:32 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -110 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 INFO KafkaApis:70 - [KafkaApi-1] Auto creation of topic topic with 1 partitions and replication factor 1 is successful 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x56 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x56 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x56 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 85,1 replyHeader:: 85,35,-110 request:: '/brokers/topics/topic,#7b2276657273696f6e223a312c22706172746974696f6e73223a7b2230223a5b315d7d7d,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 86,3 replyHeader:: 86,35,0 request:: '/brokers/topics,T response:: s{6,6,1498860031196,1498860031196,0,1,0,0,0,1,34} 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending topic metadata org.apache.kafka.common.requests.MetadataResponse$TopicMetadata@7982a789 and brokers 1 : (EndPoint(localhost,52135,ListenerName(PLAINTEXT),PLAINTEXT)) : null for correlation id 2 to client consumer-2 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending topic metadata org.apache.kafka.common.requests.MetadataResponse$TopicMetadata@79c05338 and brokers 1 : (EndPoint(localhost,52135,ListenerName(PLAINTEXT),PLAINTEXT)) : null for correlation id 2 to client consumer-1 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x57 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x57 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x57 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x57 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 87,8 replyHeader:: 87,35,0 request:: '/brokers/topics,T response:: v{'topic} 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52140,Session(User:ANONYMOUS,/127.0.0.1),null,1498860031952,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@55f5651d,SendAction) 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52139,Session(User:ANONYMOUS,/127.0.0.1),null,1498860031952,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2df24e63,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node -1, for key 3, received {brokers=[{node_id=1,host=localhost,port=52135,rack=null}],cluster_id=Lxs2Pl1IS6KZ8Iyc24GUOg,controller_id=1,topic_metadata=[{topic_error_code=5,topic=topic,is_internal=false,partition_metadata=[]}]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=3,api_version=2,correlation_id=2,client_id=consumer-2} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52139;totalTime:55,requestQueueTime:0,localTime:54,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=3,api_version=2,correlation_id=2,client_id=consumer-1} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52140;totalTime:55,requestQueueTime:0,localTime:54,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 DEBUG PartitionStateMachine$TopicChangeListener:54 - [TopicChangeListener on Controller 1]: Topic change listener fired for path /brokers/topics with children topic 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node -1, for key 3, received {brokers=[{node_id=1,host=localhost,port=52135,rack=null}],cluster_id=Lxs2Pl1IS6KZ8Iyc24GUOg,controller_id=1,topic_metadata=[{topic_error_code=5,topic=topic,is_internal=false,partition_metadata=[]}]} 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=10,api_version=0,correlation_id=0,client_id=consumer-1} -- {group_id=test-group} 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=10,api_version=0,correlation_id=0,client_id=consumer-2} -- {group_id=test-group} 2017-06-30 23:00:32 WARN NetworkClient:707 - Error while fetching metadata with correlation id 2 : {topic=LEADER_NOT_AVAILABLE} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52140,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032008,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 WARN NetworkClient:707 - Error while fetching metadata with correlation id 2 : {topic=LEADER_NOT_AVAILABLE} 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x58 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=10,api_version=0,correlation_id=0,client_id=consumer-1} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52140;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52139,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032008,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x58 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 DEBUG Metadata:249 - Updated cluster metadata version 2 to Cluster(id = Lxs2Pl1IS6KZ8Iyc24GUOg, nodes = [localhost:52135 (id: 1 rack: null)], partitions = []) 2017-06-30 23:00:32 DEBUG Metadata:249 - Updated cluster metadata version 2 to Cluster(id = Lxs2Pl1IS6KZ8Iyc24GUOg, nodes = [localhost:52135 (id: 1 rack: null)], partitions = []) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=10,api_version=0,correlation_id=0,client_id=consumer-2} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52139;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x58 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x58 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 88,4 replyHeader:: 88,35,0 request:: '/brokers/topics/topic,F response:: #7b2276657273696f6e223a312c22706172746974696f6e73223a7b2230223a5b315d7d7d,s{34,34,1498860031997,1498860031997,0,0,0,0,36,0,34} 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x59 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x59 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x59 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x59 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x5a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x5a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x5a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x5a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 89,8 replyHeader:: 89,35,0 request:: '/brokers/ids,T response:: v{'1} 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 90,8 replyHeader:: 90,35,0 request:: '/brokers/ids,T response:: v{'1} 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x5b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x5b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x5c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x5b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x5b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x5c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x5c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x5c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 91,4 replyHeader:: 91,35,0 request:: '/brokers/ids/1,F response:: #7b226c697374656e65725f73656375726974795f70726f746f636f6c5f6d6170223a7b22504c41494e54455854223a22504c41494e54455854227d2c22656e64706f696e7473223a5b22504c41494e544558543a2f2f6c6f63616c686f73743a3532313335225d2c226a6d785f706f7274223a2d312c22686f7374223a226c6f63616c686f7374222c2274696d657374616d70223a2231343938383630303331383130222c22706f7274223a35323133352c2276657273696f6e223a347d,s{26,26,1498860031814,1498860031814,0,0,0,72058654549344256,190,0,26} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ZkUtils:54 - Replicas assigned to topic [topic], partition [0] are [List(1)] 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 92,4 replyHeader:: 92,35,0 request:: '/brokers/ids/1,F response:: #7b226c697374656e65725f73656375726974795f70726f746f636f6c5f6d6170223a7b22504c41494e54455854223a22504c41494e54455854227d2c22656e64706f696e7473223a5b22504c41494e544558543a2f2f6c6f63616c686f73743a3532313335225d2c226a6d785f706f7274223a2d312c22686f7374223a226c6f63616c686f7374222c2274696d657374616d70223a2231343938383630303331383130222c22706f7274223a35323133352c2276657273696f6e223a347d,s{26,26,1498860031814,1498860031814,0,0,0,72058654549344256,190,0,26} 2017-06-30 23:00:32 INFO PartitionStateMachine$TopicChangeListener:70 - [TopicChangeListener on Controller 1]: New topics: [Set(topic)], deleted topics: [Set()], new partition replica assignment [Map([topic,0] -> List(1))] 2017-06-30 23:00:32 INFO KafkaController:70 - [Controller 1]: New topic creation callback for [topic,0] 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x5d zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x5d zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x5d zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x5d zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 93,3 replyHeader:: 93,35,0 request:: '/brokers/topics/topic,T response:: s{34,34,1498860031997,1498860031997,0,0,0,0,36,0,34} 2017-06-30 23:00:32 DEBUG ZkClient:196 - Subscribed data changes for /brokers/topics/topic 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x5e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x5e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x5e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 INFO KafkaController:70 - [Controller 1]: New partition creation callback for [topic,0] 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x5e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 INFO PartitionStateMachine:70 - [Partition state machine on Controller 1]: Invoking state change to NewPartition for partitions [topic,0] 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 94,3 replyHeader:: 94,35,-101 request:: '/brokers/topics/__consumer_offsets,F response:: 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x5f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x5f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x5f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x5f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 changed partition [topic,0] state from NonExistentPartition to NewPartition with assigned replicas 1 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 95,8 replyHeader:: 95,35,0 request:: '/brokers/topics,T response:: v{'topic} 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:setData cxid:0x60 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:setData cxid:0x60 zxid:0x24 txntype:-1 reqpath:n/a Error Path:/config/topics/__consumer_offsets Error:KeeperErrorCode = NoNode for /config/topics/__consumer_offsets 2017-06-30 23:00:32 INFO ReplicaStateMachine:70 - [Replica state machine on controller 1]: Invoking state change to NewReplica for replicas [Topic=topic,Partition=0,Replica=1] 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:setData cxid:0x60 zxid:0x24 txntype:-1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:setData cxid:0x60 zxid:0x24 txntype:-1 reqpath:n/a 2017-06-30 23:00:32 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x61 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x61 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x61 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x61 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 96,5 replyHeader:: 96,36,-101 request:: '/config/topics/__consumer_offsets,#7b2276657273696f6e223a312c22636f6e666967223a7b227365676d656e742e6279746573223a22313034383537363030222c22636f6d7072657373696f6e2e74797065223a2270726f6475636572222c22636c65616e75702e706f6c696379223a22636f6d70616374227d7d,-1 response:: 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 97,3 replyHeader:: 97,36,-101 request:: '/brokers/topics/__consumer_offsets,F response:: 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x62 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x62 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/config/topics Error:KeeperErrorCode = NodeExists for /config/topics 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x63 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x62 zxid:0x25 txntype:-1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x62 zxid:0x25 txntype:-1 reqpath:n/a 2017-06-30 23:00:32 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -110 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x64 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic/partitions/0/state 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x63 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x63 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x63 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 98,1 replyHeader:: 98,37,-110 request:: '/config/topics,,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x64 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic/partitions/0/state 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x64 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic/partitions/0/state 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x64 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic/partitions/0/state 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 99,8 replyHeader:: 99,37,0 request:: '/brokers/topics,T response:: v{'topic} 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x65 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 100,4 replyHeader:: 100,37,-101 request:: '/brokers/topics/topic/partitions/0/state,F response:: 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:setData cxid:0x66 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 2 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x65 zxid:0x26 txntype:1 reqpath:n/a 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x65 zxid:0x26 txntype:1 reqpath:n/a 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x65 zxid:0x26 txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 changed state of replica 1 for partition [topic,0] from NonExistentReplica to NewReplica 2017-06-30 23:00:32 INFO PartitionStateMachine:70 - [Partition state machine on Controller 1]: Invoking state change to OnlinePartition for partitions [topic,0] 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:setData cxid:0x66 zxid:0x27 txntype:5 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:setData cxid:0x66 zxid:0x27 txntype:5 reqpath:n/a 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 101,1 replyHeader:: 101,38,0 request:: '/config/topics/__consumer_offsets,#7b2276657273696f6e223a312c22636f6e666967223a7b227365676d656e742e6279746573223a22313034383537363030222c22636f6d7072657373696f6e2e74797065223a2270726f6475636572222c22636c65616e75702e706f6c696379223a22636f6d70616374227d7d,v{s{31,s{'world,'anyone}}},0 response:: '/config/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:setData cxid:0x66 zxid:0x27 txntype:5 reqpath:n/a 2017-06-30 23:00:32 INFO AdminUtils$:70 - Topic creation {"version":1,"partitions":{"0":[1]}} 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x67 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 102,5 replyHeader:: 102,39,0 request:: '/config/topics/__consumer_offsets,#7b2276657273696f6e223a312c22636f6e666967223a7b227365676d656e742e6279746573223a22313034383537363030222c22636f6d7072657373696f6e2e74797065223a2270726f6475636572222c22636c65616e75702e706f6c696379223a22636f6d70616374227d7d,-1 response:: s{38,39,1498860032032,1498860032033,1,0,0,0,109,0,38} 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 INFO AdminUtils$:70 - Topic creation {"version":1,"partitions":{"0":[1]}} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PartitionStateMachine:54 - [Partition state machine on Controller 1]: Live assigned replicas for partition [topic,0] are: [List(1)] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x68 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x67 zxid:0x28 txntype:1 reqpath:n/a 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x67 zxid:0x28 txntype:1 reqpath:n/a 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x67 zxid:0x28 txntype:1 reqpath:n/a 2017-06-30 23:00:32 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x68 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/brokers/topics/__consumer_offsets Error:KeeperErrorCode = NodeExists for /brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:867 - Got notification sessionid:0x10000f6eb680000 2017-06-30 23:00:32 DEBUG ClientCnxn:889 - Got WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/topics for sessionid 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG ZkClient:615 - Received event: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/topics 2017-06-30 23:00:32 DEBUG ZkEventThread:89 - New event: ZkEvent[Children of /brokers/topics changed sent to kafka.controller.PartitionStateMachine$TopicChangeListener@488f317f] 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x68 zxid:0x29 txntype:-1 reqpath:n/a 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 103,1 replyHeader:: 103,40,0 request:: '/brokers/topics/__consumer_offsets,#7b2276657273696f6e223a312c22706172746974696f6e73223a7b2230223a5b315d7d7d,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG ZkClient:659 - Leaving process event 2017-06-30 23:00:32 DEBUG AdminUtils$:54 - Updated path /brokers/topics/__consumer_offsets with {"version":1,"partitions":{"0":[1]}} for replica assignment 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x68 zxid:0x29 txntype:-1 reqpath:n/a 2017-06-30 23:00:32 INFO KafkaApis:70 - [KafkaApi-1] Auto creation of topic __consumer_offsets with 1 partitions and replication factor 1 is successful 2017-06-30 23:00:32 DEBUG PartitionStateMachine:54 - [Partition state machine on Controller 1]: Initializing leader and isr for partition [topic,0] to (Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1) 2017-06-30 23:00:32 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -110 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x69 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic/partitions/0/state 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending consumer metadata {error_code=15,coordinator={node_id=-1,host=,port=-1}} for correlation id 0 to client consumer-1. 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 104,1 replyHeader:: 104,41,-110 request:: '/brokers/topics/__consumer_offsets,#7b2276657273696f6e223a312c22706172746974696f6e73223a7b2230223a5b315d7d7d,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52140,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032008,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@330c4a8e,SendAction) 2017-06-30 23:00:32 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x69 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/brokers/topics/topic/partitions/0 Error:KeeperErrorCode = NoNode for /brokers/topics/topic/partitions/0 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending consumer metadata {error_code=15,coordinator={node_id=-1,host=,port=-1}} for correlation id 0 to client consumer-2. 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x69 zxid:0x2a txntype:-1 reqpath:n/a 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node -1, for key 10, received {error_code=15,coordinator={node_id=-1,host=,port=-1}} 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52139,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032008,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@44196d7d,SendAction) 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=10,api_version=0,correlation_id=0,client_id=consumer-1} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52140;totalTime:34,requestQueueTime:0,localTime:33,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 DEBUG AbstractCoordinator:572 - Received GroupCoordinator response ClientResponse(receivedTimeMs=1498860032042, latencyMs=128, disconnected=false, requestHeader={api_key=10,api_version=0,correlation_id=0,client_id=consumer-1}, responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}}) for group test-group 2017-06-30 23:00:32 DEBUG AbstractCoordinator:594 - Group coordinator lookup for group test-group failed: The group coordinator is not available. 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x69 zxid:0x2a txntype:-1 reqpath:n/a 2017-06-30 23:00:32 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG AbstractCoordinator:215 - Coordinator discovery failed for group test-group, refreshing metadata 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=10,api_version=0,correlation_id=0,client_id=consumer-2} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52139;totalTime:34,requestQueueTime:0,localTime:34,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node -1, for key 10, received {error_code=15,coordinator={node_id=-1,host=,port=-1}} 2017-06-30 23:00:32 DEBUG AbstractCoordinator:572 - Received GroupCoordinator response ClientResponse(receivedTimeMs=1498860032043, latencyMs=129, disconnected=false, requestHeader={api_key=10,api_version=0,correlation_id=0,client_id=consumer-2}, responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}}) for group test-group 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 105,1 replyHeader:: 105,42,-101 request:: '/brokers/topics/topic/partitions/0/state,#7b22636f6e74726f6c6c65725f65706f6368223a312c226c6561646572223a312c2276657273696f6e223a312c226c65616465725f65706f6368223a302c22697372223a5b315d7d,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:32 DEBUG AbstractCoordinator:594 - Group coordinator lookup for group test-group failed: The group coordinator is not available. 2017-06-30 23:00:32 DEBUG AbstractCoordinator:215 - Coordinator discovery failed for group test-group, refreshing metadata 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x6a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic/partitions/0 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x6a zxid:0x2b txntype:-1 reqpath:n/a Error Path:/brokers/topics/topic/partitions Error:KeeperErrorCode = NoNode for /brokers/topics/topic/partitions 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x6a zxid:0x2b txntype:-1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x6a zxid:0x2b txntype:-1 reqpath:n/a 2017-06-30 23:00:32 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 106,1 replyHeader:: 106,43,-101 request:: '/brokers/topics/topic/partitions/0,,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x6b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic/partitions 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x6b zxid:0x2c txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x6b zxid:0x2c txntype:1 reqpath:n/a 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x6b zxid:0x2c txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 107,1 replyHeader:: 107,44,0 request:: '/brokers/topics/topic/partitions,,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics/topic/partitions 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x6c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic/partitions/0 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x6c zxid:0x2d txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x6c zxid:0x2d txntype:1 reqpath:n/a 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x6c zxid:0x2d txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 108,1 replyHeader:: 108,45,0 request:: '/brokers/topics/topic/partitions/0,,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics/topic/partitions/0 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x6d zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic/partitions/0/state 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x6d zxid:0x2e txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x6d zxid:0x2e txntype:1 reqpath:n/a 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x6d zxid:0x2e txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 109,1 replyHeader:: 109,46,0 request:: '/brokers/topics/topic/partitions/0/state,#7b22636f6e74726f6c6c65725f65706f6368223a312c226c6561646572223a312c2276657273696f6e223a312c226c65616465725f65706f6368223a302c22697372223a5b315d7d,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics/topic/partitions/0/state 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 changed partition [topic,0] from NewPartition to OnlinePartition with leader 1 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 sending become-leader LeaderAndIsr request (Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1) to broker 1 for partition [topic,0] 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 sending UpdateMetadata request (Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1) to brokers Set(1) for partition topic-0 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {controller_id=1,controller_epoch=1,partition_states=[{topic=topic,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_leaders=[{id=1,host=localhost,port=52135}]} to node 1. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=4,api_version=0,correlation_id=1,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=topic,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_leaders=[{id=1,host=localhost,port=52135}]} 2017-06-30 23:00:32 INFO ReplicaStateMachine:70 - [Replica state machine on controller 1]: Invoking state change to OnlineReplica for replicas [Topic=topic,Partition=0,Replica=1] 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52138,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032062,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=4,api_version=0,correlation_id=1,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=topic,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_leaders=[{id=1,host=localhost,port=52135}]} from connection 127.0.0.1:52135-127.0.0.1:52138;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE logger:36 - Broker 1 received LeaderAndIsr request PartitionState(controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1]) correlation id 1 from controller 1 epoch 1 for partition [topic,0] 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 changed state of replica 1 for partition [topic,0] from NewReplica to OnlineReplica 2017-06-30 23:00:32 DEBUG ZkEventThread:80 - Delivering event #3 done 2017-06-30 23:00:32 DEBUG ZkEventThread:70 - Delivering event #4 ZkEvent[Children of /brokers/topics changed sent to kafka.controller.PartitionStateMachine$TopicChangeListener@488f317f] 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x6e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x6e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x6e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x6e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 110,3 replyHeader:: 110,46,0 request:: '/brokers/topics,T response:: s{6,6,1498860031196,1498860031196,0,2,0,0,0,2,40} 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x6f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x6f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x6f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x6f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 111,8 replyHeader:: 111,46,0 request:: '/brokers/topics,T response:: v{'topic,'__consumer_offsets} 2017-06-30 23:00:32 DEBUG PartitionStateMachine$TopicChangeListener:54 - [TopicChangeListener on Controller 1]: Topic change listener fired for path /brokers/topics with children topic,__consumer_offsets 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x70 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x70 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x70 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x70 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 112,4 replyHeader:: 112,46,0 request:: '/brokers/topics/__consumer_offsets,F response:: #7b2276657273696f6e223a312c22706172746974696f6e73223a7b2230223a5b315d7d7d,s{40,40,1498860032037,1498860032037,0,0,0,0,36,0,40} 2017-06-30 23:00:32 TRACE logger:36 - Broker 1 handling LeaderAndIsr request correlationId 1 from controller 1 epoch 1 starting the become-leader transition for partition topic-0 2017-06-30 23:00:32 DEBUG ZkUtils:54 - Replicas assigned to topic [__consumer_offsets], partition [0] are [List(1)] 2017-06-30 23:00:32 INFO PartitionStateMachine$TopicChangeListener:70 - [TopicChangeListener on Controller 1]: New topics: [Set(__consumer_offsets)], deleted topics: [Set()], new partition replica assignment [Map([__consumer_offsets,0] -> List(1))] 2017-06-30 23:00:32 INFO KafkaController:70 - [Controller 1]: New topic creation callback for [__consumer_offsets,0] 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x71 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x71 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x71 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 INFO ReplicaFetcherManager:70 - [ReplicaFetcherManager on broker 1] Removed fetcher for partitions topic-0 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x71 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 113,3 replyHeader:: 113,46,0 request:: '/brokers/topics/__consumer_offsets,T response:: s{40,40,1498860032037,1498860032037,0,0,0,0,36,0,40} 2017-06-30 23:00:32 DEBUG ZkClient:196 - Subscribed data changes for /brokers/topics/__consumer_offsets 2017-06-30 23:00:32 INFO KafkaController:70 - [Controller 1]: New partition creation callback for [__consumer_offsets,0] 2017-06-30 23:00:32 INFO PartitionStateMachine:70 - [Partition state machine on Controller 1]: Invoking state change to NewPartition for partitions [__consumer_offsets,0] 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 changed partition [__consumer_offsets,0] state from NonExistentPartition to NewPartition with assigned replicas 1 2017-06-30 23:00:32 INFO ReplicaStateMachine:70 - [Replica state machine on controller 1]: Invoking state change to NewReplica for replicas [Topic=__consumer_offsets,Partition=0,Replica=1] 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x72 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets/partitions/0/state 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x72 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets/partitions/0/state 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x72 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets/partitions/0/state 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x72 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets/partitions/0/state 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 114,4 replyHeader:: 114,46,-101 request:: '/brokers/topics/__consumer_offsets/partitions/0/state,F response:: 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x73 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/topic 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x73 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/topic 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 changed state of replica 1 for partition [__consumer_offsets,0] from NonExistentReplica to NewReplica 2017-06-30 23:00:32 INFO PartitionStateMachine:70 - [Partition state machine on Controller 1]: Invoking state change to OnlinePartition for partitions [__consumer_offsets,0] 2017-06-30 23:00:32 DEBUG PartitionStateMachine:54 - [Partition state machine on Controller 1]: Live assigned replicas for partition [__consumer_offsets,0] are: [List(1)] 2017-06-30 23:00:32 DEBUG PartitionStateMachine:54 - [Partition state machine on Controller 1]: Initializing leader and isr for partition [__consumer_offsets,0] to (Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1) 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x73 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/topic 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x73 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/topic 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x74 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets/partitions/0/state 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x74 zxid:0x2f txntype:-1 reqpath:n/a Error Path:/brokers/topics/__consumer_offsets/partitions/0 Error:KeeperErrorCode = NoNode for /brokers/topics/__consumer_offsets/partitions/0 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x74 zxid:0x2f txntype:-1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x74 zxid:0x2f txntype:-1 reqpath:n/a 2017-06-30 23:00:32 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 115,4 replyHeader:: 115,46,0 request:: '/config/topics/topic,F response:: #7b2276657273696f6e223a312c22636f6e666967223a7b7d7d,s{31,33,1498860031992,1498860031995,1,0,0,0,25,0,31} 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 116,1 replyHeader:: 116,47,-101 request:: '/brokers/topics/__consumer_offsets/partitions/0/state,#7b22636f6e74726f6c6c65725f65706f6368223a312c226c6561646572223a312c2276657273696f6e223a312c226c65616465725f65706f6368223a302c22697372223a5b315d7d,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x75 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets/partitions/0 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 INFO PrepRequestProcessor:843 - Got user-level KeeperException when processing sessionid:0x10000f6eb680000 type:create cxid:0x75 zxid:0x30 txntype:-1 reqpath:n/a Error Path:/brokers/topics/__consumer_offsets/partitions Error:KeeperErrorCode = NoNode for /brokers/topics/__consumer_offsets/partitions 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x75 zxid:0x30 txntype:-1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x75 zxid:0x30 txntype:-1 reqpath:n/a 2017-06-30 23:00:32 DEBUG DataTree:1014 - Ignoring processTxn failure hdr: -1 : error: -101 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 117,1 replyHeader:: 117,48,-101 request:: '/brokers/topics/__consumer_offsets/partitions/0,,v{s{31,s{'world,'anyone}}},0 response:: 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x76 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets/partitions 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x76 zxid:0x31 txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x76 zxid:0x31 txntype:1 reqpath:n/a 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x76 zxid:0x31 txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 118,1 replyHeader:: 118,49,0 request:: '/brokers/topics/__consumer_offsets/partitions,,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics/__consumer_offsets/partitions 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x77 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets/partitions/0 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x77 zxid:0x32 txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x77 zxid:0x32 txntype:1 reqpath:n/a 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x77 zxid:0x32 txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 119,1 replyHeader:: 119,50,0 request:: '/brokers/topics/__consumer_offsets/partitions/0,,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics/__consumer_offsets/partitions/0 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:create cxid:0x78 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets/partitions/0/state 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:923 - Processing ACL: 31,s{'world,'anyone} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 4 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:create cxid:0x78 zxid:0x33 txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:create cxid:0x78 zxid:0x33 txntype:1 reqpath:n/a 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:create cxid:0x78 zxid:0x33 txntype:1 reqpath:n/a 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 120,1 replyHeader:: 120,51,0 request:: '/brokers/topics/__consumer_offsets/partitions/0/state,#7b22636f6e74726f6c6c65725f65706f6368223a312c226c6561646572223a312c2276657273696f6e223a312c226c65616465725f65706f6368223a302c22697372223a5b315d7d,v{s{31,s{'world,'anyone}}},0 response:: '/brokers/topics/__consumer_offsets/partitions/0/state 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 changed partition [__consumer_offsets,0] from NewPartition to OnlinePartition with leader 1 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 sending become-leader LeaderAndIsr request (Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1) to broker 1 for partition [__consumer_offsets,0] 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 sending UpdateMetadata request (Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1) to brokers Set(1) for partition __consumer_offsets-0 2017-06-30 23:00:32 INFO ReplicaStateMachine:70 - [Replica state machine on controller 1]: Invoking state change to OnlineReplica for replicas [Topic=__consumer_offsets,Partition=0,Replica=1] 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 changed state of replica 1 for partition [__consumer_offsets,0] from NewReplica to OnlineReplica 2017-06-30 23:00:32 DEBUG ZkEventThread:80 - Delivering event #4 done 2017-06-30 23:00:32 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 DEBUG NetworkClient:767 - Initialize connection to node 1 for sending metadata request 2017-06-30 23:00:32 DEBUG NetworkClient:627 - Initiating connection to node 1 at localhost:52135. 2017-06-30 23:00:32 DEBUG NetworkClient:767 - Initialize connection to node 1 for sending metadata request 2017-06-30 23:00:32 DEBUG NetworkClient:627 - Initiating connection to node 1 at localhost:52135. 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-1.bytes-sent 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-1.bytes-sent 2017-06-30 23:00:32 DEBUG Acceptor:54 - Accepted connection from /127.0.0.1:52141 on /127.0.0.1:52135 and assigned it to processor 0, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [375636|102400] 2017-06-30 23:00:32 DEBUG Processor:54 - Processor 0 listening to new connection from /127.0.0.1:52141 2017-06-30 23:00:32 DEBUG Acceptor:54 - Accepted connection from /127.0.0.1:52142 on /127.0.0.1:52135 and assigned it to processor 1, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [375636|102400] 2017-06-30 23:00:32 DEBUG Processor:54 - Processor 1 listening to new connection from /127.0.0.1:52142 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-1.bytes-received 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-1.bytes-received 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-1.latency 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-1.latency 2017-06-30 23:00:32 DEBUG Selector:339 - Created socket with SO_RCVBUF = 342972, SO_SNDBUF = 146988, SO_TIMEOUT = 0 to node 1 2017-06-30 23:00:32 DEBUG Selector:339 - Created socket with SO_RCVBUF = 342972, SO_SNDBUF = 146988, SO_TIMEOUT = 0 to node 1 2017-06-30 23:00:32 DEBUG NetworkClient:590 - Completed connection to node 1. Fetching API versions. 2017-06-30 23:00:32 DEBUG NetworkClient:603 - Initiating API versions fetch from node 1. 2017-06-30 23:00:32 DEBUG NetworkClient:590 - Completed connection to node 1. Fetching API versions. 2017-06-30 23:00:32 TRACE NetworkClient:292 - No version information found when sending message of type API_VERSIONS to node 1. Assuming version 0. 2017-06-30 23:00:32 DEBUG NetworkClient:603 - Initiating API versions fetch from node 1. 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {} to node 1. 2017-06-30 23:00:32 TRACE NetworkClient:292 - No version information found when sending message of type API_VERSIONS to node 1. Assuming version 0. 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {} to node 1. 2017-06-30 23:00:32 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=18,api_version=0,correlation_id=3,client_id=consumer-1} -- {} 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=18,api_version=0,correlation_id=3,client_id=consumer-2} -- {} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032129,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032129,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=18,api_version=0,correlation_id=3,client_id=consumer-1} -- {} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=18,api_version=0,correlation_id=3,client_id=consumer-2} -- {} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032129,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@5060c99b,SendAction) 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032129,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@305c783,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 18, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=2},{api_key=1,min_version=0,max_version=3},{api_key=2,min_version=0,max_version=1},{api_key=3,min_version=0,max_version=2},{api_key=4,min_version=0,max_version=0},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=3},{api_key=7,min_version=1,max_version=1},{api_key=8,min_version=0,max_version=2},{api_key=9,min_version=0,max_version=2},{api_key=10,min_version=0,max_version=0},{api_key=11,min_version=0,max_version=1},{api_key=12,min_version=0,max_version=0},{api_key=13,min_version=0,max_version=0},{api_key=14,min_version=0,max_version=0},{api_key=15,min_version=0,max_version=0},{api_key=16,min_version=0,max_version=0},{api_key=17,min_version=0,max_version=0},{api_key=18,min_version=0,max_version=0},{api_key=19,min_version=0,max_version=1},{api_key=20,min_version=0,max_version=0}]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=18,api_version=0,correlation_id=3,client_id=consumer-2} -- {} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:1,requestQueueTime:0,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=18,api_version=0,correlation_id=3,client_id=consumer-1} -- {} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:1,requestQueueTime:0,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 18, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=2},{api_key=1,min_version=0,max_version=3},{api_key=2,min_version=0,max_version=1},{api_key=3,min_version=0,max_version=2},{api_key=4,min_version=0,max_version=0},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=3},{api_key=7,min_version=1,max_version=1},{api_key=8,min_version=0,max_version=2},{api_key=9,min_version=0,max_version=2},{api_key=10,min_version=0,max_version=0},{api_key=11,min_version=0,max_version=1},{api_key=12,min_version=0,max_version=0},{api_key=13,min_version=0,max_version=0},{api_key=14,min_version=0,max_version=0},{api_key=15,min_version=0,max_version=0},{api_key=16,min_version=0,max_version=0},{api_key=17,min_version=0,max_version=0},{api_key=18,min_version=0,max_version=0},{api_key=19,min_version=0,max_version=1},{api_key=20,min_version=0,max_version=0}]} 2017-06-30 23:00:32 DEBUG NetworkClient:558 - Recorded API versions for node 1: (Produce(0): 0 to 2 [usable: 2], Fetch(1): 0 to 3 [usable: 3], Offsets(2): 0 to 1 [usable: 1], Metadata(3): 0 to 2 [usable: 2], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 2 [usable: 2], OffsetFetch(9): 0 to 2 [usable: 2], GroupCoordinator(10): 0 [usable: 0], JoinGroup(11): 0 to 1 [usable: 1], Heartbeat(12): 0 [usable: 0], LeaveGroup(13): 0 [usable: 0], SyncGroup(14): 0 [usable: 0], DescribeGroups(15): 0 [usable: 0], ListGroups(16): 0 [usable: 0], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 [usable: 0], CreateTopics(19): 0 to 1 [usable: 1], DeleteTopics(20): 0 [usable: 0]) 2017-06-30 23:00:32 DEBUG NetworkClient:558 - Recorded API versions for node 1: (Produce(0): 0 to 2 [usable: 2], Fetch(1): 0 to 3 [usable: 3], Offsets(2): 0 to 1 [usable: 1], Metadata(3): 0 to 2 [usable: 2], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 2 [usable: 2], OffsetFetch(9): 0 to 2 [usable: 2], GroupCoordinator(10): 0 [usable: 0], JoinGroup(11): 0 to 1 [usable: 1], Heartbeat(12): 0 [usable: 0], LeaveGroup(13): 0 [usable: 0], SyncGroup(14): 0 [usable: 0], DescribeGroups(15): 0 [usable: 0], ListGroups(16): 0 [usable: 0], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 [usable: 0], CreateTopics(19): 0 to 1 [usable: 1], DeleteTopics(20): 0 [usable: 0]) 2017-06-30 23:00:32 TRACE NetworkClient:430 - Found least loaded node localhost:52135 (id: 1 rack: null) connected with no in-flight requests 2017-06-30 23:00:32 TRACE NetworkClient:430 - Found least loaded node localhost:52135 (id: 1 rack: null) connected with no in-flight requests 2017-06-30 23:00:32 DEBUG NetworkClient:751 - Sending metadata request (type=MetadataRequest, topics=topic) to node 1 2017-06-30 23:00:32 DEBUG OffsetIndex:54 - Loaded index file /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {topics=[topic]} to node 1. 2017-06-30 23:00:32 DEBUG NetworkClient:751 - Sending metadata request (type=MetadataRequest, topics=topic) to node 1 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {topics=[topic]} to node 1. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=3,api_version=2,correlation_id=4,client_id=consumer-1} -- {topics=[topic]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032131,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=3,api_version=2,correlation_id=4,client_id=consumer-2} -- {topics=[topic]} 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=3,api_version=2,correlation_id=4,client_id=consumer-1} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032132,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=3,api_version=2,correlation_id=4,client_id=consumer-2} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x79 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x79 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x7a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x79 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x79 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x7a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x7a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x7a zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 121,8 replyHeader:: 121,51,0 request:: '/brokers/ids,T response:: v{'1} 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x7b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x7b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x7b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 122,8 replyHeader:: 122,51,0 request:: '/brokers/ids,T response:: v{'1} 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x7b zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x7c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x7c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x7c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x7c zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 123,4 replyHeader:: 123,51,0 request:: '/brokers/ids/1,F response:: #7b226c697374656e65725f73656375726974795f70726f746f636f6c5f6d6170223a7b22504c41494e54455854223a22504c41494e54455854227d2c22656e64706f696e7473223a5b22504c41494e544558543a2f2f6c6f63616c686f73743a3532313335225d2c226a6d785f706f7274223a2d312c22686f7374223a226c6f63616c686f7374222c2274696d657374616d70223a2231343938383630303331383130222c22706f7274223a35323133352c2276657273696f6e223a347d,s{26,26,1498860031814,1498860031814,0,0,0,72058654549344256,190,0,26} 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 124,4 replyHeader:: 124,51,0 request:: '/brokers/ids/1,F response:: #7b226c697374656e65725f73656375726974795f70726f746f636f6c5f6d6170223a7b22504c41494e54455854223a22504c41494e54455854227d2c22656e64706f696e7473223a5b22504c41494e544558543a2f2f6c6f63616c686f73743a3532313335225d2c226a6d785f706f7274223a2d312c22686f7374223a226c6f63616c686f7374222c2274696d657374616d70223a2231343938383630303331383130222c22706f7274223a35323133352c2276657273696f6e223a347d,s{26,26,1498860031814,1498860031814,0,0,0,72058654549344256,190,0,26} 2017-06-30 23:00:32 INFO Log:70 - Completed load of log topic-0 with 1 log segments and log end offset 0 in 57 ms 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x7d zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x7d zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x7d zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x7d zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 125,3 replyHeader:: 125,51,0 request:: '/brokers/topics/topic,T response:: s{34,34,1498860031997,1498860031997,0,1,0,0,36,1,44} 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending topic metadata org.apache.kafka.common.requests.MetadataResponse$TopicMetadata@cece3b4 and brokers 1 : (EndPoint(localhost,52135,ListenerName(PLAINTEXT),PLAINTEXT)) : null for correlation id 4 to client consumer-1 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032131,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@5f1d246f,SendAction) 2017-06-30 23:00:32 INFO LogManager:70 - Created log for partition [topic,0] in /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832 with properties {compression.type -> producer, message.format.version -> 0.10.2-IV0, file.delete.delay.ms -> 60000, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, min.insync.replicas -> 1, segment.jitter.ms -> 0, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> true, retention.bytes -> -1, delete.retention.ms -> 86400000, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.ms -> 604800000, segment.bytes -> 1073741824, retention.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760, flush.messages -> 9223372036854775807}. 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 3, received {brokers=[{node_id=1,host=localhost,port=52135,rack=null}],cluster_id=Lxs2Pl1IS6KZ8Iyc24GUOg,controller_id=1,topic_metadata=[{topic_error_code=5,topic=topic,is_internal=false,partition_metadata=[]}]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=3,api_version=2,correlation_id=4,client_id=consumer-1} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:15,requestQueueTime:1,localTime:13,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 WARN NetworkClient:707 - Error while fetching metadata with correlation id 4 : {topic=LEADER_NOT_AVAILABLE} 2017-06-30 23:00:32 DEBUG Metadata:249 - Updated cluster metadata version 3 to Cluster(id = Lxs2Pl1IS6KZ8Iyc24GUOg, nodes = [localhost:52135 (id: 1 rack: null)], partitions = []) 2017-06-30 23:00:32 TRACE NetworkClient:430 - Found least loaded node localhost:52135 (id: 1 rack: null) connected with no in-flight requests 2017-06-30 23:00:32 DEBUG AbstractCoordinator:561 - Sending GroupCoordinator request for group test-group to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 INFO Partition:70 - Partition [topic,0] on broker 1: No checkpointed highwatermark is found for partition topic-0 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {group_id=test-group} to node 1. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=10,api_version=0,correlation_id=5,client_id=consumer-1} -- {group_id=test-group} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032147,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x7e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=10,api_version=0,correlation_id=5,client_id=consumer-1} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x7e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x7e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x7e zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/topic 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x7f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x7f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 126,3 replyHeader:: 126,51,0 request:: '/brokers/topics/topic,T response:: s{34,34,1498860031997,1498860031997,0,1,0,0,36,1,44} 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x7f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x7f zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending topic metadata org.apache.kafka.common.requests.MetadataResponse$TopicMetadata@608c5d8a and brokers 1 : (EndPoint(localhost,52135,ListenerName(PLAINTEXT),PLAINTEXT)) : null for correlation id 4 to client consumer-2 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032132,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@65306d2b,SendAction) 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 3, received {brokers=[{node_id=1,host=localhost,port=52135,rack=null}],cluster_id=Lxs2Pl1IS6KZ8Iyc24GUOg,controller_id=1,topic_metadata=[{topic_error_code=5,topic=topic,is_internal=false,partition_metadata=[]}]} 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 127,8 replyHeader:: 127,51,0 request:: '/brokers/ids,T response:: v{'1} 2017-06-30 23:00:32 WARN NetworkClient:707 - Error while fetching metadata with correlation id 4 : {topic=LEADER_NOT_AVAILABLE} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=3,api_version=2,correlation_id=4,client_id=consumer-2} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:17,requestQueueTime:0,localTime:17,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 DEBUG Metadata:249 - Updated cluster metadata version 3 to Cluster(id = Lxs2Pl1IS6KZ8Iyc24GUOg, nodes = [localhost:52135 (id: 1 rack: null)], partitions = []) 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x80 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 TRACE NetworkClient:430 - Found least loaded node localhost:52135 (id: 1 rack: null) connected with no in-flight requests 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x80 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x80 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x80 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG AbstractCoordinator:561 - Sending GroupCoordinator request for group test-group to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {group_id=test-group} to node 1. 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 128,4 replyHeader:: 128,51,0 request:: '/brokers/ids/1,F response:: #7b226c697374656e65725f73656375726974795f70726f746f636f6c5f6d6170223a7b22504c41494e54455854223a22504c41494e54455854227d2c22656e64706f696e7473223a5b22504c41494e544558543a2f2f6c6f63616c686f73743a3532313335225d2c226a6d785f706f7274223a2d312c22686f7374223a226c6f63616c686f7374222c2274696d657374616d70223a2231343938383630303331383130222c22706f7274223a35323133352c2276657273696f6e223a347d,s{26,26,1498860031814,1498860031814,0,0,0,72058654549344256,190,0,26} 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=10,api_version=0,correlation_id=5,client_id=consumer-2} -- {group_id=test-group} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032150,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=10,api_version=0,correlation_id=5,client_id=consumer-2} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getChildren cxid:0x81 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getChildren cxid:0x81 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getChildren cxid:0x81 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getChildren cxid:0x81 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 129,8 replyHeader:: 129,51,0 request:: '/brokers/ids,T response:: v{'1} 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x82 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x82 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x82 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x82 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 130,4 replyHeader:: 130,51,0 request:: '/brokers/ids/1,F response:: #7b226c697374656e65725f73656375726974795f70726f746f636f6c5f6d6170223a7b22504c41494e54455854223a22504c41494e54455854227d2c22656e64706f696e7473223a5b22504c41494e544558543a2f2f6c6f63616c686f73743a3532313335225d2c226a6d785f706f7274223a2d312c22686f7374223a226c6f63616c686f7374222c2274696d657374616d70223a2231343938383630303331383130222c22706f7274223a35323133352c2276657273696f6e223a347d,s{26,26,1498860031814,1498860031814,0,0,0,72058654549344256,190,0,26} 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x83 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x83 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x83 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x83 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 131,3 replyHeader:: 131,51,0 request:: '/brokers/topics/__consumer_offsets,T response:: s{40,40,1498860032037,1498860032037,0,1,0,0,36,1,49} 2017-06-30 23:00:32 TRACE Log:36 - Reading 1 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending consumer metadata {error_code=15,coordinator={node_id=-1,host=,port=-1}} for correlation id 5 to client consumer-1. 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032147,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@78457631,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 10, received {error_code=15,coordinator={node_id=-1,host=,port=-1}} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=10,api_version=0,correlation_id=5,client_id=consumer-1} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:7,requestQueueTime:0,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 DEBUG AbstractCoordinator:572 - Received GroupCoordinator response ClientResponse(receivedTimeMs=1498860032155, latencyMs=9, disconnected=false, requestHeader={api_key=10,api_version=0,correlation_id=5,client_id=consumer-1}, responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}}) for group test-group 2017-06-30 23:00:32 DEBUG AbstractCoordinator:594 - Group coordinator lookup for group test-group failed: The group coordinator is not available. 2017-06-30 23:00:32 DEBUG AbstractCoordinator:215 - Coordinator discovery failed for group test-group, refreshing metadata 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:exists cxid:0x84 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:exists cxid:0x84 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:exists cxid:0x84 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:exists cxid:0x84 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 132,3 replyHeader:: 132,51,0 request:: '/brokers/topics/__consumer_offsets,T response:: s{40,40,1498860032037,1498860032037,0,1,0,0,36,1,49} 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending consumer metadata {error_code=15,coordinator={node_id=-1,host=,port=-1}} for correlation id 5 to client consumer-2. 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032150,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@1925b0e7,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 10, received {error_code=15,coordinator={node_id=-1,host=,port=-1}} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=10,api_version=0,correlation_id=5,client_id=consumer-2} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:8,requestQueueTime:1,localTime:6,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 DEBUG AbstractCoordinator:572 - Received GroupCoordinator response ClientResponse(receivedTimeMs=1498860032158, latencyMs=8, disconnected=false, requestHeader={api_key=10,api_version=0,correlation_id=5,client_id=consumer-2}, responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}}) for group test-group 2017-06-30 23:00:32 DEBUG AbstractCoordinator:594 - Group coordinator lookup for group test-group failed: The group coordinator is not available. 2017-06-30 23:00:32 DEBUG AbstractCoordinator:215 - Coordinator discovery failed for group test-group, refreshing metadata 2017-06-30 23:00:32 DEBUG Partition:54 - Partition [topic,0] on broker 1: Skipping update high watermark since Old hw 0 [0 : 0] is larger than new hw 0 [0 : 0] for partition [topic,0]. All leo's are 0 [0 : 0] 2017-06-30 23:00:32 TRACE logger:36 - Broker 1 stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 1 for partition topic-0 2017-06-30 23:00:32 TRACE logger:36 - Broker 1 completed LeaderAndIsr request correlationId 1 from controller 1 epoch 1 for the become-leader transition for partition topic-0 2017-06-30 23:00:32 DEBUG KafkaScheduler:54 - Scheduling task highwatermark-checkpoint with initial delay 0 ms and period 5000 ms. 2017-06-30 23:00:32 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52138,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032062,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@46b9f4c3,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 4, received {error_code=0,partitions=[{topic=topic,partition=0,error_code=0}]} 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 received response {error_code=0,partitions=[{topic=topic,partition=0,error_code=0}]} for a request sent to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=4,api_version=0,correlation_id=1,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=topic,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_leaders=[{id=1,host=localhost,port=52135}]} from connection 127.0.0.1:52135-127.0.0.1:52138;totalTime:108,requestQueueTime:0,localTime:108,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {controller_id=1,controller_epoch=1,partition_states=[{topic=topic,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} to node 1. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=6,api_version=3,correlation_id=2,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=topic,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52138,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032171,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=6,api_version=3,correlation_id=2,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=topic,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} from connection 127.0.0.1:52135-127.0.0.1:52138;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:32 TRACE logger:36 - Broker 1 cached leader info (LeaderAndIsrInfo:(Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1),ReplicationFactor:1),AllReplicas:1) for partition topic-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 2 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52138,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032171,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@d126b33,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 6, received {error_code=0} 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 received response {error_code=0} for a request sent to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {controller_id=1,controller_epoch=1,partition_states=[{topic=__consumer_offsets,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_leaders=[{id=1,host=localhost,port=52135}]} to node 1. 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=6,api_version=3,correlation_id=2,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=topic,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} from connection 127.0.0.1:52135-127.0.0.1:52138;totalTime:3,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=4,api_version=0,correlation_id=3,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=__consumer_offsets,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_leaders=[{id=1,host=localhost,port=52135}]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52138,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032174,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=4,api_version=0,correlation_id=3,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=__consumer_offsets,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_leaders=[{id=1,host=localhost,port=52135}]} from connection 127.0.0.1:52135-127.0.0.1:52138;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE logger:36 - Broker 1 received LeaderAndIsr request PartitionState(controllerEpoch=1, leader=1, leaderEpoch=0, isr=[1], zkVersion=0, replicas=[1]) correlation id 3 from controller 1 epoch 1 for partition [__consumer_offsets,0] 2017-06-30 23:00:32 TRACE logger:36 - Broker 1 handling LeaderAndIsr request correlationId 3 from controller 1 epoch 1 starting the become-leader transition for partition __consumer_offsets-0 2017-06-30 23:00:32 INFO ReplicaFetcherManager:70 - [ReplicaFetcherManager on broker 1] Removed fetcher for partitions __consumer_offsets-0 2017-06-30 23:00:32 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x85 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x85 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/__consumer_offsets 2017-06-30 23:00:32 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x85 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x85 zxid:0xfffffffffffffffe txntype:unknown reqpath:/config/topics/__consumer_offsets 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:00:32 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:00:32 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:32 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 133,4 replyHeader:: 133,51,0 request:: '/config/topics/__consumer_offsets,F response:: #7b2276657273696f6e223a312c22636f6e666967223a7b227365676d656e742e6279746573223a22313034383537363030222c22636f6d7072657373696f6e2e74797065223a2270726f6475636572222c22636c65616e75702e706f6c696379223a22636f6d70616374227d7d,s{38,39,1498860032032,1498860032033,1,0,0,0,109,0,38} 2017-06-30 23:00:32 DEBUG OffsetIndex:54 - Loaded index file /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries = 0, lastOffset = 0, file position = 0 2017-06-30 23:00:32 INFO Log:70 - Completed load of log __consumer_offsets-0 with 1 log segments and log end offset 0 in 1 ms 2017-06-30 23:00:32 INFO LogManager:70 - Created log for partition [__consumer_offsets,0] in /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832 with properties {compression.type -> producer, message.format.version -> 0.10.2-IV0, file.delete.delay.ms -> 60000, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, min.insync.replicas -> 1, segment.jitter.ms -> 0, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> true, retention.bytes -> -1, delete.retention.ms -> 86400000, cleanup.policy -> compact, flush.ms -> 9223372036854775807, segment.ms -> 604800000, segment.bytes -> 104857600, retention.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760, flush.messages -> 9223372036854775807}. 2017-06-30 23:00:32 INFO Partition:70 - Partition [__consumer_offsets,0] on broker 1: No checkpointed highwatermark is found for partition __consumer_offsets-0 2017-06-30 23:00:32 TRACE Log:36 - Reading 1 bytes from offset 0 in log __consumer_offsets-0 of length 0 bytes 2017-06-30 23:00:32 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: Skipping update high watermark since Old hw 0 [0 : 0] is larger than new hw 0 [0 : 0] for partition [__consumer_offsets,0]. All leo's are 0 [0 : 0] 2017-06-30 23:00:32 TRACE logger:36 - Broker 1 stopped fetchers as part of become-leader request from controller 1 epoch 1 with correlation id 3 for partition __consumer_offsets-0 2017-06-30 23:00:32 TRACE logger:36 - Broker 1 completed LeaderAndIsr request correlationId 3 from controller 1 epoch 1 for the become-leader transition for partition __consumer_offsets-0 2017-06-30 23:00:32 DEBUG KafkaScheduler:54 - Scheduling task __consumer_offsets-0 with initial delay 0 ms and period -1 ms. 2017-06-30 23:00:32 TRACE KafkaScheduler:36 - Beginning execution of scheduled task '__consumer_offsets-0'. 2017-06-30 23:00:32 INFO GroupMetadataManager:70 - [Group Metadata Manager on Broker 1]: Loading offsets and group metadata from __consumer_offsets-0 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52138,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032174,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@398440fe,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 4, received {error_code=0,partitions=[{topic=__consumer_offsets,partition=0,error_code=0}]} 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 received response {error_code=0,partitions=[{topic=__consumer_offsets,partition=0,error_code=0}]} for a request sent to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {controller_id=1,controller_epoch=1,partition_states=[{topic=__consumer_offsets,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} to node 1. 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=4,api_version=0,correlation_id=3,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=__consumer_offsets,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_leaders=[{id=1,host=localhost,port=52135}]} from connection 127.0.0.1:52135-127.0.0.1:52138;totalTime:10,requestQueueTime:1,localTime:8,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=6,api_version=3,correlation_id=4,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=__consumer_offsets,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52138,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032185,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=6,api_version=3,correlation_id=4,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=__consumer_offsets,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} from connection 127.0.0.1:52135-127.0.0.1:52138;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE logger:36 - Broker 1 cached leader info (LeaderAndIsrInfo:(Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1),ReplicationFactor:1),AllReplicas:1) for partition __consumer_offsets-0 in response to UpdateMetadata request sent by controller 1 epoch 1 with correlation id 4 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52138,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032185,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@33ee87f1,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 6, received {error_code=0} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=6,api_version=3,correlation_id=4,client_id=1} -- {controller_id=1,controller_epoch=1,partition_states=[{topic=__consumer_offsets,partition=0,controller_epoch=1,leader=1,leader_epoch=0,isr=[1],zk_version=0,replicas=[1]}],live_brokers=[{id=1,end_points=[{port=52135,host=localhost,listener_name=PLAINTEXT,security_protocol_type=0}],rack=null}]} from connection 127.0.0.1:52135-127.0.0.1:52138;totalTime:1,requestQueueTime:0,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE logger:36 - Controller 1 epoch 1 received response {error_code=0} for a request sent to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 INFO GroupMetadataManager:70 - [Group Metadata Manager on Broker 1]: Finished loading offsets from __consumer_offsets-0 in 8 milliseconds. 2017-06-30 23:00:32 TRACE KafkaScheduler:36 - Completed execution of scheduled task '__consumer_offsets-0'. 2017-06-30 23:00:32 TRACE NetworkClient:430 - Found least loaded node localhost:52135 (id: 1 rack: null) connected with no in-flight requests 2017-06-30 23:00:32 DEBUG NetworkClient:751 - Sending metadata request (type=MetadataRequest, topics=topic) to node 1 2017-06-30 23:00:32 TRACE NetworkClient:430 - Found least loaded node localhost:52135 (id: 1 rack: null) connected with no in-flight requests 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {topics=[topic]} to node 1. 2017-06-30 23:00:32 DEBUG NetworkClient:751 - Sending metadata request (type=MetadataRequest, topics=topic) to node 1 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {topics=[topic]} to node 1. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=3,api_version=2,correlation_id=6,client_id=consumer-1} -- {topics=[topic]} 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=3,api_version=2,correlation_id=6,client_id=consumer-2} -- {topics=[topic]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032254,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032254,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=3,api_version=2,correlation_id=6,client_id=consumer-1} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=3,api_version=2,correlation_id=6,client_id=consumer-2} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending topic metadata org.apache.kafka.common.requests.MetadataResponse$TopicMetadata@514a3f21 and brokers 1 : (EndPoint(localhost,52135,ListenerName(PLAINTEXT),PLAINTEXT)) : null for correlation id 6 to client consumer-2 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending topic metadata org.apache.kafka.common.requests.MetadataResponse$TopicMetadata@78eda4cf and brokers 1 : (EndPoint(localhost,52135,ListenerName(PLAINTEXT),PLAINTEXT)) : null for correlation id 6 to client consumer-1 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032254,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@671e9647,SendAction) 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032254,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2d3b394c,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 3, received {brokers=[{node_id=1,host=localhost,port=52135,rack=null}],cluster_id=Lxs2Pl1IS6KZ8Iyc24GUOg,controller_id=1,topic_metadata=[{topic_error_code=0,topic=topic,is_internal=false,partition_metadata=[{partition_error_code=0,partition_id=0,leader=1,replicas=[1],isr=[1]}]}]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=3,api_version=2,correlation_id=6,client_id=consumer-1} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 3, received {brokers=[{node_id=1,host=localhost,port=52135,rack=null}],cluster_id=Lxs2Pl1IS6KZ8Iyc24GUOg,controller_id=1,topic_metadata=[{topic_error_code=0,topic=topic,is_internal=false,partition_metadata=[{partition_error_code=0,partition_id=0,leader=1,replicas=[1],isr=[1]}]}]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=3,api_version=2,correlation_id=6,client_id=consumer-2} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:5,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 DEBUG Metadata:249 - Updated cluster metadata version 4 to Cluster(id = Lxs2Pl1IS6KZ8Iyc24GUOg, nodes = [localhost:52135 (id: 1 rack: null)], partitions = [Partition(topic = topic, partition = 0, leader = 1, replicas = [1], isr = [1])]) 2017-06-30 23:00:32 DEBUG Metadata:249 - Updated cluster metadata version 4 to Cluster(id = Lxs2Pl1IS6KZ8Iyc24GUOg, nodes = [localhost:52135 (id: 1 rack: null)], partitions = [Partition(topic = topic, partition = 0, leader = 1, replicas = [1], isr = [1])]) 2017-06-30 23:00:32 TRACE NetworkClient:430 - Found least loaded node localhost:52135 (id: 1 rack: null) connected with no in-flight requests 2017-06-30 23:00:32 DEBUG AbstractCoordinator:561 - Sending GroupCoordinator request for group test-group to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:430 - Found least loaded node localhost:52135 (id: 1 rack: null) connected with no in-flight requests 2017-06-30 23:00:32 DEBUG AbstractCoordinator:561 - Sending GroupCoordinator request for group test-group to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {group_id=test-group} to node 1. 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {group_id=test-group} to node 1. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=10,api_version=0,correlation_id=7,client_id=consumer-1} -- {group_id=test-group} 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=10,api_version=0,correlation_id=7,client_id=consumer-2} -- {group_id=test-group} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032260,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032260,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=10,api_version=0,correlation_id=7,client_id=consumer-1} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=10,api_version=0,correlation_id=7,client_id=consumer-2} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending consumer metadata {error_code=0,coordinator={node_id=1,host=localhost,port=52135}} for correlation id 7 to client consumer-1. 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending consumer metadata {error_code=0,coordinator={node_id=1,host=localhost,port=52135}} for correlation id 7 to client consumer-2. 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032260,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@31e4a72e,SendAction) 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032260,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@36a31fa5,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 10, received {error_code=0,coordinator={node_id=1,host=localhost,port=52135}} 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 10, received {error_code=0,coordinator={node_id=1,host=localhost,port=52135}} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=10,api_version=0,correlation_id=7,client_id=consumer-2} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:1,requestQueueTime:0,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=10,api_version=0,correlation_id=7,client_id=consumer-1} -- {group_id=test-group} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:1,requestQueueTime:0,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 DEBUG AbstractCoordinator:572 - Received GroupCoordinator response ClientResponse(receivedTimeMs=1498860032261, latencyMs=2, disconnected=false, requestHeader={api_key=10,api_version=0,correlation_id=7,client_id=consumer-1}, responseBody={error_code=0,coordinator={node_id=1,host=localhost,port=52135}}) for group test-group 2017-06-30 23:00:32 INFO AbstractCoordinator:586 - Discovered coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group. 2017-06-30 23:00:32 DEBUG NetworkClient:627 - Initiating connection to node 2147483646 at localhost:52135. 2017-06-30 23:00:32 DEBUG AbstractCoordinator:572 - Received GroupCoordinator response ClientResponse(receivedTimeMs=1498860032262, latencyMs=2, disconnected=false, requestHeader={api_key=10,api_version=0,correlation_id=7,client_id=consumer-2}, responseBody={error_code=0,coordinator={node_id=1,host=localhost,port=52135}}) for group test-group 2017-06-30 23:00:32 INFO AbstractCoordinator:586 - Discovered coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group. 2017-06-30 23:00:32 DEBUG Acceptor:54 - Accepted connection from /127.0.0.1:52143 on /127.0.0.1:52135 and assigned it to processor 2, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [375636|102400] 2017-06-30 23:00:32 DEBUG NetworkClient:627 - Initiating connection to node 2147483646 at localhost:52135. 2017-06-30 23:00:32 DEBUG Processor:54 - Processor 2 listening to new connection from /127.0.0.1:52143 2017-06-30 23:00:32 DEBUG Acceptor:54 - Accepted connection from /127.0.0.1:52144 on /127.0.0.1:52135 and assigned it to processor 0, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [375636|102400] 2017-06-30 23:00:32 DEBUG Processor:54 - Processor 0 listening to new connection from /127.0.0.1:52144 2017-06-30 23:00:32 INFO ConsumerCoordinator:397 - Revoking previously assigned partitions [] for group test-group 2017-06-30 23:00:32 DEBUG AbstractCoordinator:889 - Heartbeat thread for group test-group started 2017-06-30 23:00:32 INFO ConsumerCoordinator:397 - Revoking previously assigned partitions [] for group test-group 2017-06-30 23:00:32 TRACE AbstractCoordinator:866 - Disabling heartbeat thread for group test-group 2017-06-30 23:00:32 TRACE AbstractCoordinator:866 - Disabling heartbeat thread for group test-group 2017-06-30 23:00:32 DEBUG AbstractCoordinator:889 - Heartbeat thread for group test-group started 2017-06-30 23:00:32 INFO AbstractCoordinator:420 - (Re-)joining group test-group 2017-06-30 23:00:32 INFO AbstractCoordinator:420 - (Re-)joining group test-group 2017-06-30 23:00:32 DEBUG AbstractCoordinator:428 - Sending JoinGroup ((type: JoinGroupRequest, groupId=test-group, sessionTimeout=10000, rebalanceTimeout=300000, memberId=, protocolType=consumer, groupProtocols=org.apache.kafka.common.requests.JoinGroupRequest$ProtocolMetadata@3682ca63)) to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:32 DEBUG AbstractCoordinator:428 - Sending JoinGroup ((type: JoinGroupRequest, groupId=test-group, sessionTimeout=10000, rebalanceTimeout=300000, memberId=, protocolType=consumer, groupProtocols=org.apache.kafka.common.requests.JoinGroupRequest$ProtocolMetadata@6f6b5b5)) to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-2147483646.bytes-sent 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-2147483646.bytes-sent 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-2147483646.bytes-received 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-2147483646.bytes-received 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-2147483646.latency 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name node-2147483646.latency 2017-06-30 23:00:32 DEBUG Selector:339 - Created socket with SO_RCVBUF = 342972, SO_SNDBUF = 146988, SO_TIMEOUT = 0 to node 2147483646 2017-06-30 23:00:32 DEBUG NetworkClient:590 - Completed connection to node 2147483646. Fetching API versions. 2017-06-30 23:00:32 DEBUG Selector:339 - Created socket with SO_RCVBUF = 342972, SO_SNDBUF = 146988, SO_TIMEOUT = 0 to node 2147483646 2017-06-30 23:00:32 DEBUG NetworkClient:603 - Initiating API versions fetch from node 2147483646. 2017-06-30 23:00:32 DEBUG NetworkClient:590 - Completed connection to node 2147483646. Fetching API versions. 2017-06-30 23:00:32 DEBUG NetworkClient:603 - Initiating API versions fetch from node 2147483646. 2017-06-30 23:00:32 TRACE NetworkClient:292 - No version information found when sending message of type API_VERSIONS to node 2147483646. Assuming version 0. 2017-06-30 23:00:32 TRACE NetworkClient:292 - No version information found when sending message of type API_VERSIONS to node 2147483646. Assuming version 0. 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {} to node 2147483646. 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {} to node 2147483646. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=18,api_version=0,correlation_id=9,client_id=consumer-2} -- {} 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=18,api_version=0,correlation_id=9,client_id=consumer-1} -- {} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032269,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032269,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=18,api_version=0,correlation_id=9,client_id=consumer-2} -- {} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=18,api_version=0,correlation_id=9,client_id=consumer-1} -- {} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032269,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2020fe35,SendAction) 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032269,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@35da9a52,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 18, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=2},{api_key=1,min_version=0,max_version=3},{api_key=2,min_version=0,max_version=1},{api_key=3,min_version=0,max_version=2},{api_key=4,min_version=0,max_version=0},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=3},{api_key=7,min_version=1,max_version=1},{api_key=8,min_version=0,max_version=2},{api_key=9,min_version=0,max_version=2},{api_key=10,min_version=0,max_version=0},{api_key=11,min_version=0,max_version=1},{api_key=12,min_version=0,max_version=0},{api_key=13,min_version=0,max_version=0},{api_key=14,min_version=0,max_version=0},{api_key=15,min_version=0,max_version=0},{api_key=16,min_version=0,max_version=0},{api_key=17,min_version=0,max_version=0},{api_key=18,min_version=0,max_version=0},{api_key=19,min_version=0,max_version=1},{api_key=20,min_version=0,max_version=0}]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=18,api_version=0,correlation_id=9,client_id=consumer-1} -- {} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:2,requestQueueTime:1,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=18,api_version=0,correlation_id=9,client_id=consumer-2} -- {} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:2,requestQueueTime:1,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 18, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=2},{api_key=1,min_version=0,max_version=3},{api_key=2,min_version=0,max_version=1},{api_key=3,min_version=0,max_version=2},{api_key=4,min_version=0,max_version=0},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=3},{api_key=7,min_version=1,max_version=1},{api_key=8,min_version=0,max_version=2},{api_key=9,min_version=0,max_version=2},{api_key=10,min_version=0,max_version=0},{api_key=11,min_version=0,max_version=1},{api_key=12,min_version=0,max_version=0},{api_key=13,min_version=0,max_version=0},{api_key=14,min_version=0,max_version=0},{api_key=15,min_version=0,max_version=0},{api_key=16,min_version=0,max_version=0},{api_key=17,min_version=0,max_version=0},{api_key=18,min_version=0,max_version=0},{api_key=19,min_version=0,max_version=1},{api_key=20,min_version=0,max_version=0}]} 2017-06-30 23:00:32 DEBUG NetworkClient:558 - Recorded API versions for node 2147483646: (Produce(0): 0 to 2 [usable: 2], Fetch(1): 0 to 3 [usable: 3], Offsets(2): 0 to 1 [usable: 1], Metadata(3): 0 to 2 [usable: 2], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 2 [usable: 2], OffsetFetch(9): 0 to 2 [usable: 2], GroupCoordinator(10): 0 [usable: 0], JoinGroup(11): 0 to 1 [usable: 1], Heartbeat(12): 0 [usable: 0], LeaveGroup(13): 0 [usable: 0], SyncGroup(14): 0 [usable: 0], DescribeGroups(15): 0 [usable: 0], ListGroups(16): 0 [usable: 0], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 [usable: 0], CreateTopics(19): 0 to 1 [usable: 1], DeleteTopics(20): 0 [usable: 0]) 2017-06-30 23:00:32 DEBUG NetworkClient:558 - Recorded API versions for node 2147483646: (Produce(0): 0 to 2 [usable: 2], Fetch(1): 0 to 3 [usable: 3], Offsets(2): 0 to 1 [usable: 1], Metadata(3): 0 to 2 [usable: 2], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 2 [usable: 2], OffsetFetch(9): 0 to 2 [usable: 2], GroupCoordinator(10): 0 [usable: 0], JoinGroup(11): 0 to 1 [usable: 1], Heartbeat(12): 0 [usable: 0], LeaveGroup(13): 0 [usable: 0], SyncGroup(14): 0 [usable: 0], DescribeGroups(15): 0 [usable: 0], ListGroups(16): 0 [usable: 0], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 [usable: 0], CreateTopics(19): 0 to 1 [usable: 1], DeleteTopics(20): 0 [usable: 0]) 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} to node 2147483646. 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} to node 2147483646. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=11,api_version=1,correlation_id=8,client_id=consumer-1} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=11,api_version=1,correlation_id=8,client_id=consumer-2} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032272,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032272,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=11,api_version=1,correlation_id=8,client_id=consumer-1} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=11,api_version=1,correlation_id=8,client_id=consumer-2} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Preparing to restabilize group test-group with old generation 0 2017-06-30 23:00:32 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Stabilized group test-group generation 1 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending join group response {error_code=0,generation_id=1,group_protocol=range,leader_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,members=[{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} for correlation id 8 to client consumer-1. 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032272,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@6453ee5d,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 11, received {error_code=0,generation_id=1,group_protocol=range,leader_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,members=[{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=11,api_version=1,correlation_id=8,client_id=consumer-1} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:17,requestQueueTime:1,localTime:15,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 DEBUG AbstractCoordinator:438 - Received successful JoinGroup response for group test-group: {error_code=0,generation_id=1,group_protocol=range,leader_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,members=[{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} 2017-06-30 23:00:32 DEBUG ConsumerCoordinator:340 - Performing assignment for group test-group using strategy range with subscriptions {consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c=Subscription(topics=[topic])} 2017-06-30 23:00:32 DEBUG ConsumerCoordinator:379 - Finished assignment for group test-group: {consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c=Assignment(partitions=[topic-0])} 2017-06-30 23:00:32 DEBUG AbstractCoordinator:506 - Sending leader SyncGroup for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null): (type=SyncGroupRequest, groupId=test-group, generationId=1, memberId=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c, groupAssignment=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c) 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {group_id=test-group,generation_id=1,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,group_assignment=[{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25]}]} to node 2147483646. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=14,api_version=0,correlation_id=10,client_id=consumer-1} -- {group_id=test-group,generation_id=1,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,group_assignment=[{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25]}]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032292,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=14,api_version=0,correlation_id=10,client_id=consumer-1} -- {group_id=test-group,generation_id=1,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,group_assignment=[{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Assignment received from leader for group test-group for generation 1 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032292,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@559c9e43,SendAction) 2017-06-30 23:00:32 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3495311439, CreateTime = 1498860032300, key = 14 bytes, value = 207 bytes))])] to local log 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 14, received {error_code=27,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=0 cap=0]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=14,api_version=0,correlation_id=10,client_id=consumer-1} -- {group_id=test-group,generation_id=1,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,group_assignment=[{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:20,requestQueueTime:0,localTime:19,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 DEBUG AbstractCoordinator:535 - SyncGroup for group test-group failed due to coordinator rebalance 2017-06-30 23:00:32 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Preparing to restabilize group test-group with old generation 1 2017-06-30 23:00:32 TRACE AbstractCoordinator:866 - Disabling heartbeat thread for group test-group 2017-06-30 23:00:32 INFO AbstractCoordinator:420 - (Re-)joining group test-group 2017-06-30 23:00:32 DEBUG AbstractCoordinator:428 - Sending JoinGroup ((type: JoinGroupRequest, groupId=test-group, sessionTimeout=10000, rebalanceTimeout=300000, memberId=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c, protocolType=consumer, groupProtocols=org.apache.kafka.common.requests.JoinGroupRequest$ProtocolMetadata@6e905dbd)) to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} to node 2147483646. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=11,api_version=1,correlation_id=11,client_id=consumer-1} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032313,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=11,api_version=1,correlation_id=11,client_id=consumer-1} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Stabilized group test-group generation 2 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending join group response {error_code=0,generation_id=2,group_protocol=range,leader_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,members=[]} for correlation id 8 to client consumer-2. 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending join group response {error_code=0,generation_id=2,group_protocol=range,leader_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,members=[{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]},{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} for correlation id 11 to client consumer-1. 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032272,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@ed093a3,SendAction) 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032313,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@50fd4b66,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 11, received {error_code=0,generation_id=2,group_protocol=range,leader_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,members=[]} 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 11, received {error_code=0,generation_id=2,group_protocol=range,leader_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,members=[{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=87]},{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} 2017-06-30 23:00:32 DEBUG AbstractCoordinator:438 - Received successful JoinGroup response for group test-group: {error_code=0,generation_id=2,group_protocol=range,leader_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,members=[]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=11,api_version=1,correlation_id=11,client_id=consumer-1} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:2,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=11,api_version=1,correlation_id=8,client_id=consumer-2} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:43,requestQueueTime:1,localTime:40,remoteTime:1,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 DEBUG AbstractCoordinator:493 - Sending follower SyncGroup for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null): (type=SyncGroupRequest, groupId=test-group, generationId=2, memberId=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71, groupAssignment=) 2017-06-30 23:00:32 DEBUG AbstractCoordinator:438 - Received successful JoinGroup response for group test-group: {error_code=0,generation_id=2,group_protocol=range,leader_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,members=[{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=87]},{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {group_id=test-group,generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,group_assignment=[]} to node 2147483646. 2017-06-30 23:00:32 DEBUG ConsumerCoordinator:340 - Performing assignment for group test-group using strategy range with subscriptions {consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c=Subscription(topics=[topic]), consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71=Subscription(topics=[topic])} 2017-06-30 23:00:32 DEBUG ConsumerCoordinator:379 - Finished assignment for group test-group: {consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c=Assignment(partitions=[topic-0]), consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71=Assignment(partitions=[])} 2017-06-30 23:00:32 DEBUG AbstractCoordinator:506 - Sending leader SyncGroup for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null): (type=SyncGroupRequest, groupId=test-group, generationId=2, memberId=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c, groupAssignment=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71) 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {group_id=test-group,generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,group_assignment=[{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25]},{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]}]} to node 2147483646. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=14,api_version=0,correlation_id=10,client_id=consumer-2} -- {group_id=test-group,generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,group_assignment=[]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032316,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=14,api_version=0,correlation_id=12,client_id=consumer-1} -- {group_id=test-group,generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,group_assignment=[{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=88]},{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]}]} 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=14,api_version=0,correlation_id=10,client_id=consumer-2} -- {group_id=test-group,generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,group_assignment=[]} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032317,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=14,api_version=0,correlation_id=12,client_id=consumer-1} -- {group_id=test-group,generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,group_assignment=[{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=88]},{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Assignment received from leader for group test-group for generation 2 2017-06-30 23:00:32 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4291333158, CreateTime = 1498860032317, key = 14 bytes, value = 323 bytes))])] to local log 2017-06-30 23:00:32 TRACE LogSegment:36 - Inserting 255 bytes at offset 0 at position 0 with largest timestamp 1498860032300 at shallow offset 0 2017-06-30 23:00:32 TRACE LogSegment:36 - Appended 255 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 0 2017-06-30 23:00:32 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 0, next offset: 1, and messages: [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3495311439, CreateTime = 1498860032300, key = 14 bytes, value = 207 bytes))] 2017-06-30 23:00:32 TRACE LogSegment:36 - Inserting 371 bytes at offset 1 at position 255 with largest timestamp 1498860032317 at shallow offset 1 2017-06-30 23:00:32 TRACE LogSegment:36 - Appended 371 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 1 2017-06-30 23:00:32 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 1, next offset: 2, and messages: [(offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4291333158, CreateTime = 1498860032317, key = 14 bytes, value = 323 bytes))] 2017-06-30 23:00:32 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:32 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:32 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: Skipping update high watermark since Old hw 2 [0 : 626] is larger than new hw 2 [0 : 626] for partition [__consumer_offsets,0]. All leo's are 2 [0 : 626] 2017-06-30 23:00:32 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [2 [0 : 626]] 2017-06-30 23:00:32 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 2 [0 : 626] 2017-06-30 23:00:32 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 371 bytes written to log __consumer_offsets-0 beginning at offset 1 and ending at offset 1 2017-06-30 23:00:32 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:32 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:32 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 255 bytes written to log __consumer_offsets-0 beginning at offset 0 and ending at offset 0 2017-06-30 23:00:32 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 11 ms 2017-06-30 23:00:32 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 17 ms 2017-06-30 23:00:32 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 1, requiredOffset: 2] 2017-06-30 23:00:32 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 0, requiredOffset: 1] 2017-06-30 23:00:32 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 0, requiredOffset: 1] 2017-06-30 23:00:32 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 1, requiredOffset: 2] 2017-06-30 23:00:32 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:32 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032317,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@31944321,SendAction) 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032316,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@16d50b5,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 14, received {error_code=0,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=14,api_version=0,correlation_id=12,client_id=consumer-1} -- {group_id=test-group,generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,group_assignment=[{member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=88]},{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:17,requestQueueTime:0,localTime:17,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 14, received {error_code=0,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=10 cap=10]} 2017-06-30 23:00:32 INFO AbstractCoordinator:388 - Successfully joined group test-group with generation 2 2017-06-30 23:00:32 TRACE AbstractCoordinator:857 - Enabling heartbeat thread for group test-group 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=14,api_version=0,correlation_id=10,client_id=consumer-2} -- {group_id=test-group,generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,group_assignment=[]} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:18,requestQueueTime:1,localTime:0,remoteTime:16,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 INFO AbstractCoordinator:388 - Successfully joined group test-group with generation 2 2017-06-30 23:00:32 TRACE AbstractCoordinator:857 - Enabling heartbeat thread for group test-group 2017-06-30 23:00:32 INFO ConsumerCoordinator:256 - Setting newly assigned partitions [] for group test-group 2017-06-30 23:00:32 INFO ConsumerCoordinator:256 - Setting newly assigned partitions [topic-0] for group test-group 2017-06-30 23:00:32 DEBUG ConsumerCoordinator:804 - Group test-group fetching committed offsets for partitions: [topic-0] 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {group_id=test-group,topics=[{topic=topic,partitions=[{partition=0}]}]} to node 2147483646. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=9,api_version=2,correlation_id=13,client_id=consumer-1} -- {group_id=test-group,topics=[{topic=topic,partitions=[{partition=0}]}]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032337,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=9,api_version=2,correlation_id=13,client_id=consumer-1} -- {group_id=test-group,topics=[{topic=topic,partitions=[{partition=0}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE GroupMetadataManager:36 - [Group Metadata Manager on Broker 1]: Getting offsets of ArrayBuffer(topic-0) for group test-group. 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending offset fetch response {responses=[{topic=topic,partition_responses=[{partition=0,offset=-1,metadata=,error_code=0}]}],error_code=0} for correlation id 13 to client consumer-1. 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032337,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@4a4e6248,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 9, received {responses=[{topic=topic,partition_responses=[{partition=0,offset=-1,metadata=,error_code=0}]}],error_code=0} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=9,api_version=2,correlation_id=13,client_id=consumer-1} -- {group_id=test-group,topics=[{topic=topic,partitions=[{partition=0}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:6,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 DEBUG ConsumerCoordinator:855 - Group test-group has no committed offset for partition topic-0 2017-06-30 23:00:32 DEBUG Fetcher:363 - Resetting offset for partition topic-0 to latest offset. 2017-06-30 23:00:32 TRACE Fetcher:627 - Sending ListOffsetRequest (type=ListOffsetRequest, replicaId=-1, partitionTimestamps={topic-0=-1}, minVersion=0) to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {replica_id=-1,topics=[{topic=topic,partitions=[{partition=0,timestamp=-1}]}]} to node 1. 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=2,api_version=1,correlation_id=14,client_id=consumer-1} -- {replica_id=-1,topics=[{topic=topic,partitions=[{partition=0,timestamp=-1}]}]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032345,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=2,api_version=1,correlation_id=14,client_id=consumer-1} -- {replica_id=-1,topics=[{topic=topic,partitions=[{partition=0,timestamp=-1}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032345,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@7ecd321,SendAction) 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 2, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,timestamp=-1,offset=0}]}]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=2,api_version=1,correlation_id=14,client_id=consumer-1} -- {replica_id=-1,topics=[{topic=topic,partitions=[{partition=0,timestamp=-1}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:3,requestQueueTime:1,localTime:2,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE Fetcher:633 - Received ListOffsetResponse {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,timestamp=-1,offset=0}]}]} from broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 DEBUG Fetcher:675 - Handling ListOffsetResponse response for topic-0. Fetched offset 0, timestamp -1 2017-06-30 23:00:32 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 0 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:32 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=15,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032351,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=15,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:32 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:32 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:32 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name Fetch-:consumer-1 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name FetchThrottleTime-:consumer-1 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:32 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032351,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@54cbc913,SendAction) 2017-06-30 23:00:32 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:32 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=0},record_set=[]}]}]} 2017-06-30 23:00:32 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=15,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:521,requestQueueTime:0,localTime:10,remoteTime:505,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:32 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 0 to buffered record list 2017-06-30 23:00:32 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 0 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name topic.topic.bytes-fetched 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name topic.topic.records-fetched 2017-06-30 23:00:32 DEBUG Metrics:335 - Added sensor with name topic-0.records-lag 2017-06-30 23:00:32 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 0 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:32 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:32 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=16,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} 2017-06-30 23:00:32 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032876,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:32 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=16,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:32 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:32 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:33 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:33 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:33 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:33 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860032876,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@47f4c163,SendAction) 2017-06-30 23:00:33 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:33 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=0},record_set=[]}]}]} 2017-06-30 23:00:33 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=16,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:501,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:33 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 0 to buffered record list 2017-06-30 23:00:33 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 0 2017-06-30 23:00:33 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 0 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:33 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:33 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:33 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:33 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=17,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} 2017-06-30 23:00:33 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860033381,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:33 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=17,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:33 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:33 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:33 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:33 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:33 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:33 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860033381,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@53bdd364,SendAction) 2017-06-30 23:00:33 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:33 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=0},record_set=[]}]}]} 2017-06-30 23:00:33 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 0 to buffered record list 2017-06-30 23:00:33 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=17,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:505,requestQueueTime:0,localTime:1,remoteTime:503,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:33 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 0 2017-06-30 23:00:33 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 0 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:33 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:33 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:33 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:33 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=18,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} 2017-06-30 23:00:33 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860033887,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:33 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=18,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:33 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:33 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:34 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:34 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:34 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:34 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:34 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:34 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:34 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:00:34 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:34 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:34 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:34 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860033887,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@322977e9,SendAction) 2017-06-30 23:00:34 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:34 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=0},record_set=[]}]}]} 2017-06-30 23:00:34 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=18,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:506,requestQueueTime:1,localTime:0,remoteTime:504,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:34 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 0 to buffered record list 2017-06-30 23:00:34 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 0 2017-06-30 23:00:34 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 0 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:34 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:34 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:34 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:34 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=19,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} 2017-06-30 23:00:34 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860034394,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:34 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=19,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:34 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:34 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:34 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:34 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:34 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:34 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860034394,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@38a0b3ee,SendAction) 2017-06-30 23:00:34 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:34 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=0},record_set=[]}]}]} 2017-06-30 23:00:34 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=19,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:501,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:34 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 0 to buffered record list 2017-06-30 23:00:34 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 0 2017-06-30 23:00:34 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 0 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:34 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:34 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:34 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:34 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=20,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} 2017-06-30 23:00:34 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860034899,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:34 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=20,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:34 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:34 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:35 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} to node 2147483646. 2017-06-30 23:00:35 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=12,api_version=0,correlation_id=21,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035343,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=21,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} to node 2147483646. 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 21 to client consumer-1. 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035343,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@7b1193c4,SendAction) 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=12,api_version=0,correlation_id=11,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=21,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:2,requestQueueTime:0,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035345,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=11,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 11 to client consumer-2. 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035345,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@7f53ecd0,SendAction) 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=11,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:1,requestQueueTime:0,localTime:0,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:35 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860034899,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@593e8240,SendAction) 2017-06-30 23:00:35 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=0},record_set=[]}]}]} 2017-06-30 23:00:35 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 0 to buffered record list 2017-06-30 23:00:35 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 0 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=20,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:506,requestQueueTime:0,localTime:1,remoteTime:502,responseQueueTime:0,sendTime:3,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 0 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:35 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=22,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035407,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=22,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:35 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:544 - Requesting metadata update for topic topic. 2017-06-30 23:00:35 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:35 DEBUG NetworkClient:767 - Initialize connection to node -1 for sending metadata request 2017-06-30 23:00:35 DEBUG NetworkClient:627 - Initiating connection to node -1 at localhost:52135. 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name node--1.bytes-sent 2017-06-30 23:00:35 DEBUG Acceptor:54 - Accepted connection from /127.0.0.1:52145 on /127.0.0.1:52135 and assigned it to processor 1, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [375636|102400] 2017-06-30 23:00:35 DEBUG Processor:54 - Processor 1 listening to new connection from /127.0.0.1:52145 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name node--1.bytes-received 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name node--1.latency 2017-06-30 23:00:35 DEBUG Selector:339 - Created socket with SO_RCVBUF = 326640, SO_SNDBUF = 146988, SO_TIMEOUT = 0 to node -1 2017-06-30 23:00:35 DEBUG NetworkClient:590 - Completed connection to node -1. Fetching API versions. 2017-06-30 23:00:35 DEBUG NetworkClient:603 - Initiating API versions fetch from node -1. 2017-06-30 23:00:35 TRACE NetworkClient:292 - No version information found when sending message of type API_VERSIONS to node -1. Assuming version 0. 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {} to node -1. 2017-06-30 23:00:35 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:35 TRACE NetworkClient:443 - Found least loaded node localhost:52135 (id: -1 rack: null) 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=18,api_version=0,correlation_id=0,client_id=producer-1} -- {} 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52145,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035898,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=18,api_version=0,correlation_id=0,client_id=producer-1} -- {} from connection 127.0.0.1:52135-127.0.0.1:52145;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52145,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035898,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@20480626,SendAction) 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=18,api_version=0,correlation_id=0,client_id=producer-1} -- {} from connection 127.0.0.1:52135-127.0.0.1:52145;totalTime:1,requestQueueTime:0,localTime:1,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node -1, for key 18, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=2},{api_key=1,min_version=0,max_version=3},{api_key=2,min_version=0,max_version=1},{api_key=3,min_version=0,max_version=2},{api_key=4,min_version=0,max_version=0},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=3},{api_key=7,min_version=1,max_version=1},{api_key=8,min_version=0,max_version=2},{api_key=9,min_version=0,max_version=2},{api_key=10,min_version=0,max_version=0},{api_key=11,min_version=0,max_version=1},{api_key=12,min_version=0,max_version=0},{api_key=13,min_version=0,max_version=0},{api_key=14,min_version=0,max_version=0},{api_key=15,min_version=0,max_version=0},{api_key=16,min_version=0,max_version=0},{api_key=17,min_version=0,max_version=0},{api_key=18,min_version=0,max_version=0},{api_key=19,min_version=0,max_version=1},{api_key=20,min_version=0,max_version=0}]} 2017-06-30 23:00:35 DEBUG NetworkClient:558 - Recorded API versions for node -1: (Produce(0): 0 to 2 [usable: 2], Fetch(1): 0 to 3 [usable: 3], Offsets(2): 0 to 1 [usable: 1], Metadata(3): 0 to 2 [usable: 2], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 2 [usable: 2], OffsetFetch(9): 0 to 2 [usable: 2], GroupCoordinator(10): 0 [usable: 0], JoinGroup(11): 0 to 1 [usable: 1], Heartbeat(12): 0 [usable: 0], LeaveGroup(13): 0 [usable: 0], SyncGroup(14): 0 [usable: 0], DescribeGroups(15): 0 [usable: 0], ListGroups(16): 0 [usable: 0], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 [usable: 0], CreateTopics(19): 0 to 1 [usable: 1], DeleteTopics(20): 0 [usable: 0]) 2017-06-30 23:00:35 TRACE NetworkClient:430 - Found least loaded node localhost:52135 (id: -1 rack: null) connected with no in-flight requests 2017-06-30 23:00:35 DEBUG NetworkClient:751 - Sending metadata request (type=MetadataRequest, topics=topic) to node -1 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {topics=[topic]} to node -1. 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=3,api_version=2,correlation_id=1,client_id=producer-1} -- {topics=[topic]} 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52145,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035900,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=3,api_version=2,correlation_id=1,client_id=producer-1} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52145;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Sending topic metadata org.apache.kafka.common.requests.MetadataResponse$TopicMetadata@5cd40823 and brokers 1 : (EndPoint(localhost,52135,ListenerName(PLAINTEXT),PLAINTEXT)) : null for correlation id 1 to client producer-1 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52145,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035900,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@d49aced,SendAction) 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=3,api_version=2,correlation_id=1,client_id=producer-1} -- {topics=[topic]} from connection 127.0.0.1:52135-127.0.0.1:52145;totalTime:1,requestQueueTime:0,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node -1, for key 3, received {brokers=[{node_id=1,host=localhost,port=52135,rack=null}],cluster_id=Lxs2Pl1IS6KZ8Iyc24GUOg,controller_id=1,topic_metadata=[{topic_error_code=0,topic=topic,is_internal=false,partition_metadata=[{partition_error_code=0,partition_id=0,leader=1,replicas=[1],isr=[1]}]}]} 2017-06-30 23:00:35 DEBUG Metadata:249 - Updated cluster metadata version 2 to Cluster(id = Lxs2Pl1IS6KZ8Iyc24GUOg, nodes = [localhost:52135 (id: 1 rack: null)], partitions = [Partition(topic = topic, partition = 0, leader = 1, replicas = [1], isr = [1])]) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5c6648b0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@48f2bd5b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7b2bbc3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@a1153bc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1aafa419, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG NetworkClient:627 - Initiating connection to node 1 at localhost:52135. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@47eaca72, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@55141def, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name node-1.bytes-sent 2017-06-30 23:00:35 DEBUG Acceptor:54 - Accepted connection from /127.0.0.1:52146 on /127.0.0.1:52135 and assigned it to processor 2, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [375636|102400] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@55182842, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Processor:54 - Processor 2 listening to new connection from /127.0.0.1:52146 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3270d194, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@235834f2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name node-1.bytes-received 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5656be13, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name node-1.latency 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4218d6a3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Selector:339 - Created socket with SO_RCVBUF = 326640, SO_SNDBUF = 146988, SO_TIMEOUT = 0 to node 1 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@76505305, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG NetworkClient:590 - Completed connection to node 1. Fetching API versions. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@14cd1699, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG NetworkClient:603 - Initiating API versions fetch from node 1. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@77888435, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:292 - No version information found when sending message of type API_VERSIONS to node 1. Assuming version 0. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@73a1e9a9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {} to node 1. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@71d44a3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7b98f307, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4802796d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=18,api_version=0,correlation_id=2,client_id=producer-1} -- {} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@34123d65, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035908,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@59474f18, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=18,api_version=0,correlation_id=2,client_id=producer-1} -- {} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@65fb9ffc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035908,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@6bf6fbd8,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3e694b3f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1bb5a082, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=18,api_version=0,correlation_id=2,client_id=producer-1} -- {} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:1,requestQueueTime:0,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 18, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=2},{api_key=1,min_version=0,max_version=3},{api_key=2,min_version=0,max_version=1},{api_key=3,min_version=0,max_version=2},{api_key=4,min_version=0,max_version=0},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=3},{api_key=7,min_version=1,max_version=1},{api_key=8,min_version=0,max_version=2},{api_key=9,min_version=0,max_version=2},{api_key=10,min_version=0,max_version=0},{api_key=11,min_version=0,max_version=1},{api_key=12,min_version=0,max_version=0},{api_key=13,min_version=0,max_version=0},{api_key=14,min_version=0,max_version=0},{api_key=15,min_version=0,max_version=0},{api_key=16,min_version=0,max_version=0},{api_key=17,min_version=0,max_version=0},{api_key=18,min_version=0,max_version=0},{api_key=19,min_version=0,max_version=1},{api_key=20,min_version=0,max_version=0}]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@78691363, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG NetworkClient:558 - Recorded API versions for node 1: (Produce(0): 0 to 2 [usable: 2], Fetch(1): 0 to 3 [usable: 3], Offsets(2): 0 to 1 [usable: 1], Metadata(3): 0 to 2 [usable: 2], LeaderAndIsr(4): 0 [usable: 0], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 3 [usable: 3], ControlledShutdown(7): 1 [usable: 1], OffsetCommit(8): 0 to 2 [usable: 2], OffsetFetch(9): 0 to 2 [usable: 2], GroupCoordinator(10): 0 [usable: 0], JoinGroup(11): 0 to 1 [usable: 1], Heartbeat(12): 0 [usable: 0], LeaveGroup(13): 0 [usable: 0], SyncGroup(14): 0 [usable: 0], DescribeGroups(15): 0 [usable: 0], ListGroups(16): 0 [usable: 0], SaslHandshake(17): 0 [usable: 0], ApiVersions(18): 0 [usable: 0], CreateTopics(19): 0 to 1 [usable: 1], DeleteTopics(20): 0 [usable: 0]) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@41d477ed, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name topic.topic.records-per-batch 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name topic.topic.bytes 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@397fbdb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name topic.topic.compression-rate 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@33d512c1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name topic.topic.record-retries 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@515c6049, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name topic.topic.record-errors 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@639c2c1d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5fe94a96, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@443118b0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@765d7657, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@74235045, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=975]} to node 1. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@618b19ad, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2d3379b4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@30c15d8b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5e0e82ae, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035407,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@43c5a378,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6771beb3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@51399530, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6b2ea799, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=0},record_set=[]}]}]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@411f53a0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2279531422, CreateTime = 1498860035902, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2787771739, CreateTime = 1498860035904, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2787771739, CreateTime = 1498860035904, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=22,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:506,requestQueueTime:1,localTime:1,remoteTime:504,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2b71e916, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 0 to buffered record list 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=3,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=975]} 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035914,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 0 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=3,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=975]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@28701274, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=663]} to node 1. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@13c9d689, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 0 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3754a4bf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@62379589, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4afcd809, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1592282861, CreateTime = 1498860035910, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1592282861, CreateTime = 1498860035910, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=23,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@175c2241, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035916,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=23,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=234]} to node 1. 2017-06-30 23:00:35 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 0 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5b7a5baa, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@776aec5c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3910287030, CreateTime = 1498860035915, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3910287030, CreateTime = 1498860035915, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1d296da, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2279531422, CreateTime = 1498860035902, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2787771739, CreateTime = 1498860035904, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2787771739, CreateTime = 1498860035904, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7c7a06ec, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=156]} to node 1. 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@557caf28, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 975 bytes at offset 0 at position 0 with largest timestamp 1498860035909 at shallow offset 22 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@408d971b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=78]} to node 1. 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 975 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 0 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4039029165, CreateTime = 1498860035919, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3231201591, CreateTime = 1498860035920, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3c46e67a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@c730b35, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@206a70ef, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@292b08d6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@22555ebf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@36ebc363, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log topic-0 with first offset: 0, next offset: 25, and messages: [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2279531422, CreateTime = 1498860035902, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2787771739, CreateTime = 1498860035904, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2787771739, CreateTime = 1498860035904, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@45752059, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@34e9fd99, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [25 [0 : 975]] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3c41ed1d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 25 [0 : 975] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@54d9d12d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 0, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@38425407, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Reading 1048576 bytes from offset 0 in log topic-0 of length 975 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@43bc63a3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@702657cc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6a6cb05c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@40a4337a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6025e1b6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@22ff4249, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2d1ef81a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4c402120, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@327514f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5b12b668, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1165b38, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4c12331b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7586beff, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 975 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3b69e7d1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 1 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@815b41f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035916,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@98855cb,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5542c4ed, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:35 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1573f9fc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 975 bytes written to log topic-0 beginning at offset 0 and ending at offset 24 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6150c3ec, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 10 ms 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@44c03695, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7e6f74c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@dd05255, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6a78afa0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2f4948e4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1020, total bytes written so far: 1020, expected bytes to write: 1020 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1f2586d6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@10683d9d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=23,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=0,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:12,requestQueueTime:1,localTime:1,remoteTime:8,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3fc2959f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5aa9e4eb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6989da5e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=25},record_set=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2279531422, CreateTime = 1498860035902, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2787771739, CreateTime = 1498860035904, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2787771739, CreateTime = 1498860035904, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 992338989, CreateTime = 1498860035905, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1195688438, CreateTime = 1498860035906, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3662356608, CreateTime = 1498860035907, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3213265472, CreateTime = 1498860035908, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 579431222, CreateTime = 1498860035909, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@385c9627, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name Produce-:producer-1 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@139982de, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@682b2fa, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Metrics:335 - Added sensor with name ProduceThrottleTime-:producer-1 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@217ed35e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7dcf94f8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 0 to buffered record list 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@229f66ed, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035914,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@1c0ecad1,SendAction) 2017-06-30 23:00:35 TRACE Fetcher:818 - Received 25 records in fetch response for partition topic-0 with offset 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@31190526, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:525 - Returning fetched records at offset 0 for assigned partition topic-0 and update position to 25 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=3,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=975]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:17,requestQueueTime:1,localTime:15,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@662ac478, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=0,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=4,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6743e411, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 0 since the current position is 25 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3eb25e1a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035931,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE Sender:262 - Received produce response from node 1 with correlation id 3 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=4,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@477b4cdf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 25 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@77c2494c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 0 and error: null. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@f5958c9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@233795b6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=25,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1592282861, CreateTime = 1498860035910, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1592282861, CreateTime = 1498860035910, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=2067]} to node 1. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5bda8e08, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1e800aaa, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=24,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=25,max_bytes=1048576}]}]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@185a6e9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 663 bytes at offset 25 at position 975 with largest timestamp 1498860035914 at shallow offset 40 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6f03482, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035933,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@9d5509a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 663 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 25 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@179ece50, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=24,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=25,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3b0090a4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 25, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3cd3e762, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1fa121e2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7eac9008, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Reading 1048576 bytes from offset 25 in log topic-0 of length 1638 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4116aac9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@62ddbd7e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@74e52ef6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log topic-0 with first offset: 25, next offset: 42, and messages: [(offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1592282861, CreateTime = 1498860035910, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1592282861, CreateTime = 1498860035910, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=32,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=33,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=34,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=35,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=36,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=37,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=38,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=39,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=40,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes)), (offset=41,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6ed3ccb2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3231201591, CreateTime = 1498860035920, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=32,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=33,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=34,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=35,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=36,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=37,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=38,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=39,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=40,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1859044983, CreateTime = 1498860035929, key = 0 bytes, value = 5 bytes)), (offset=41,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1859044983, CreateTime = 1498860035929, key = 0 bytes, value = 5 bytes)), (offset=42,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=43,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=44,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=45,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=46,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=47,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=48,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=49,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=50,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=51,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=52,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1a677343, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@15de0b3c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [42 [0 : 1638]] 2017-06-30 23:00:35 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=25, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 42 [0 : 1638] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@489115ef, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 25, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3857f613, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=25,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@198b6731, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Reading 1048576 bytes from offset 25 in log topic-0 of length 1638 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7c6908d7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3c9754d8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=25,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=25,metadata=}]}]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3bf7ca37, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035939,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 663 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@79079097, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 1 fetch requests. 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035933,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@69910bea,SendAction) 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=25,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=25,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 663 bytes written to log topic-0 beginning at offset 25 and ending at offset 41 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4d1c00d0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4b2bac3f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4e08711f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@bcec361, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 9 ms 2017-06-30 23:00:35 TRACE MultiSend:88 - Bytes written as part of multi-send call: 708, total bytes written so far: 708, expected bytes to write: 708 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=42},record_set=[(offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1592282861, CreateTime = 1498860035910, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1592282861, CreateTime = 1498860035910, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286740891, CreateTime = 1498860035911, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=32,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=33,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=34,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=35,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2507348845, CreateTime = 1498860035912, key = 0 bytes, value = 5 bytes)), (offset=36,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=37,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=38,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=39,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 142408219, CreateTime = 1498860035913, key = 0 bytes, value = 5 bytes)), (offset=40,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes)), (offset=41,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@26794848, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@302552ec, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035931,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@37a5c062,SendAction) 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=24,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=25,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:9,requestQueueTime:1,localTime:2,remoteTime:4,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3d285d7e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=25,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@40005471, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:262 - Received produce response from node 1 with correlation id 4 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=4,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:13,requestQueueTime:0,localTime:11,remoteTime:0,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 25 and error: null. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2cd76f31, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=5,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=234]} 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=1248]} to node 1. 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035944,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@49438269, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=5,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=234]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@ba2f4ec, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1c1bbc4e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@55fe41ea, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3910287030, CreateTime = 1498860035915, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3910287030, CreateTime = 1498860035915, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@fbd1f6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1ce24091, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 234 bytes at offset 42 at position 1638 with largest timestamp 1498860035916 at shallow offset 45 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 234 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 42 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5dda768f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4131495157, CreateTime = 1498860035937, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4131495157, CreateTime = 1498860035937, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2317400366, CreateTime = 1498860035938, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2317400366, CreateTime = 1498860035938, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1927475864, CreateTime = 1498860035940, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1927475864, CreateTime = 1498860035940, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 243521347, CreateTime = 1498860035943, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 243521347, CreateTime = 1498860035943, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1477927861, CreateTime = 1498860035944, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2251877894, CreateTime = 1498860035945, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7a8c8dcf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log topic-0 with first offset: 42, next offset: 48, and messages: [(offset=42,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes)), (offset=43,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3910287030, CreateTime = 1498860035915, key = 0 bytes, value = 5 bytes)), (offset=44,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3910287030, CreateTime = 1498860035915, key = 0 bytes, value = 5 bytes)), (offset=45,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=46,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=47,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@24269709, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 87 bytes at offset 2 at position 626 with largest timestamp 1498860035945 at shallow offset 2 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2aceadd4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@24aed80c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 2 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3a52dba3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [48 [0 : 1872]] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2a5c8d3f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 2, next offset: 3, and messages: [(offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2251877894, CreateTime = 1498860035945, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@752325ad, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 48 [0 : 1872] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@279fedbd, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@b3ca52e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@45c7e403, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [3 [0 : 713]] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2925bf5b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@710f4dc7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 3 [0 : 713] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1ff4931d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 234 bytes written to log topic-0 beginning at offset 42 and ending at offset 47 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@65e98b1c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@61322f9d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6ad82709, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@510f3d34, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 2 and ending at offset 2 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035944,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@79073579,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7817fd62, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 6 ms 2017-06-30 23:00:35 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 2, requiredOffset: 3] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@8297b3a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 2, requiredOffset: 3] 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=5,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=234]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:9,requestQueueTime:1,localTime:7,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=42,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:35 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2362f559, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=6,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=156]} 2017-06-30 23:00:35 TRACE Sender:262 - Received produce response from node 1 with correlation id 5 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@b2c9a9c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035954,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 42 and error: null. 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=6,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=156]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4c178a76, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=1131]} to node 1. 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 156 bytes at offset 48 at position 1872 with largest timestamp 1498860035918 at shallow offset 49 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3bd82cf5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 156 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 48 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@544fa968, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@247bddad, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log topic-0 with first offset: 48, next offset: 52, and messages: [(offset=48,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=49,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes)), (offset=50,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes)), (offset=51,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@d35dea7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1477927861, CreateTime = 1498860035944, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3306717891, CreateTime = 1498860035945, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3306717891, CreateTime = 1498860035945, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 611731054, CreateTime = 1498860035947, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1102834862, CreateTime = 1498860035948, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1102834862, CreateTime = 1498860035948, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2431885465, CreateTime = 1498860035953, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2431885465, CreateTime = 1498860035953, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3969025346, CreateTime = 1498860035954, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3969025346, CreateTime = 1498860035954, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [52 [0 : 2028]] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7770f470, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035939,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@25f329ba,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5e5d171f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 52 [0 : 2028] 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=25,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=25,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:19,requestQueueTime:1,localTime:17,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@24313fcc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 25 for partition topic-0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7d20d0b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:35 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 25 to buffered record list 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@77f1baf5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:818 - Received 17 records in fetch response for partition topic-0 with offset 25 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 156 bytes written to log topic-0 beginning at offset 48 and ending at offset 51 2017-06-30 23:00:35 TRACE Fetcher:525 - Returning fetched records at offset 25 for assigned partition topic-0 and update position to 42 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@41a2befb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 25 since the current position is 42 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:35 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 42 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6c40365c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035954,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@4fc12797,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7bedc48a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=42,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=48,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@131ef10, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:262 - Received produce response from node 1 with correlation id 6 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=6,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=156]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:6,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 48 and error: null. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@55b0dcab, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=26,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=42,max_bytes=1048576}]}]} 2017-06-30 23:00:35 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=42, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=7,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=78]} 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=546]} to node 1. 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=42,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035961,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2df3b89c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035961,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=27,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=42,metadata=}]}]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@23348b5d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=26,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=42,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@70325e14, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035962,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=7,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=78]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1906140212, CreateTime = 1498860035955, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 340840180, CreateTime = 1498860035956, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 340840180, CreateTime = 1498860035956, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4114483801, CreateTime = 1498860035958, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4114483801, CreateTime = 1498860035958, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=27,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=42,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@37ceb1df, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 42, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7c9d8e2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4039029165, CreateTime = 1498860035919, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3231201591, CreateTime = 1498860035920, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2206359903, CreateTime = 1498860035963, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@20d525, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Reading 1048576 bytes from offset 42 in log topic-0 of length 2028 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6200f9cb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 87 bytes at offset 3 at position 713 with largest timestamp 1498860035963 at shallow offset 3 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 78 bytes at offset 52 at position 2028 with largest timestamp 1498860035920 at shallow offset 53 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 3 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2002fc1d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 3, next offset: 4, and messages: [(offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2206359903, CreateTime = 1498860035963, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 78 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 52 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@69453e37, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [4 [0 : 800]] 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log topic-0 with first offset: 52, next offset: 54, and messages: [(offset=52,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4039029165, CreateTime = 1498860035919, key = 0 bytes, value = 5 bytes)), (offset=53,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3231201591, CreateTime = 1498860035920, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 390 bytes 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 4 [0 : 800] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6f4a47c7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [54 [0 : 2106]] 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035961,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@29fffcf1,SendAction) 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 54 [0 : 2106] 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@ae13544, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 3 and ending at offset 3 2017-06-30 23:00:35 TRACE MultiSend:88 - Bytes written as part of multi-send call: 435, total bytes written so far: 435, expected bytes to write: 435 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3d34d211, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7dc0f706, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 3, requiredOffset: 4] 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=26,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=42,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:5,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=52},record_set=[(offset=42,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1948114880, CreateTime = 1498860035914, key = 0 bytes, value = 5 bytes)), (offset=43,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3910287030, CreateTime = 1498860035915, key = 0 bytes, value = 5 bytes)), (offset=44,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3910287030, CreateTime = 1498860035915, key = 0 bytes, value = 5 bytes)), (offset=45,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=46,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=47,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=48,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2363462774, CreateTime = 1498860035916, key = 0 bytes, value = 5 bytes)), (offset=49,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes)), (offset=50,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes)), (offset=51,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1840337115, CreateTime = 1498860035918, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 78 bytes written to log topic-0 beginning at offset 52 and ending at offset 53 2017-06-30 23:00:35 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 3, requiredOffset: 4] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4009e306, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@43c1b556, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@587e5365, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035962,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@567e48dd,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@22fcf7ab, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035961,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@16920396,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2de23121, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@63475ace, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=52,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:35 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 42 for partition topic-0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4988d8b8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=7,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=78]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:7,requestQueueTime:0,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 42 to buffered record list 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@c0c2f8d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:262 - Received produce response from node 1 with correlation id 7 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@305b7c14, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=27,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=42,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:7,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:1,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE Fetcher:818 - Received 10 records in fetch response for partition topic-0 with offset 42 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6913c1fb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 52 and error: null. 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=8,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=2067]} 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@66d18979, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:525 - Returning fetched records at offset 42 for assigned partition topic-0 and update position to 52 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=936]} to node 1. 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035969,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 42 since the current position is 52 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@609cd4d8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=8,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=2067]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@17f7cd29, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 52 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7d8704ef, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2745876143, CreateTime = 1498860035961, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1120172546, CreateTime = 1498860035963, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1120172546, CreateTime = 1498860035963, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3120968116, CreateTime = 1498860035965, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3120968116, CreateTime = 1498860035965, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3328644207, CreateTime = 1498860035966, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3328644207, CreateTime = 1498860035966, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1533605145, CreateTime = 1498860035967, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1533605145, CreateTime = 1498860035967, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@13b6aecc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=52,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@158a8276, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3c3d9b6b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=28,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=52,max_bytes=1048576}]}]} 2017-06-30 23:00:35 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=52, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035971,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@79d8407f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=28,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=52,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=52,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5fbe4146, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3231201591, CreateTime = 1498860035920, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=32,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=33,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=34,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=35,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=36,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=37,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=38,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=39,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=40,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1859044983, CreateTime = 1498860035929, key = 0 bytes, value = 5 bytes)), (offset=41,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1859044983, CreateTime = 1498860035929, key = 0 bytes, value = 5 bytes)), (offset=42,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=43,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=44,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=45,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=46,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=47,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=48,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=49,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=50,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=51,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=52,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 52, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=29,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=52,metadata=}]}]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1e66f1f5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035972,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE Log:36 - Reading 1048576 bytes from offset 52 in log topic-0 of length 2106 bytes 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=29,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=52,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4e50c791, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 2067 bytes at offset 54 at position 2106 with largest timestamp 1498860035932 at shallow offset 104 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7530ad9c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 2067 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 54 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4051184052, CreateTime = 1498860035974, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@58a9760d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 78 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@71e9ddb4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 87 bytes at offset 4 at position 800 with largest timestamp 1498860035974 at shallow offset 4 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@394df057, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035971,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@474f54d5,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4961f6af, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5aebe890, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 4 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=54},record_set=[(offset=52,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4039029165, CreateTime = 1498860035919, key = 0 bytes, value = 5 bytes)), (offset=53,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3231201591, CreateTime = 1498860035920, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 4, next offset: 5, and messages: [(offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4051184052, CreateTime = 1498860035974, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@65d09a04, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE MultiSend:88 - Bytes written as part of multi-send call: 123, total bytes written so far: 123, expected bytes to write: 123 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@33c911a1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log topic-0 with first offset: 54, next offset: 107, and messages: [(offset=54,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3231201591, CreateTime = 1498860035920, key = 0 bytes, value = 5 bytes)), (offset=55,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=56,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=57,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=58,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=59,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=60,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=61,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=62,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=63,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=64,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=65,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=66,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=67,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=68,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=69,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=70,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=71,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=72,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=73,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=74,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=75,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=76,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=77,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=78,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=79,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=80,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=81,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=82,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=83,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=84,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=85,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=86,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=87,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=88,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=89,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=90,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=91,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=92,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=93,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=94,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1859044983, CreateTime = 1498860035929, key = 0 bytes, value = 5 bytes)), (offset=95,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1859044983, CreateTime = 1498860035929, key = 0 bytes, value = 5 bytes)), (offset=96,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=97,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=98,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=99,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=100,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=101,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=102,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=103,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=104,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=105,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=106,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [5 [0 : 887]] 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=28,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=52,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:1,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@75db5df9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 5 [0 : 887] 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@707194ba, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [107 [0 : 4173]] 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 4 and ending at offset 4 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1190200a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 107 [0 : 4173] 2017-06-30 23:00:35 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 4, requiredOffset: 5] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6a2f6f80, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 4, requiredOffset: 5] 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@45b4c3a9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@399c4be1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035972,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2a105607,SendAction) 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 2067 bytes written to log topic-0 beginning at offset 54 and ending at offset 106 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@291caca8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 7 ms 2017-06-30 23:00:35 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 52 for partition topic-0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@385e9564, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=29,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=52,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:6,requestQueueTime:1,localTime:5,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5b94b04d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 52 to buffered record list 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@8c3b9d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035969,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@6c2b214d,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4c39bec8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:818 - Received 2 records in fetch response for partition topic-0 with offset 52 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@f79e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=8,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=2067]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:10,requestQueueTime:1,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE Fetcher:525 - Returning fetched records at offset 52 for assigned partition topic-0 and update position to 54 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=54,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:35 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 52 since the current position is 54 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7ee8290b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 54 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=9,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1248]} 2017-06-30 23:00:35 TRACE Sender:262 - Received produce response from node 1 with correlation id 8 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035980,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1f59a598, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=54,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=9,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1248]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 54 and error: null. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1e178745, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=30,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=54,max_bytes=1048576}]}]} 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035981,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=54, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=30,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=54,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} to node 1. 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 54, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=54,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:35 TRACE Log:36 - Reading 1048576 bytes from offset 54 in log topic-0 of length 4173 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@26b3fd41, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7494f96a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4131495157, CreateTime = 1498860035937, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4131495157, CreateTime = 1498860035937, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2317400366, CreateTime = 1498860035938, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2317400366, CreateTime = 1498860035938, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1927475864, CreateTime = 1498860035940, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1927475864, CreateTime = 1498860035940, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 243521347, CreateTime = 1498860035943, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 243521347, CreateTime = 1498860035943, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1477927861, CreateTime = 1498860035944, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@561b6512, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2240731621, CreateTime = 1498860035970, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3762516773, CreateTime = 1498860035973, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3762516773, CreateTime = 1498860035973, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1471742846, CreateTime = 1498860035976, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1471742846, CreateTime = 1498860035976, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=32,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1310035045, CreateTime = 1498860035980, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=31,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=54,metadata=}]}]} 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 2067 bytes 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2e377400, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035982,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 1248 bytes at offset 107 at position 4173 with largest timestamp 1498860035944 at shallow offset 138 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=31,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=54,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1757cd72, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035981,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@ca267fa,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@445b295b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@49e5f737, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 1248 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 107 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5c671d7f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@757277dc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223436200, CreateTime = 1498860035984, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:35 TRACE MultiSend:88 - Bytes written as part of multi-send call: 2112, total bytes written so far: 2112, expected bytes to write: 2112 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 87 bytes at offset 5 at position 887 with largest timestamp 1498860035984 at shallow offset 5 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 5 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@687e99d8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 5, next offset: 6, and messages: [(offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223436200, CreateTime = 1498860035984, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=107},record_set=[(offset=54,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3231201591, CreateTime = 1498860035920, key = 0 bytes, value = 5 bytes)), (offset=55,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=56,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=57,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1570232385, CreateTime = 1498860035921, key = 0 bytes, value = 5 bytes)), (offset=58,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=59,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=60,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=61,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 569834906, CreateTime = 1498860035922, key = 0 bytes, value = 5 bytes)), (offset=62,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=63,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=64,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3170442476, CreateTime = 1498860035923, key = 0 bytes, value = 5 bytes)), (offset=65,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=66,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=67,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=68,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3644110380, CreateTime = 1498860035924, key = 0 bytes, value = 5 bytes)), (offset=69,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=70,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=71,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=72,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=73,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=74,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=75,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1144739674, CreateTime = 1498860035925, key = 0 bytes, value = 5 bytes)), (offset=76,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=77,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=78,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=79,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=80,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=81,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 945451649, CreateTime = 1498860035926, key = 0 bytes, value = 5 bytes)), (offset=82,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=83,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=84,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=85,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=86,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=87,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2773849079, CreateTime = 1498860035927, key = 0 bytes, value = 5 bytes)), (offset=88,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=89,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=90,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=91,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=92,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=93,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4089521921, CreateTime = 1498860035928, key = 0 bytes, value = 5 bytes)), (offset=94,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1859044983, CreateTime = 1498860035929, key = 0 bytes, value = 5 bytes)), (offset=95,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1859044983, CreateTime = 1498860035929, key = 0 bytes, value = 5 bytes)), (offset=96,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=97,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=98,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=99,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 313516972, CreateTime = 1498860035930, key = 0 bytes, value = 5 bytes)), (offset=100,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=101,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=102,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=103,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2409628378, CreateTime = 1498860035931, key = 0 bytes, value = 5 bytes)), (offset=104,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=105,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=106,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=30,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=54,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 DEBUG OffsetIndex:54 - Adding index entry 107 => 4173 to 00000000000000000000.index. 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@e4487af, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [6 [0 : 974]] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6aaceffd, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 6 [0 : 974] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@c86b9e3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@10aa41f2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3af9c5b7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@37271612, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG TimeIndex:54 - Adding index entry 1498860035944 => 138 to 00000000000000000000.timeindex. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@ed7f8b4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 5 and ending at offset 5 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4c309d4d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@38102d01, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 5, requiredOffset: 6] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@37883b97, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 5, requiredOffset: 6] 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log topic-0 with first offset: 107, next offset: 139, and messages: [(offset=107,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=108,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=109,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=110,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=111,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=112,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=113,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=114,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=115,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=116,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=117,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=118,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=119,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=120,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=121,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=122,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4131495157, CreateTime = 1498860035937, key = 0 bytes, value = 5 bytes)), (offset=123,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4131495157, CreateTime = 1498860035937, key = 0 bytes, value = 5 bytes)), (offset=124,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2317400366, CreateTime = 1498860035938, key = 0 bytes, value = 5 bytes)), (offset=125,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2317400366, CreateTime = 1498860035938, key = 0 bytes, value = 5 bytes)), (offset=126,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=127,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=128,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=129,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=130,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1927475864, CreateTime = 1498860035940, key = 0 bytes, value = 5 bytes)), (offset=131,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1927475864, CreateTime = 1498860035940, key = 0 bytes, value = 5 bytes)), (offset=132,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=133,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=134,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=135,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=136,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 243521347, CreateTime = 1498860035943, key = 0 bytes, value = 5 bytes)), (offset=137,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 243521347, CreateTime = 1498860035943, key = 0 bytes, value = 5 bytes)), (offset=138,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1477927861, CreateTime = 1498860035944, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6ab778a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [139 [0 : 5421]] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4e3958e7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035982,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@4837b4b5,SendAction) 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 139 [0 : 5421] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@77f80c04, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=31,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=54,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:8,requestQueueTime:1,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 54 for partition topic-0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1dac5ef, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5c90e579, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 54 to buffered record list 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 1248 bytes written to log topic-0 beginning at offset 107 and ending at offset 138 2017-06-30 23:00:35 TRACE Fetcher:818 - Received 53 records in fetch response for partition topic-0 with offset 54 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@58ea606c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:525 - Returning fetched records at offset 54 for assigned partition topic-0 and update position to 107 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 10 ms 2017-06-30 23:00:35 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 54 since the current position is 107 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6f45df59, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 107 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@38e79ae3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035980,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@4ebf8096,SendAction) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@63070bab, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=107,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@68e5eea7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:262 - Received produce response from node 1 with correlation id 9 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=107,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=9,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1248]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:12,requestQueueTime:0,localTime:12,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 107 and error: null. 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=10,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1131]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@291b4bf5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035993,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=32,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=107,max_bytes=1048576}]}]} 2017-06-30 23:00:35 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035993,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=107, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=32,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=107,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=1209]} to node 1. 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 107, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=10,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1131]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Reading 1048576 bytes from offset 107 in log topic-0 of length 5421 bytes 2017-06-30 23:00:35 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=107,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:35 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@762ef0ea, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@31f9b85e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1310035045, CreateTime = 1498860035980, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 846506430, CreateTime = 1498860035983, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2673721426, CreateTime = 1498860035985, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3812418953, CreateTime = 1498860035986, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4203768466, CreateTime = 1498860035990, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4203768466, CreateTime = 1498860035990, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@424e1977, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1477927861, CreateTime = 1498860035944, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3306717891, CreateTime = 1498860035945, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3306717891, CreateTime = 1498860035945, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 611731054, CreateTime = 1498860035947, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1102834862, CreateTime = 1498860035948, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1102834862, CreateTime = 1498860035948, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2431885465, CreateTime = 1498860035953, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2431885465, CreateTime = 1498860035953, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3969025346, CreateTime = 1498860035954, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3969025346, CreateTime = 1498860035954, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1248 bytes 2017-06-30 23:00:35 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=33,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=107,metadata=}]}]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@10d68fcd, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035994,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:35 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035993,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@6d0df3df,SendAction) 2017-06-30 23:00:35 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=33,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=107,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@117e949d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 1131 bytes at offset 139 at position 5421 with largest timestamp 1498860035954 at shallow offset 166 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6db9f5a4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1293, total bytes written so far: 1293, expected bytes to write: 1293 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5f8edcc5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7b02881e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 889898139, CreateTime = 1498860035996, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 1131 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 139 2017-06-30 23:00:35 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=32,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=107,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1ebd319f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=139},record_set=[(offset=107,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3933055002, CreateTime = 1498860035932, key = 0 bytes, value = 5 bytes)), (offset=108,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=109,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=110,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=111,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=112,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 184773815, CreateTime = 1498860035934, key = 0 bytes, value = 5 bytes)), (offset=113,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=114,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=115,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=116,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=117,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2517405121, CreateTime = 1498860035935, key = 0 bytes, value = 5 bytes)), (offset=118,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=119,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=120,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=121,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1800306051, CreateTime = 1498860035936, key = 0 bytes, value = 5 bytes)), (offset=122,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4131495157, CreateTime = 1498860035937, key = 0 bytes, value = 5 bytes)), (offset=123,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4131495157, CreateTime = 1498860035937, key = 0 bytes, value = 5 bytes)), (offset=124,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2317400366, CreateTime = 1498860035938, key = 0 bytes, value = 5 bytes)), (offset=125,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2317400366, CreateTime = 1498860035938, key = 0 bytes, value = 5 bytes)), (offset=126,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=127,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=128,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=129,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 388978776, CreateTime = 1498860035939, key = 0 bytes, value = 5 bytes)), (offset=130,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1927475864, CreateTime = 1498860035940, key = 0 bytes, value = 5 bytes)), (offset=131,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1927475864, CreateTime = 1498860035940, key = 0 bytes, value = 5 bytes)), (offset=132,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=133,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=134,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=135,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4025291758, CreateTime = 1498860035941, key = 0 bytes, value = 5 bytes)), (offset=136,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 243521347, CreateTime = 1498860035943, key = 0 bytes, value = 5 bytes)), (offset=137,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 243521347, CreateTime = 1498860035943, key = 0 bytes, value = 5 bytes)), (offset=138,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1477927861, CreateTime = 1498860035944, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3c0be339, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Inserting 87 bytes at offset 6 at position 974 with largest timestamp 1498860035996 at shallow offset 6 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@15ca7889, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log topic-0 with first offset: 139, next offset: 168, and messages: [(offset=139,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1477927861, CreateTime = 1498860035944, key = 0 bytes, value = 5 bytes)), (offset=140,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3306717891, CreateTime = 1498860035945, key = 0 bytes, value = 5 bytes)), (offset=141,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3306717891, CreateTime = 1498860035945, key = 0 bytes, value = 5 bytes)), (offset=142,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=143,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=144,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=145,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=146,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=147,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 611731054, CreateTime = 1498860035947, key = 0 bytes, value = 5 bytes)), (offset=148,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1102834862, CreateTime = 1498860035948, key = 0 bytes, value = 5 bytes)), (offset=149,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1102834862, CreateTime = 1498860035948, key = 0 bytes, value = 5 bytes)), (offset=150,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=151,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=152,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=153,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=154,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=155,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=156,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=157,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=158,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=159,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=160,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=161,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=162,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=163,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=164,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2431885465, CreateTime = 1498860035953, key = 0 bytes, value = 5 bytes)), (offset=165,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2431885465, CreateTime = 1498860035953, key = 0 bytes, value = 5 bytes)), (offset=166,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3969025346, CreateTime = 1498860035954, key = 0 bytes, value = 5 bytes)), (offset=167,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3969025346, CreateTime = 1498860035954, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7a675056, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 6 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@d21a74c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6e509ffa, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 6, next offset: 7, and messages: [(offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 889898139, CreateTime = 1498860035996, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2898ac89, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [168 [0 : 6552]] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@683dbc2c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@68267da0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 168 [0 : 6552] 2017-06-30 23:00:35 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2638011, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:35 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [7 [0 : 1061]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6ff29830, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6a2b953e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 7 [0 : 1061] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@313b2ea6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2f465398, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@548e6d58, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 1131 bytes written to log topic-0 beginning at offset 139 and ending at offset 167 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@623a8092, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@a1cdc6d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 7 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@175b9425, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 6 and ending at offset 6 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035993,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@66374728,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3098cf3b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 6 ms 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=139,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 6, requiredOffset: 7] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@610f7aa, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 6, requiredOffset: 7] 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=10,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1131]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:9,requestQueueTime:0,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 10 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6a03bcb1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=11,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 139 and error: null. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036002,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860035994,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@532323ea,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@21b2e768, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=1170]} to node 1. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=11,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=33,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=107,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:9,requestQueueTime:1,localTime:8,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 107 for partition topic-0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1906140212, CreateTime = 1498860035955, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 340840180, CreateTime = 1498860035956, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 340840180, CreateTime = 1498860035956, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4114483801, CreateTime = 1498860035958, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4114483801, CreateTime = 1498860035958, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 107 to buffered record list 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 546 bytes at offset 168 at position 6552 with largest timestamp 1498860035960 at shallow offset 179 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5609159b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2886000228, CreateTime = 1498860035993, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3496344511, CreateTime = 1498860035994, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 682078217, CreateTime = 1498860035996, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 682078217, CreateTime = 1498860035996, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2118cddf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 546 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 168 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 32 records in fetch response for partition topic-0 with offset 107 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@17a7f733, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 107 for assigned partition topic-0 and update position to 139 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@68567e20, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 168, next offset: 182, and messages: [(offset=168,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1906140212, CreateTime = 1498860035955, key = 0 bytes, value = 5 bytes)), (offset=169,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 340840180, CreateTime = 1498860035956, key = 0 bytes, value = 5 bytes)), (offset=170,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 340840180, CreateTime = 1498860035956, key = 0 bytes, value = 5 bytes)), (offset=171,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=172,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=173,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=174,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4114483801, CreateTime = 1498860035958, key = 0 bytes, value = 5 bytes)), (offset=175,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4114483801, CreateTime = 1498860035958, key = 0 bytes, value = 5 bytes)), (offset=176,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=177,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=178,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=179,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes)), (offset=180,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes)), (offset=181,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 107 since the current position is 139 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@76ed1b7c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [182 [0 : 7098]] 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 139 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 182 [0 : 7098] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@11fc564b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@394a2528, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 546 bytes written to log topic-0 beginning at offset 168 and ending at offset 181 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=139,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6236eb5f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=139, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036002,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2644a727,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7c1e2a9e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=139,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=34,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=139,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=11,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:5,requestQueueTime:1,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=168,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@fa36558, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=12,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=936]} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 11 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036007,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036008,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 168 and error: null. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=35,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=139,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@672872e1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036008,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=12,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=936]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=34,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=139,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=429]} to node 1. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=35,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=139,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 139, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3588571211, CreateTime = 1498860036003, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2955471499, CreateTime = 1498860036004, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2955471499, CreateTime = 1498860036004, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1363553830, CreateTime = 1498860036006, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1363553830, CreateTime = 1498860036006, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2745876143, CreateTime = 1498860035961, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1120172546, CreateTime = 1498860035963, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1120172546, CreateTime = 1498860035963, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3120968116, CreateTime = 1498860035965, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3120968116, CreateTime = 1498860035965, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3328644207, CreateTime = 1498860035966, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3328644207, CreateTime = 1498860035966, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1533605145, CreateTime = 1498860035967, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1533605145, CreateTime = 1498860035967, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3770138922, CreateTime = 1498860036009, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 139 in log topic-0 of length 7098 bytes 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 7 at position 1061 with largest timestamp 1498860036009 at shallow offset 7 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3f56875e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 7 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 936 bytes at offset 182 at position 7098 with largest timestamp 1498860035969 at shallow offset 203 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 7, next offset: 8, and messages: [(offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3770138922, CreateTime = 1498860036009, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2b4bac49, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1677 bytes 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 936 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 182 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [8 [0 : 1148]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@fd07cbb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 8 [0 : 1148] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036007,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@3b4392fb,SendAction) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 182, next offset: 206, and messages: [(offset=182,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2745876143, CreateTime = 1498860035961, key = 0 bytes, value = 5 bytes)), (offset=183,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=184,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=185,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=186,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=187,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1120172546, CreateTime = 1498860035963, key = 0 bytes, value = 5 bytes)), (offset=188,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1120172546, CreateTime = 1498860035963, key = 0 bytes, value = 5 bytes)), (offset=189,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=190,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=191,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=192,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3120968116, CreateTime = 1498860035965, key = 0 bytes, value = 5 bytes)), (offset=193,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3120968116, CreateTime = 1498860035965, key = 0 bytes, value = 5 bytes)), (offset=194,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3328644207, CreateTime = 1498860035966, key = 0 bytes, value = 5 bytes)), (offset=195,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3328644207, CreateTime = 1498860035966, key = 0 bytes, value = 5 bytes)), (offset=196,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1533605145, CreateTime = 1498860035967, key = 0 bytes, value = 5 bytes)), (offset=197,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1533605145, CreateTime = 1498860035967, key = 0 bytes, value = 5 bytes)), (offset=198,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=199,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=200,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=201,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=202,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=203,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=204,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=205,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3571b748, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1722, total bytes written so far: 1722, expected bytes to write: 1722 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 7 and ending at offset 7 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [206 [0 : 8034]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3e96bacf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 206 [0 : 8034] 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=34,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=139,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:5,requestQueueTime:1,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=182},record_set=[(offset=139,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1477927861, CreateTime = 1498860035944, key = 0 bytes, value = 5 bytes)), (offset=140,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3306717891, CreateTime = 1498860035945, key = 0 bytes, value = 5 bytes)), (offset=141,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3306717891, CreateTime = 1498860035945, key = 0 bytes, value = 5 bytes)), (offset=142,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=143,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=144,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=145,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=146,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3111757592, CreateTime = 1498860035946, key = 0 bytes, value = 5 bytes)), (offset=147,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 611731054, CreateTime = 1498860035947, key = 0 bytes, value = 5 bytes)), (offset=148,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1102834862, CreateTime = 1498860035948, key = 0 bytes, value = 5 bytes)), (offset=149,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1102834862, CreateTime = 1498860035948, key = 0 bytes, value = 5 bytes)), (offset=150,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=151,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=152,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=153,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3702787544, CreateTime = 1498860035949, key = 0 bytes, value = 5 bytes)), (offset=154,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=155,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=156,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=157,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2698323971, CreateTime = 1498860035950, key = 0 bytes, value = 5 bytes)), (offset=158,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=159,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=160,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1037748597, CreateTime = 1498860035951, key = 0 bytes, value = 5 bytes)), (offset=161,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=162,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=163,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 234635759, CreateTime = 1498860035952, key = 0 bytes, value = 5 bytes)), (offset=164,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2431885465, CreateTime = 1498860035953, key = 0 bytes, value = 5 bytes)), (offset=165,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2431885465, CreateTime = 1498860035953, key = 0 bytes, value = 5 bytes)), (offset=166,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3969025346, CreateTime = 1498860035954, key = 0 bytes, value = 5 bytes)), (offset=167,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3969025346, CreateTime = 1498860035954, key = 0 bytes, value = 5 bytes)), (offset=168,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1906140212, CreateTime = 1498860035955, key = 0 bytes, value = 5 bytes)), (offset=169,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 340840180, CreateTime = 1498860035956, key = 0 bytes, value = 5 bytes)), (offset=170,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 340840180, CreateTime = 1498860035956, key = 0 bytes, value = 5 bytes)), (offset=171,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=172,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=173,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2304716674, CreateTime = 1498860035957, key = 0 bytes, value = 5 bytes)), (offset=174,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4114483801, CreateTime = 1498860035958, key = 0 bytes, value = 5 bytes)), (offset=175,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4114483801, CreateTime = 1498860035958, key = 0 bytes, value = 5 bytes)), (offset=176,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=177,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=178,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1748101935, CreateTime = 1498860035959, key = 0 bytes, value = 5 bytes)), (offset=179,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes)), (offset=180,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes)), (offset=181,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1051025369, CreateTime = 1498860035960, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@484970b0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 7, requiredOffset: 8] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 936 bytes written to log topic-0 beginning at offset 182 and ending at offset 205 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4470f8a6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 7, requiredOffset: 8] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7c83dc97, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036008,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@144d3849,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7748410a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=182,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@740773a3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=12,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=936]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:7,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@37f1104d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 12 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@55740540, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036008,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@489f33ef,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@60015ef5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 182 and error: null. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=13,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2f54a33d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=35,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=139,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:8,requestQueueTime:0,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036016,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=13,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 139 for partition topic-0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@65b3f4a4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=546]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@f2ff811, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 139 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@568ff82, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2240731621, CreateTime = 1498860035970, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3762516773, CreateTime = 1498860035973, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3762516773, CreateTime = 1498860035973, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1471742846, CreateTime = 1498860035976, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1471742846, CreateTime = 1498860035976, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=32,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1310035045, CreateTime = 1498860035980, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 43 records in fetch response for partition topic-0 with offset 139 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@50caa560, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2598206374, CreateTime = 1498860036008, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2075377419, CreateTime = 1498860036010, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2075377419, CreateTime = 1498860036010, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3871104637, CreateTime = 1498860036011, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3871104637, CreateTime = 1498860036011, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2205283517, CreateTime = 1498860036012, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 511579595, CreateTime = 1498860036013, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 1287 bytes at offset 206 at position 8034 with largest timestamp 1498860035980 at shallow offset 238 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2a266d09, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 139 for assigned partition topic-0 and update position to 182 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5ab9e72c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 1287 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 206 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@186f8716, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 139 since the current position is 182 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1d8bd0de, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 182 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@45ca843, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 206, next offset: 239, and messages: [(offset=206,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=207,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2240731621, CreateTime = 1498860035970, key = 0 bytes, value = 5 bytes)), (offset=208,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=209,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=210,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=211,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=212,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=213,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=214,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=215,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=216,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3762516773, CreateTime = 1498860035973, key = 0 bytes, value = 5 bytes)), (offset=217,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3762516773, CreateTime = 1498860035973, key = 0 bytes, value = 5 bytes)), (offset=218,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=219,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=220,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=221,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=222,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=223,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=224,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=225,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1471742846, CreateTime = 1498860035976, key = 0 bytes, value = 5 bytes)), (offset=226,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1471742846, CreateTime = 1498860035976, key = 0 bytes, value = 5 bytes)), (offset=227,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=228,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=229,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=230,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=231,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=232,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=233,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=234,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=235,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=236,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=237,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=238,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1310035045, CreateTime = 1498860035980, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@11c9af63, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [239 [0 : 9321]] 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=182,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 239 [0 : 9321] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@757acd7b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=36,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=182,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=182, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036020,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=36,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=182,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=182,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@36b4fe2a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 182, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 182 in log topic-0 of length 9321 bytes 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=37,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=182,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@574b560f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036020,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 1287 bytes written to log topic-0 beginning at offset 206 and ending at offset 238 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=37,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=182,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@ba54932, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@28975c28, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3943a2be, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036016,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2e96565,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@343570b7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@157853da, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 2223 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@71c3b41, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=13,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:6,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=206,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 48720507, CreateTime = 1498860036022, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=14,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1209]} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 13 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 8 at position 1148 with largest timestamp 1498860036022 at shallow offset 8 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@236e3f4e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036020,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@61780ba,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3cc1435c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 8 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 206 and error: null. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036023,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 8, next offset: 9, and messages: [(offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 48720507, CreateTime = 1498860036022, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 2268, total bytes written so far: 2268, expected bytes to write: 2268 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6bf0219d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=14,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1209]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [9 [0 : 1235]] 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=239},record_set=[(offset=182,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2745876143, CreateTime = 1498860035961, key = 0 bytes, value = 5 bytes)), (offset=183,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=184,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=185,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=186,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3754662772, CreateTime = 1498860035962, key = 0 bytes, value = 5 bytes)), (offset=187,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1120172546, CreateTime = 1498860035963, key = 0 bytes, value = 5 bytes)), (offset=188,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1120172546, CreateTime = 1498860035963, key = 0 bytes, value = 5 bytes)), (offset=189,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=190,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=191,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 654954690, CreateTime = 1498860035964, key = 0 bytes, value = 5 bytes)), (offset=192,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3120968116, CreateTime = 1498860035965, key = 0 bytes, value = 5 bytes)), (offset=193,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3120968116, CreateTime = 1498860035965, key = 0 bytes, value = 5 bytes)), (offset=194,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3328644207, CreateTime = 1498860035966, key = 0 bytes, value = 5 bytes)), (offset=195,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3328644207, CreateTime = 1498860035966, key = 0 bytes, value = 5 bytes)), (offset=196,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1533605145, CreateTime = 1498860035967, key = 0 bytes, value = 5 bytes)), (offset=197,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1533605145, CreateTime = 1498860035967, key = 0 bytes, value = 5 bytes)), (offset=198,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=199,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=200,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=201,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=202,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1692409160, CreateTime = 1498860035968, key = 0 bytes, value = 5 bytes)), (offset=203,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=204,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=205,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=206,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4193254462, CreateTime = 1498860035969, key = 0 bytes, value = 5 bytes)), (offset=207,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2240731621, CreateTime = 1498860035970, key = 0 bytes, value = 5 bytes)), (offset=208,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=209,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=210,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=211,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=212,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 411121811, CreateTime = 1498860035971, key = 0 bytes, value = 5 bytes)), (offset=213,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=214,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=215,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2102170195, CreateTime = 1498860035972, key = 0 bytes, value = 5 bytes)), (offset=216,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3762516773, CreateTime = 1498860035973, key = 0 bytes, value = 5 bytes)), (offset=217,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3762516773, CreateTime = 1498860035973, key = 0 bytes, value = 5 bytes)), (offset=218,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=219,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=220,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2619496190, CreateTime = 1498860035974, key = 0 bytes, value = 5 bytes)), (offset=221,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=222,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=223,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=224,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 19773320, CreateTime = 1498860035975, key = 0 bytes, value = 5 bytes)), (offset=225,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1471742846, CreateTime = 1498860035976, key = 0 bytes, value = 5 bytes)), (offset=226,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1471742846, CreateTime = 1498860035976, key = 0 bytes, value = 5 bytes)), (offset=227,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=228,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=229,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3400983048, CreateTime = 1498860035977, key = 0 bytes, value = 5 bytes)), (offset=230,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=231,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=232,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3067594707, CreateTime = 1498860035978, key = 0 bytes, value = 5 bytes)), (offset=233,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=234,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=235,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=236,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=237,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 735585957, CreateTime = 1498860035979, key = 0 bytes, value = 5 bytes)), (offset=238,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1310035045, CreateTime = 1498860035980, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 9 [0 : 1235] 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=36,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=182,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1310035045, CreateTime = 1498860035980, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 846506430, CreateTime = 1498860035983, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2673721426, CreateTime = 1498860035985, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3812418953, CreateTime = 1498860035986, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4203768466, CreateTime = 1498860035990, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4203768466, CreateTime = 1498860035990, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=858]} to node 1. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 1209 bytes at offset 239 at position 9321 with largest timestamp 1498860035992 at shallow offset 267 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 8 and ending at offset 8 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 1209 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 239 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5f16132a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG OffsetIndex:54 - Adding index entry 239 => 9321 to 00000000000000000000.index. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3476445692, CreateTime = 1498860036016, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3600471783, CreateTime = 1498860036020, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3600471783, CreateTime = 1498860036020, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1268070289, CreateTime = 1498860036021, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2868638524, CreateTime = 1498860036023, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 8, requiredOffset: 9] 2017-06-30 23:00:36 DEBUG TimeIndex:54 - Adding index entry 1498860035992 => 267 to 00000000000000000000.timeindex. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@69fb6037, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 8, requiredOffset: 9] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@36d585c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 239, next offset: 270, and messages: [(offset=239,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1310035045, CreateTime = 1498860035980, key = 0 bytes, value = 5 bytes)), (offset=240,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=241,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=242,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=243,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=244,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 846506430, CreateTime = 1498860035983, key = 0 bytes, value = 5 bytes)), (offset=245,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=246,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=247,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=248,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=249,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=250,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2673721426, CreateTime = 1498860035985, key = 0 bytes, value = 5 bytes)), (offset=251,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3812418953, CreateTime = 1498860035986, key = 0 bytes, value = 5 bytes)), (offset=252,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=253,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=254,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=255,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=256,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=257,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=258,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=259,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=260,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=261,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=262,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4203768466, CreateTime = 1498860035990, key = 0 bytes, value = 5 bytes)), (offset=263,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4203768466, CreateTime = 1498860035990, key = 0 bytes, value = 5 bytes)), (offset=264,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=265,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=266,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=267,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes)), (offset=268,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes)), (offset=269,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@87a85e1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [270 [0 : 10530]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@671a5887, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036020,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@1179780,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5552768b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 270 [0 : 10530] 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=37,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=182,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:8,requestQueueTime:1,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3c947bc5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 182 for partition topic-0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@609db43b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 182 to buffered record list 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 1209 bytes written to log topic-0 beginning at offset 239 and ending at offset 269 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 57 records in fetch response for partition topic-0 with offset 182 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@55f616cf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 182 for assigned partition topic-0 and update position to 239 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 182 since the current position is 239 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1356d4d4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036023,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@7ce5689b,SendAction) 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 239 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@c03cf28, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=14,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1209]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:7,requestQueueTime:0,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=239,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=15,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1170]} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 14 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036030,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1329eff, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=15,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1170]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 239 and error: null. 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=239,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6497b078, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=239, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=507]} to node 1. 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=239,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2886000228, CreateTime = 1498860035993, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3496344511, CreateTime = 1498860035994, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 682078217, CreateTime = 1498860035996, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 682078217, CreateTime = 1498860035996, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=38,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=239,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036031,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=39,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=239,metadata=}]}]} 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2868638524, CreateTime = 1498860036023, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 486638439, CreateTime = 1498860036026, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 486638439, CreateTime = 1498860036026, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2148426257, CreateTime = 1498860036027, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2148426257, CreateTime = 1498860036027, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 78449788, CreateTime = 1498860036030, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 78449788, CreateTime = 1498860036030, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036031,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=38,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=239,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@53aad5d5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 1170 bytes at offset 270 at position 10530 with largest timestamp 1498860036002 at shallow offset 297 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@46fa7c39, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 239, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=39,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=239,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 239 in log topic-0 of length 11700 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1fb700ee, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 1170 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 270 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4f67eb2a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1559261332, CreateTime = 1498860036034, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4a668b6e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 9 at position 1235 with largest timestamp 1498860036034 at shallow offset 9 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1209 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5f683daf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036031,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@1995ba35,SendAction) 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 270, next offset: 300, and messages: [(offset=270,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2886000228, CreateTime = 1498860035993, key = 0 bytes, value = 5 bytes)), (offset=271,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3496344511, CreateTime = 1498860035994, key = 0 bytes, value = 5 bytes)), (offset=272,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=273,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=274,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=275,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=276,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 682078217, CreateTime = 1498860035996, key = 0 bytes, value = 5 bytes)), (offset=277,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 682078217, CreateTime = 1498860035996, key = 0 bytes, value = 5 bytes)), (offset=278,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=279,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=280,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=281,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=282,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=283,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=284,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=285,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=286,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=287,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=288,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=289,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=290,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=291,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=292,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=293,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=294,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=295,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=296,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=297,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes)), (offset=298,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes)), (offset=299,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [300 [0 : 11700]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 300 [0 : 11700] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 9 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=270},record_set=[(offset=239,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1310035045, CreateTime = 1498860035980, key = 0 bytes, value = 5 bytes)), (offset=240,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=241,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=242,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=243,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2944092360, CreateTime = 1498860035982, key = 0 bytes, value = 5 bytes)), (offset=244,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 846506430, CreateTime = 1498860035983, key = 0 bytes, value = 5 bytes)), (offset=245,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=246,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=247,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=248,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=249,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 38936868, CreateTime = 1498860035984, key = 0 bytes, value = 5 bytes)), (offset=250,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2673721426, CreateTime = 1498860035985, key = 0 bytes, value = 5 bytes)), (offset=251,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3812418953, CreateTime = 1498860035986, key = 0 bytes, value = 5 bytes)), (offset=252,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=253,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=254,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=255,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2117272831, CreateTime = 1498860035987, key = 0 bytes, value = 5 bytes)), (offset=256,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=257,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=258,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 469675583, CreateTime = 1498860035988, key = 0 bytes, value = 5 bytes)), (offset=259,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=260,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=261,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2263961417, CreateTime = 1498860035989, key = 0 bytes, value = 5 bytes)), (offset=262,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4203768466, CreateTime = 1498860035990, key = 0 bytes, value = 5 bytes)), (offset=263,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4203768466, CreateTime = 1498860035990, key = 0 bytes, value = 5 bytes)), (offset=264,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=265,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=266,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1738509284, CreateTime = 1498860035991, key = 0 bytes, value = 5 bytes)), (offset=267,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes)), (offset=268,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes)), (offset=269,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 822820626, CreateTime = 1498860035992, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1254, total bytes written so far: 1254, expected bytes to write: 1254 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@78ffe6dc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=38,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=239,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:10,requestQueueTime:1,localTime:2,remoteTime:0,responseQueueTime:1,sendTime:6,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@8317c52, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 1170 bytes written to log topic-0 beginning at offset 270 and ending at offset 299 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 9, next offset: 10, and messages: [(offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1559261332, CreateTime = 1498860036034, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 11 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@76f2bbc1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036030,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@4dd42ca3,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@68e965f5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [10 [0 : 1322]] 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=15,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1170]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:12,requestQueueTime:0,localTime:12,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=270,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6f27a732, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=16,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=429]} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 15 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 10 [0 : 1322] 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 270 and error: null. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036043,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6c779568, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=16,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=429]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=468]} to node 1. 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2577591562, CreateTime = 1498860036031, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 626649785, CreateTime = 1498860036032, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3092646863, CreateTime = 1498860036033, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3092646863, CreateTime = 1498860036033, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1496895330, CreateTime = 1498860036035, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2333021689, CreateTime = 1498860036041, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3588571211, CreateTime = 1498860036003, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2955471499, CreateTime = 1498860036004, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2955471499, CreateTime = 1498860036004, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1363553830, CreateTime = 1498860036006, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1363553830, CreateTime = 1498860036006, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2cdd0d4b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 9 and ending at offset 9 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 429 bytes at offset 300 at position 11700 with largest timestamp 1498860036007 at shallow offset 308 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7e9131d5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 429 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 300 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 11 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2e1d27ba, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@61d6015a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 9, requiredOffset: 10] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2525ff7e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 300, next offset: 311, and messages: [(offset=300,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3588571211, CreateTime = 1498860036003, key = 0 bytes, value = 5 bytes)), (offset=301,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2955471499, CreateTime = 1498860036004, key = 0 bytes, value = 5 bytes)), (offset=302,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2955471499, CreateTime = 1498860036004, key = 0 bytes, value = 5 bytes)), (offset=303,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=304,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=305,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=306,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1363553830, CreateTime = 1498860036006, key = 0 bytes, value = 5 bytes)), (offset=307,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1363553830, CreateTime = 1498860036006, key = 0 bytes, value = 5 bytes)), (offset=308,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes)), (offset=309,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes)), (offset=310,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@524d6d96, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 9, requiredOffset: 10] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@152aa092, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@44a7bfbc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4ef37659, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [311 [0 : 12129]] 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036031,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@4dfaa31,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@776b83cc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 311 [0 : 12129] 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=39,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=239,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:17,requestQueueTime:1,localTime:15,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@37858383, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 239 for partition topic-0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4e268090, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 239 to buffered record list 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 31 records in fetch response for partition topic-0 with offset 239 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1bb266b3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 239 for assigned partition topic-0 and update position to 270 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 429 bytes written to log topic-0 beginning at offset 300 and ending at offset 310 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 239 since the current position is 270 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@306cf3ea, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 270 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2beee7ff, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=270,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036043,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@39c986bd,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5136d012, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=270, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=16,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=429]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:7,requestQueueTime:0,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=40,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=270,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5939a379, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036050,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=17,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=300,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036050,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=270,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=17,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 16 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 300 and error: null. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=41,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=270,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=40,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=270,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036051,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@e1de817, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 270, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=41,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=270,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2598206374, CreateTime = 1498860036008, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2075377419, CreateTime = 1498860036010, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2075377419, CreateTime = 1498860036010, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3871104637, CreateTime = 1498860036011, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3871104637, CreateTime = 1498860036011, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2205283517, CreateTime = 1498860036012, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 511579595, CreateTime = 1498860036013, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 270 in log topic-0 of length 12129 bytes 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 546 bytes at offset 311 at position 12129 with largest timestamp 1498860036015 at shallow offset 321 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 546 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 311 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2617231359, CreateTime = 1498860036054, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=702]} to node 1. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1599 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036050,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@1b0431d3,SendAction) 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 311, next offset: 325, and messages: [(offset=311,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2598206374, CreateTime = 1498860036008, key = 0 bytes, value = 5 bytes)), (offset=312,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2075377419, CreateTime = 1498860036010, key = 0 bytes, value = 5 bytes)), (offset=313,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2075377419, CreateTime = 1498860036010, key = 0 bytes, value = 5 bytes)), (offset=314,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3871104637, CreateTime = 1498860036011, key = 0 bytes, value = 5 bytes)), (offset=315,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3871104637, CreateTime = 1498860036011, key = 0 bytes, value = 5 bytes)), (offset=316,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2205283517, CreateTime = 1498860036012, key = 0 bytes, value = 5 bytes)), (offset=317,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 511579595, CreateTime = 1498860036013, key = 0 bytes, value = 5 bytes)), (offset=318,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=319,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=320,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=321,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=322,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=323,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=324,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 10 at position 1322 with largest timestamp 1498860036054 at shallow offset 10 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1644, total bytes written so far: 1644, expected bytes to write: 1644 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1784795476, CreateTime = 1498860036043, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2460195554, CreateTime = 1498860036045, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2460195554, CreateTime = 1498860036045, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1139529429, CreateTime = 1498860036048, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1139529429, CreateTime = 1498860036048, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3541cb24, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=40,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=270,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:6,requestQueueTime:0,localTime:5,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [325 [0 : 12675]] 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=311},record_set=[(offset=270,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2886000228, CreateTime = 1498860035993, key = 0 bytes, value = 5 bytes)), (offset=271,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3496344511, CreateTime = 1498860035994, key = 0 bytes, value = 5 bytes)), (offset=272,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=273,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=274,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=275,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1298799305, CreateTime = 1498860035995, key = 0 bytes, value = 5 bytes)), (offset=276,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 682078217, CreateTime = 1498860035996, key = 0 bytes, value = 5 bytes)), (offset=277,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 682078217, CreateTime = 1498860035996, key = 0 bytes, value = 5 bytes)), (offset=278,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=279,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=280,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047707007, CreateTime = 1498860035997, key = 0 bytes, value = 5 bytes)), (offset=281,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=282,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=283,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=284,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3385423012, CreateTime = 1498860035998, key = 0 bytes, value = 5 bytes)), (offset=285,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=286,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=287,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=288,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1422300626, CreateTime = 1498860035999, key = 0 bytes, value = 5 bytes)), (offset=289,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=290,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=291,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=292,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2844026256, CreateTime = 1498860036000, key = 0 bytes, value = 5 bytes)), (offset=293,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=294,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=295,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=296,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 881558758, CreateTime = 1498860036001, key = 0 bytes, value = 5 bytes)), (offset=297,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes)), (offset=298,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes)), (offset=299,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1223336253, CreateTime = 1498860036002, key = 0 bytes, value = 5 bytes)), (offset=300,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3588571211, CreateTime = 1498860036003, key = 0 bytes, value = 5 bytes)), (offset=301,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2955471499, CreateTime = 1498860036004, key = 0 bytes, value = 5 bytes)), (offset=302,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2955471499, CreateTime = 1498860036004, key = 0 bytes, value = 5 bytes)), (offset=303,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=304,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=305,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 757533693, CreateTime = 1498860036005, key = 0 bytes, value = 5 bytes)), (offset=306,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1363553830, CreateTime = 1498860036006, key = 0 bytes, value = 5 bytes)), (offset=307,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1363553830, CreateTime = 1498860036006, key = 0 bytes, value = 5 bytes)), (offset=308,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes)), (offset=309,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes)), (offset=310,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3427389264, CreateTime = 1498860036007, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 10 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 325 [0 : 12675] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2177849e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 10, next offset: 11, and messages: [(offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2617231359, CreateTime = 1498860036054, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@40cb8df7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 546 bytes written to log topic-0 beginning at offset 311 and ending at offset 324 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 7 ms 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [11 [0 : 1409]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@13b13b5d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 11 [0 : 1409] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2892dae4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036050,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@6e3f90af,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@355ce81c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=17,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:8,requestQueueTime:1,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=311,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@29647f75, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 17 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=18,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=858]} 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036059,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 311 and error: null. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3315d2d7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=18,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=858]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 10 and ending at offset 10 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=312]} to node 1. 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 6 ms 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 10, requiredOffset: 11] 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 640056341, CreateTime = 1498860036055, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1890765027, CreateTime = 1498860036056, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3988597141, CreateTime = 1498860036057, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 10, requiredOffset: 11] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3476445692, CreateTime = 1498860036016, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3600471783, CreateTime = 1498860036020, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3600471783, CreateTime = 1498860036020, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1268070289, CreateTime = 1498860036021, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2868638524, CreateTime = 1498860036023, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5fa07e12, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 858 bytes at offset 325 at position 12675 with largest timestamp 1498860036023 at shallow offset 346 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@55b53d44, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036051,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@26218ff,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@482bce4f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 858 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 325 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=41,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=270,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:10,requestQueueTime:1,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@366647c2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 270 for partition topic-0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 325, next offset: 347, and messages: [(offset=325,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3476445692, CreateTime = 1498860036016, key = 0 bytes, value = 5 bytes)), (offset=326,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=327,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=328,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=329,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=330,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=331,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=332,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=333,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=334,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=335,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=336,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=337,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3600471783, CreateTime = 1498860036020, key = 0 bytes, value = 5 bytes)), (offset=338,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3600471783, CreateTime = 1498860036020, key = 0 bytes, value = 5 bytes)), (offset=339,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1268070289, CreateTime = 1498860036021, key = 0 bytes, value = 5 bytes)), (offset=340,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=341,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=342,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=343,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=344,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=345,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=346,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2868638524, CreateTime = 1498860036023, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6a6afff2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 270 to buffered record list 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 41 records in fetch response for partition topic-0 with offset 270 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [347 [0 : 13533]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1649b0e6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 347 [0 : 13533] 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 270 for assigned partition topic-0 and update position to 311 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@865dd6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 270 since the current position is 311 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 858 bytes written to log topic-0 beginning at offset 325 and ending at offset 346 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4da4253, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 311 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3972a855, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036059,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@7b95a4a0,SendAction) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=311,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@62e7f11d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=325,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=311, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=42,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=311,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@503d687a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=18,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=858]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:4,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6a370f4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036064,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=311,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 18 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=42,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=311,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2abf4075, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=19,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=507]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@770d3326, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=43,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=311,metadata=}]}]} 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 311, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 325 and error: null. 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 311 in log topic-0 of length 13533 bytes 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036065,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4cc8eb05, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036064,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=43,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=311,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=19,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=507]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@19d481b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=585]} to node 1. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1404 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1f97cf0d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1120263662, CreateTime = 1498860036066, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@140c9f39, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 11 at position 1409 with largest timestamp 1498860036066 at shallow offset 11 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036064,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@3cf7bc02,SendAction) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2868638524, CreateTime = 1498860036023, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 486638439, CreateTime = 1498860036026, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 486638439, CreateTime = 1498860036026, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2148426257, CreateTime = 1498860036027, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2148426257, CreateTime = 1498860036027, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 78449788, CreateTime = 1498860036030, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 78449788, CreateTime = 1498860036030, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 11 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4d910fd6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 215215416, CreateTime = 1498860036059, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1763592184, CreateTime = 1498860036060, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1966240535, CreateTime = 1498860036065, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@26275bef, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 507 bytes at offset 347 at position 13533 with largest timestamp 1498860036030 at shallow offset 358 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 11, next offset: 12, and messages: [(offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1120263662, CreateTime = 1498860036066, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1449, total bytes written so far: 1449, expected bytes to write: 1449 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 507 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 347 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7690781, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG OffsetIndex:54 - Adding index entry 347 => 13533 to 00000000000000000000.index. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [12 [0 : 1496]] 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=42,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=311,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:0,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=347},record_set=[(offset=311,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2598206374, CreateTime = 1498860036008, key = 0 bytes, value = 5 bytes)), (offset=312,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2075377419, CreateTime = 1498860036010, key = 0 bytes, value = 5 bytes)), (offset=313,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2075377419, CreateTime = 1498860036010, key = 0 bytes, value = 5 bytes)), (offset=314,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3871104637, CreateTime = 1498860036011, key = 0 bytes, value = 5 bytes)), (offset=315,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3871104637, CreateTime = 1498860036011, key = 0 bytes, value = 5 bytes)), (offset=316,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2205283517, CreateTime = 1498860036012, key = 0 bytes, value = 5 bytes)), (offset=317,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 511579595, CreateTime = 1498860036013, key = 0 bytes, value = 5 bytes)), (offset=318,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=319,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=320,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1646211088, CreateTime = 1498860036014, key = 0 bytes, value = 5 bytes)), (offset=321,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=322,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=323,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=324,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4279292262, CreateTime = 1498860036015, key = 0 bytes, value = 5 bytes)), (offset=325,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3476445692, CreateTime = 1498860036016, key = 0 bytes, value = 5 bytes)), (offset=326,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=327,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=328,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=329,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1379514506, CreateTime = 1498860036017, key = 0 bytes, value = 5 bytes)), (offset=330,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=331,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=332,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=333,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 777559377, CreateTime = 1498860036018, key = 0 bytes, value = 5 bytes)), (offset=334,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=335,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=336,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3008855079, CreateTime = 1498860036019, key = 0 bytes, value = 5 bytes)), (offset=337,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3600471783, CreateTime = 1498860036020, key = 0 bytes, value = 5 bytes)), (offset=338,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3600471783, CreateTime = 1498860036020, key = 0 bytes, value = 5 bytes)), (offset=339,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1268070289, CreateTime = 1498860036021, key = 0 bytes, value = 5 bytes)), (offset=340,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=341,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=342,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=343,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=344,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=345,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 938742346, CreateTime = 1498860036022, key = 0 bytes, value = 5 bytes)), (offset=346,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2868638524, CreateTime = 1498860036023, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 12 [0 : 1496] 2017-06-30 23:00:36 DEBUG TimeIndex:54 - Adding index entry 1498860036030 => 358 to 00000000000000000000.timeindex. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@77eca502, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3246fb96, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 347, next offset: 360, and messages: [(offset=347,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2868638524, CreateTime = 1498860036023, key = 0 bytes, value = 5 bytes)), (offset=348,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 486638439, CreateTime = 1498860036026, key = 0 bytes, value = 5 bytes)), (offset=349,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 486638439, CreateTime = 1498860036026, key = 0 bytes, value = 5 bytes)), (offset=350,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2148426257, CreateTime = 1498860036027, key = 0 bytes, value = 5 bytes)), (offset=351,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2148426257, CreateTime = 1498860036027, key = 0 bytes, value = 5 bytes)), (offset=352,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=353,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=354,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=355,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=356,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=357,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=358,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 78449788, CreateTime = 1498860036030, key = 0 bytes, value = 5 bytes)), (offset=359,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 78449788, CreateTime = 1498860036030, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2e222612, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [360 [0 : 14040]] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 11 and ending at offset 11 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 360 [0 : 14040] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@61386958, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@73ee04c8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 507 bytes written to log topic-0 beginning at offset 347 and ending at offset 359 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 11, requiredOffset: 12] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7671cb68, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 11, requiredOffset: 12] 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036064,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@e1c2901,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@49dc7102, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6b8ca3c8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=347,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@68c72235, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=19,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=507]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:7,requestQueueTime:1,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@10959ece, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 19 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3a6bb9bf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036065,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@1c346a85,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@34f7cfd9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 347 and error: null. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@65f095f8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=20,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=468]} 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=43,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=311,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:8,requestQueueTime:0,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036072,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=741]} to node 1. 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=20,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=468]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 311 for partition topic-0 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1966240535, CreateTime = 1498860036065, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 156456652, CreateTime = 1498860036066, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 156456652, CreateTime = 1498860036066, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2489104314, CreateTime = 1498860036067, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2489104314, CreateTime = 1498860036067, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1822358540, CreateTime = 1498860036069, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1822358540, CreateTime = 1498860036069, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 285202903, CreateTime = 1498860036070, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 285202903, CreateTime = 1498860036070, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2577591562, CreateTime = 1498860036031, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 626649785, CreateTime = 1498860036032, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3092646863, CreateTime = 1498860036033, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3092646863, CreateTime = 1498860036033, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1496895330, CreateTime = 1498860036035, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2333021689, CreateTime = 1498860036041, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 311 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3e6ef8ad, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 468 bytes at offset 360 at position 14040 with largest timestamp 1498860036042 at shallow offset 369 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 36 records in fetch response for partition topic-0 with offset 311 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 468 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 360 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@346d61be, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 311 for assigned partition topic-0 and update position to 347 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 360, next offset: 372, and messages: [(offset=360,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2577591562, CreateTime = 1498860036031, key = 0 bytes, value = 5 bytes)), (offset=361,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 626649785, CreateTime = 1498860036032, key = 0 bytes, value = 5 bytes)), (offset=362,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3092646863, CreateTime = 1498860036033, key = 0 bytes, value = 5 bytes)), (offset=363,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3092646863, CreateTime = 1498860036033, key = 0 bytes, value = 5 bytes)), (offset=364,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=365,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=366,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=367,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1496895330, CreateTime = 1498860036035, key = 0 bytes, value = 5 bytes)), (offset=368,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2333021689, CreateTime = 1498860036041, key = 0 bytes, value = 5 bytes)), (offset=369,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes)), (offset=370,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes)), (offset=371,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@55536d9e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 311 since the current position is 347 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [372 [0 : 14508]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@747edf66, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 372 [0 : 14508] 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 347 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3d1cfad4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 468 bytes written to log topic-0 beginning at offset 360 and ending at offset 371 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@62230c58, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=347,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2cd2a21f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2e55dd0c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=347, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036072,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@e032c1c,SendAction) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=347,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=44,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=347,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@74455848, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036077,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=360,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=20,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=468]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:5,requestQueueTime:1,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 20 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=44,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=347,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=21,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=702]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@e7edb54, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=45,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=347,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036077,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 347, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 360 and error: null. 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 347 in log topic-0 of length 14508 bytes 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=21,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=702]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036078,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@378542de, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=45,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=347,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 975 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@69e1dd28, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4111578987, CreateTime = 1498860036079, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=429]} to node 1. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1784795476, CreateTime = 1498860036043, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2460195554, CreateTime = 1498860036045, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2460195554, CreateTime = 1498860036045, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1139529429, CreateTime = 1498860036048, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1139529429, CreateTime = 1498860036048, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@11bd0f3b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036077,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@6dfe976,SendAction) 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 702 bytes at offset 372 at position 14508 with largest timestamp 1498860036050 at shallow offset 388 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 973752570, CreateTime = 1498860036074, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 973752570, CreateTime = 1498860036074, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1606935098, CreateTime = 1498860036077, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1606935098, CreateTime = 1498860036077, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@c333c60, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 12 at position 1496 with largest timestamp 1498860036079 at shallow offset 12 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@79da8dc5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1020, total bytes written so far: 1020, expected bytes to write: 1020 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 702 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 372 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1eb5174b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=372},record_set=[(offset=347,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2868638524, CreateTime = 1498860036023, key = 0 bytes, value = 5 bytes)), (offset=348,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 486638439, CreateTime = 1498860036026, key = 0 bytes, value = 5 bytes)), (offset=349,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 486638439, CreateTime = 1498860036026, key = 0 bytes, value = 5 bytes)), (offset=350,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2148426257, CreateTime = 1498860036027, key = 0 bytes, value = 5 bytes)), (offset=351,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2148426257, CreateTime = 1498860036027, key = 0 bytes, value = 5 bytes)), (offset=352,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=353,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=354,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3854813393, CreateTime = 1498860036028, key = 0 bytes, value = 5 bytes)), (offset=355,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=356,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=357,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2026645927, CreateTime = 1498860036029, key = 0 bytes, value = 5 bytes)), (offset=358,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 78449788, CreateTime = 1498860036030, key = 0 bytes, value = 5 bytes)), (offset=359,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 78449788, CreateTime = 1498860036030, key = 0 bytes, value = 5 bytes)), (offset=360,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2577591562, CreateTime = 1498860036031, key = 0 bytes, value = 5 bytes)), (offset=361,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 626649785, CreateTime = 1498860036032, key = 0 bytes, value = 5 bytes)), (offset=362,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3092646863, CreateTime = 1498860036033, key = 0 bytes, value = 5 bytes)), (offset=363,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3092646863, CreateTime = 1498860036033, key = 0 bytes, value = 5 bytes)), (offset=364,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=365,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=366,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3291950612, CreateTime = 1498860036034, key = 0 bytes, value = 5 bytes)), (offset=367,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1496895330, CreateTime = 1498860036035, key = 0 bytes, value = 5 bytes)), (offset=368,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2333021689, CreateTime = 1498860036041, key = 0 bytes, value = 5 bytes)), (offset=369,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes)), (offset=370,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes)), (offset=371,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4151193634, CreateTime = 1498860036042, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 12 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 372, next offset: 390, and messages: [(offset=372,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1784795476, CreateTime = 1498860036043, key = 0 bytes, value = 5 bytes)), (offset=373,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2460195554, CreateTime = 1498860036045, key = 0 bytes, value = 5 bytes)), (offset=374,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2460195554, CreateTime = 1498860036045, key = 0 bytes, value = 5 bytes)), (offset=375,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=376,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=377,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=378,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=379,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=380,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=381,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=382,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=383,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1139529429, CreateTime = 1498860036048, key = 0 bytes, value = 5 bytes)), (offset=384,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1139529429, CreateTime = 1498860036048, key = 0 bytes, value = 5 bytes)), (offset=385,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=386,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=387,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=388,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes)), (offset=389,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@67080771, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=44,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=347,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@72cde7cc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 12, next offset: 13, and messages: [(offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4111578987, CreateTime = 1498860036079, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [390 [0 : 15210]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5fd4f8f5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 390 [0 : 15210] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@696da30b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [13 [0 : 1583]] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 702 bytes written to log topic-0 beginning at offset 372 and ending at offset 389 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4e7912d8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 13 [0 : 1583] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@53976f5c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036077,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@58e529d8,SendAction) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2bfc268b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2f8dad04, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=372,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=21,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=702]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:6,requestQueueTime:1,localTime:5,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 21 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@29e495ff, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 12 and ending at offset 12 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@41e1e210, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=22,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=312]} 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 372 and error: null. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036084,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@be35cd9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=22,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=312]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 12, requiredOffset: 13] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 640056341, CreateTime = 1498860036055, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1890765027, CreateTime = 1498860036056, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3988597141, CreateTime = 1498860036057, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@44821a96, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=624]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@a3d8174, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 312 bytes at offset 390 at position 15210 with largest timestamp 1498860036058 at shallow offset 394 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 12, requiredOffset: 13] 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 312 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 390 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1ba9117e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 598132705, CreateTime = 1498860036078, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3198756503, CreateTime = 1498860036079, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3198756503, CreateTime = 1498860036079, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2391780877, CreateTime = 1498860036080, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2391780877, CreateTime = 1498860036080, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2535661846, CreateTime = 1498860036084, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 390, next offset: 398, and messages: [(offset=390,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes)), (offset=391,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 640056341, CreateTime = 1498860036055, key = 0 bytes, value = 5 bytes)), (offset=392,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1890765027, CreateTime = 1498860036056, key = 0 bytes, value = 5 bytes)), (offset=393,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3988597141, CreateTime = 1498860036057, key = 0 bytes, value = 5 bytes)), (offset=394,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=395,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=396,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=397,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@732c2a62, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036078,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@37de47e4,SendAction) 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [398 [0 : 15522]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@272ed83b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=45,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=347,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:8,requestQueueTime:0,localTime:8,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 398 [0 : 15522] 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 347 for partition topic-0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@41fecb8b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@120f102b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 347 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@625732, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@51dcb805, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 25 records in fetch response for partition topic-0 with offset 347 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@66498326, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 312 bytes written to log topic-0 beginning at offset 390 and ending at offset 397 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@cad498c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 347 for assigned partition topic-0 and update position to 372 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1e6454ec, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2accdbb5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 347 since the current position is 372 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@b62d79, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036084,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@80173d8,SendAction) 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 372 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6631f5ca, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=22,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=312]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:5,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5ace1ed4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=390,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1613674b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=23,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=585]} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=372,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@27ff5d15, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 22 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=372, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4e096385, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036089,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@649bec2e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=372,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=46,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=372,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 390 and error: null. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036090,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@693fe6c9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=23,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=585]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=47,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=372,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=46,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=372,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036090,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=47,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=372,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 215215416, CreateTime = 1498860036059, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1763592184, CreateTime = 1498860036060, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1966240535, CreateTime = 1498860036065, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 372, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 372 in log topic-0 of length 15522 bytes 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 585 bytes at offset 398 at position 15522 with largest timestamp 1498860036065 at shallow offset 412 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=819]} to node 1. 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 585 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 398 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3233845423, CreateTime = 1498860036092, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@31e5415e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 13 at position 1583 with largest timestamp 1498860036092 at shallow offset 13 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1014 bytes 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2535661846, CreateTime = 1498860036084, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1984816571, CreateTime = 1498860036086, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1984816571, CreateTime = 1498860036086, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 398, next offset: 413, and messages: [(offset=398,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 215215416, CreateTime = 1498860036059, key = 0 bytes, value = 5 bytes)), (offset=399,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1763592184, CreateTime = 1498860036060, key = 0 bytes, value = 5 bytes)), (offset=400,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=401,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=402,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=403,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=404,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=405,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=406,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=407,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=408,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=409,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=410,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=411,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=412,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1966240535, CreateTime = 1498860036065, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 13 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@a2431d0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 13, next offset: 14, and messages: [(offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3233845423, CreateTime = 1498860036092, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036090,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@32afaf8a,SendAction) 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [413 [0 : 16107]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 413 [0 : 16107] 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1059, total bytes written so far: 1059, expected bytes to write: 1059 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1cbb87f3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [14 [0 : 1670]] 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=46,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=372,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:0,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=398},record_set=[(offset=372,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1784795476, CreateTime = 1498860036043, key = 0 bytes, value = 5 bytes)), (offset=373,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2460195554, CreateTime = 1498860036045, key = 0 bytes, value = 5 bytes)), (offset=374,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2460195554, CreateTime = 1498860036045, key = 0 bytes, value = 5 bytes)), (offset=375,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=376,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=377,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=378,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4005740345, CreateTime = 1498860036046, key = 0 bytes, value = 5 bytes)), (offset=379,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=380,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=381,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=382,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1942838863, CreateTime = 1498860036047, key = 0 bytes, value = 5 bytes)), (offset=383,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1139529429, CreateTime = 1498860036048, key = 0 bytes, value = 5 bytes)), (offset=384,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1139529429, CreateTime = 1498860036048, key = 0 bytes, value = 5 bytes)), (offset=385,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=386,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=387,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3739498403, CreateTime = 1498860036049, key = 0 bytes, value = 5 bytes)), (offset=388,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes)), (offset=389,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes)), (offset=390,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2726630008, CreateTime = 1498860036050, key = 0 bytes, value = 5 bytes)), (offset=391,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 640056341, CreateTime = 1498860036055, key = 0 bytes, value = 5 bytes)), (offset=392,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1890765027, CreateTime = 1498860036056, key = 0 bytes, value = 5 bytes)), (offset=393,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3988597141, CreateTime = 1498860036057, key = 0 bytes, value = 5 bytes)), (offset=394,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=395,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=396,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes)), (offset=397,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2447117390, CreateTime = 1498860036058, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 14 [0 : 1670] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1a4013, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1b6e1eff, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 13 and ending at offset 13 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 585 bytes written to log topic-0 beginning at offset 398 and ending at offset 412 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@306f16f3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 13, requiredOffset: 14] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 13, requiredOffset: 14] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@702b8b12, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036089,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@1ff5dd08,SendAction) 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@22e357dc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=23,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=585]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:7,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=398,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@49912c99, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 23 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036090,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@6eaf8cc7,SendAction) 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 398 and error: null. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@10163d6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=24,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=741]} 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036096,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@15bbf42f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=390]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@550ee7e5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=24,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=741]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 372 for partition topic-0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=47,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=372,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:7,requestQueueTime:1,localTime:5,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2759474976, CreateTime = 1498860036092, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2759474976, CreateTime = 1498860036092, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 964025942, CreateTime = 1498860036093, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1159003021, CreateTime = 1498860036094, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1159003021, CreateTime = 1498860036094, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2143064294, CreateTime = 1498860036096, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5f9b2141, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1966240535, CreateTime = 1498860036065, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 156456652, CreateTime = 1498860036066, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 156456652, CreateTime = 1498860036066, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2489104314, CreateTime = 1498860036067, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2489104314, CreateTime = 1498860036067, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1822358540, CreateTime = 1498860036069, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1822358540, CreateTime = 1498860036069, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 285202903, CreateTime = 1498860036070, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 285202903, CreateTime = 1498860036070, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 372 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@247d8ae, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 741 bytes at offset 413 at position 16107 with largest timestamp 1498860036072 at shallow offset 429 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 26 records in fetch response for partition topic-0 with offset 372 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 741 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 413 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@48974e45, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 372 for assigned partition topic-0 and update position to 398 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6a84a97d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 413, next offset: 432, and messages: [(offset=413,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1966240535, CreateTime = 1498860036065, key = 0 bytes, value = 5 bytes)), (offset=414,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 156456652, CreateTime = 1498860036066, key = 0 bytes, value = 5 bytes)), (offset=415,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 156456652, CreateTime = 1498860036066, key = 0 bytes, value = 5 bytes)), (offset=416,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2489104314, CreateTime = 1498860036067, key = 0 bytes, value = 5 bytes)), (offset=417,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2489104314, CreateTime = 1498860036067, key = 0 bytes, value = 5 bytes)), (offset=418,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=419,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=420,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=421,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1822358540, CreateTime = 1498860036069, key = 0 bytes, value = 5 bytes)), (offset=422,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1822358540, CreateTime = 1498860036069, key = 0 bytes, value = 5 bytes)), (offset=423,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 285202903, CreateTime = 1498860036070, key = 0 bytes, value = 5 bytes)), (offset=424,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 285202903, CreateTime = 1498860036070, key = 0 bytes, value = 5 bytes)), (offset=425,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=426,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=427,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=428,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=429,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=430,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=431,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 372 since the current position is 398 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6c130c45, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [432 [0 : 16848]] 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 398 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 432 [0 : 16848] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@50ad3bc1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@223aa2f7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 741 bytes written to log topic-0 beginning at offset 413 and ending at offset 431 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=398,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6d3a388c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=398, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@193f604a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=48,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=398,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=398,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036101,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036096,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2b0b0791,SendAction) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=48,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=398,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=413,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@20f5239f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 24 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=49,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=398,metadata=}]}]} 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 398, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036101,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 413 and error: null. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@57af006c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=49,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=398,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 398 in log topic-0 of length 16848 bytes 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=24,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=741]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:5,requestQueueTime:1,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=25,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=429]} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=507]} to node 1. 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1326 bytes 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036103,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1133212698, CreateTime = 1498860036103, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=25,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=429]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036101,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@89f9aa5,SendAction) 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2143064294, CreateTime = 1498860036096, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2664584267, CreateTime = 1498860036098, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2664584267, CreateTime = 1498860036098, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4213177995, CreateTime = 1498860036101, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1371, total bytes written so far: 1371, expected bytes to write: 1371 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@932bc4a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@d29f28, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=48,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=398,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:3,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 973752570, CreateTime = 1498860036074, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 973752570, CreateTime = 1498860036074, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1606935098, CreateTime = 1498860036077, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1606935098, CreateTime = 1498860036077, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 14 at position 1670 with largest timestamp 1498860036103 at shallow offset 14 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=432},record_set=[(offset=398,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 215215416, CreateTime = 1498860036059, key = 0 bytes, value = 5 bytes)), (offset=399,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1763592184, CreateTime = 1498860036060, key = 0 bytes, value = 5 bytes)), (offset=400,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=401,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=402,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4094797454, CreateTime = 1498860036061, key = 0 bytes, value = 5 bytes)), (offset=403,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=404,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=405,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2289075029, CreateTime = 1498860036062, key = 0 bytes, value = 5 bytes)), (offset=406,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=407,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=408,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 360669731, CreateTime = 1498860036063, key = 0 bytes, value = 5 bytes)), (offset=409,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=410,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=411,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3896349281, CreateTime = 1498860036064, key = 0 bytes, value = 5 bytes)), (offset=412,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1966240535, CreateTime = 1498860036065, key = 0 bytes, value = 5 bytes)), (offset=413,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1966240535, CreateTime = 1498860036065, key = 0 bytes, value = 5 bytes)), (offset=414,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 156456652, CreateTime = 1498860036066, key = 0 bytes, value = 5 bytes)), (offset=415,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 156456652, CreateTime = 1498860036066, key = 0 bytes, value = 5 bytes)), (offset=416,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2489104314, CreateTime = 1498860036067, key = 0 bytes, value = 5 bytes)), (offset=417,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2489104314, CreateTime = 1498860036067, key = 0 bytes, value = 5 bytes)), (offset=418,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=419,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=420,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4052819322, CreateTime = 1498860036068, key = 0 bytes, value = 5 bytes)), (offset=421,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1822358540, CreateTime = 1498860036069, key = 0 bytes, value = 5 bytes)), (offset=422,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1822358540, CreateTime = 1498860036069, key = 0 bytes, value = 5 bytes)), (offset=423,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 285202903, CreateTime = 1498860036070, key = 0 bytes, value = 5 bytes)), (offset=424,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 285202903, CreateTime = 1498860036070, key = 0 bytes, value = 5 bytes)), (offset=425,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=426,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=427,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=428,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2381330593, CreateTime = 1498860036071, key = 0 bytes, value = 5 bytes)), (offset=429,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=430,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=431,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2fd1433e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 429 bytes at offset 432 at position 16848 with largest timestamp 1498860036077 at shallow offset 441 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 14 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 429 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 432 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@29d89d5d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3514a4c0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 14, next offset: 15, and messages: [(offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1133212698, CreateTime = 1498860036103, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 432, next offset: 443, and messages: [(offset=432,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=433,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 973752570, CreateTime = 1498860036074, key = 0 bytes, value = 5 bytes)), (offset=434,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 973752570, CreateTime = 1498860036074, key = 0 bytes, value = 5 bytes)), (offset=435,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=436,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=437,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=438,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=439,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=440,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=441,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1606935098, CreateTime = 1498860036077, key = 0 bytes, value = 5 bytes)), (offset=442,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1606935098, CreateTime = 1498860036077, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@212b5695, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [443 [0 : 17277]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@446293d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 443 [0 : 17277] 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [15 [0 : 1757]] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@69997e9d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 15 [0 : 1757] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 429 bytes written to log topic-0 beginning at offset 432 and ending at offset 442 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@793be5ca, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2df9b86, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@37654521, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036103,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@28972e9b,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@15aab8c6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@33990a0c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 14 and ending at offset 14 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4de4b452, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=432,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=25,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=429]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:5,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 25 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@50b5ac82, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@101952da, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=26,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=624]} 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 432 and error: null. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036108,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6babf3bf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 14, requiredOffset: 15] 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=26,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=624]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 14, requiredOffset: 15] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7ea9e1e2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=663]} to node 1. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 598132705, CreateTime = 1498860036078, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3198756503, CreateTime = 1498860036079, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3198756503, CreateTime = 1498860036079, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2391780877, CreateTime = 1498860036080, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2391780877, CreateTime = 1498860036080, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2535661846, CreateTime = 1498860036084, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 624 bytes at offset 443 at position 17277 with largest timestamp 1498860036084 at shallow offset 458 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@24fcf36f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 624 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 443 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036101,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@19bbab1c,SendAction) 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4213177995, CreateTime = 1498860036101, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2911586941, CreateTime = 1498860036106, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2911586941, CreateTime = 1498860036106, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3360088253, CreateTime = 1498860036109, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=49,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=398,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:10,requestQueueTime:0,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@10feca44, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 443, next offset: 459, and messages: [(offset=443,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 598132705, CreateTime = 1498860036078, key = 0 bytes, value = 5 bytes)), (offset=444,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3198756503, CreateTime = 1498860036079, key = 0 bytes, value = 5 bytes)), (offset=445,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3198756503, CreateTime = 1498860036079, key = 0 bytes, value = 5 bytes)), (offset=446,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2391780877, CreateTime = 1498860036080, key = 0 bytes, value = 5 bytes)), (offset=447,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2391780877, CreateTime = 1498860036080, key = 0 bytes, value = 5 bytes)), (offset=448,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=449,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=450,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=451,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=452,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=453,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=454,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=455,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=456,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=457,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=458,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2535661846, CreateTime = 1498860036084, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 398 for partition topic-0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3fb1549b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@ea6147e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 398 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4d02f94e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [459 [0 : 17901]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2b48a640, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 34 records in fetch response for partition topic-0 with offset 398 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1e683a3e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 459 [0 : 17901] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2053d869, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 398 for assigned partition topic-0 and update position to 432 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7a419da4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@14555e0a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 398 since the current position is 432 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4bb33f74, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@759d26fb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 432 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3c73951, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 624 bytes written to log topic-0 beginning at offset 443 and ending at offset 458 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3d5c822d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6f46426d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@73700b80, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=432,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@49c7b90e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036108,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@b60d558,SendAction) 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=432, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=50,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=432,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=26,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=624]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:6,requestQueueTime:1,localTime:5,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@10d307f1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=27,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036114,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036114,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=443,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=432,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 26 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=27,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=50,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=432,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=51,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=432,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4d5b6aac, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036115,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 432, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 443 and error: null. 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 432 in log topic-0 of length 17901 bytes 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=51,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=432,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2535661846, CreateTime = 1498860036084, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1984816571, CreateTime = 1498860036086, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1984816571, CreateTime = 1498860036086, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3e84448c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=819]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@429bffaa, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1053 bytes 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 819 bytes at offset 459 at position 17901 with largest timestamp 1498860036090 at shallow offset 478 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036114,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@9892018,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5403f35f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@483f6d77, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2660815939, CreateTime = 1498860036117, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7e5afaa6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 15 at position 1757 with largest timestamp 1498860036117 at shallow offset 15 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1098, total bytes written so far: 1098, expected bytes to write: 1098 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 819 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 459 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3360088253, CreateTime = 1498860036109, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 690496528, CreateTime = 1498860036111, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 690496528, CreateTime = 1498860036111, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1701808465, CreateTime = 1498860036115, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=50,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=432,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:0,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG OffsetIndex:54 - Adding index entry 459 => 17901 to 00000000000000000000.index. 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=459},record_set=[(offset=432,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3680799831, CreateTime = 1498860036072, key = 0 bytes, value = 5 bytes)), (offset=433,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 973752570, CreateTime = 1498860036074, key = 0 bytes, value = 5 bytes)), (offset=434,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 973752570, CreateTime = 1498860036074, key = 0 bytes, value = 5 bytes)), (offset=435,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=436,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=437,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2802166156, CreateTime = 1498860036075, key = 0 bytes, value = 5 bytes)), (offset=438,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=439,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=440,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3267887948, CreateTime = 1498860036076, key = 0 bytes, value = 5 bytes)), (offset=441,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1606935098, CreateTime = 1498860036077, key = 0 bytes, value = 5 bytes)), (offset=442,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1606935098, CreateTime = 1498860036077, key = 0 bytes, value = 5 bytes)), (offset=443,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 598132705, CreateTime = 1498860036078, key = 0 bytes, value = 5 bytes)), (offset=444,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3198756503, CreateTime = 1498860036079, key = 0 bytes, value = 5 bytes)), (offset=445,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3198756503, CreateTime = 1498860036079, key = 0 bytes, value = 5 bytes)), (offset=446,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2391780877, CreateTime = 1498860036080, key = 0 bytes, value = 5 bytes)), (offset=447,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2391780877, CreateTime = 1498860036080, key = 0 bytes, value = 5 bytes)), (offset=448,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=449,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=450,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 327176059, CreateTime = 1498860036081, key = 0 bytes, value = 5 bytes)), (offset=451,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=452,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=453,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1877043872, CreateTime = 1498860036082, key = 0 bytes, value = 5 bytes)), (offset=454,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=455,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=456,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=457,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4075719638, CreateTime = 1498860036083, key = 0 bytes, value = 5 bytes)), (offset=458,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2535661846, CreateTime = 1498860036084, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 15 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@63a12c68, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 15, next offset: 16, and messages: [(offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2660815939, CreateTime = 1498860036117, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG TimeIndex:54 - Adding index entry 1498860036090 => 478 to 00000000000000000000.timeindex. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@28f3b248, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [16 [0 : 1844]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1b1426f4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 16 [0 : 1844] 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 459, next offset: 480, and messages: [(offset=459,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2535661846, CreateTime = 1498860036084, key = 0 bytes, value = 5 bytes)), (offset=460,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=461,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=462,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=463,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1984816571, CreateTime = 1498860036086, key = 0 bytes, value = 5 bytes)), (offset=464,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1984816571, CreateTime = 1498860036086, key = 0 bytes, value = 5 bytes)), (offset=465,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=466,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=467,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=468,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=469,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=470,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=471,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=472,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=473,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=474,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=475,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=476,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=477,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=478,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes)), (offset=479,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@32b260fa, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 15 and ending at offset 15 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@581ac8a8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [480 [0 : 18720]] 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 15, requiredOffset: 16] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6d4e5011, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 15, requiredOffset: 16] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 480 [0 : 18720] 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@57d7f8ca, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@76c3e77a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036115,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@78246c2a,SendAction) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 819 bytes written to log topic-0 beginning at offset 459 and ending at offset 479 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 6 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@78123e82, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=51,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=432,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:6,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 432 for partition topic-0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@67c33749, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 432 to buffered record list 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036114,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@69567643,SendAction) 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 27 records in fetch response for partition topic-0 with offset 432 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@fba92d3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=459,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=27,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:8,requestQueueTime:1,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 432 for assigned partition topic-0 and update position to 459 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 27 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@662b4c69, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=28,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=390]} 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 459 and error: null. 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 432 since the current position is 459 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036123,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@fa49800, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=28,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=390]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 459 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=459,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2759474976, CreateTime = 1498860036092, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2759474976, CreateTime = 1498860036092, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 964025942, CreateTime = 1498860036093, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1159003021, CreateTime = 1498860036094, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1159003021, CreateTime = 1498860036094, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2143064294, CreateTime = 1498860036096, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=663]} to node 1. 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=459, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=52,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=459,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1701808465, CreateTime = 1498860036115, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3788302140, CreateTime = 1498860036118, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3076019146, CreateTime = 1498860036121, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3076019146, CreateTime = 1498860036121, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036124,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=459,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 390 bytes at offset 480 at position 18720 with largest timestamp 1498860036096 at shallow offset 489 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=52,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=459,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2a54a73f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=53,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=459,metadata=}]}]} 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 459, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 390 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 480 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 459 in log topic-0 of length 19110 bytes 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036125,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@16a0ee18, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=53,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=459,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 480, next offset: 490, and messages: [(offset=480,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes)), (offset=481,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2759474976, CreateTime = 1498860036092, key = 0 bytes, value = 5 bytes)), (offset=482,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2759474976, CreateTime = 1498860036092, key = 0 bytes, value = 5 bytes)), (offset=483,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 964025942, CreateTime = 1498860036093, key = 0 bytes, value = 5 bytes)), (offset=484,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1159003021, CreateTime = 1498860036094, key = 0 bytes, value = 5 bytes)), (offset=485,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1159003021, CreateTime = 1498860036094, key = 0 bytes, value = 5 bytes)), (offset=486,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=487,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=488,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=489,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2143064294, CreateTime = 1498860036096, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 819 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3d6f0054, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036124,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@7064ec06,SendAction) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 671864368, CreateTime = 1498860036126, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@505fc5a4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 16 at position 1844 with largest timestamp 1498860036126 at shallow offset 16 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [490 [0 : 19110]] 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 864, total bytes written so far: 864, expected bytes to write: 864 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 490 [0 : 19110] 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=480},record_set=[(offset=459,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2535661846, CreateTime = 1498860036084, key = 0 bytes, value = 5 bytes)), (offset=460,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=461,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=462,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 170704992, CreateTime = 1498860036085, key = 0 bytes, value = 5 bytes)), (offset=463,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1984816571, CreateTime = 1498860036086, key = 0 bytes, value = 5 bytes)), (offset=464,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1984816571, CreateTime = 1498860036086, key = 0 bytes, value = 5 bytes)), (offset=465,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=466,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=467,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=468,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3946972365, CreateTime = 1498860036087, key = 0 bytes, value = 5 bytes)), (offset=469,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=470,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=471,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=472,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=473,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3184963643, CreateTime = 1498860036088, key = 0 bytes, value = 5 bytes)), (offset=474,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=475,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=476,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=477,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 551113037, CreateTime = 1498860036089, key = 0 bytes, value = 5 bytes)), (offset=478,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes)), (offset=479,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 16 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5fbdfdcf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 16, next offset: 17, and messages: [(offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 671864368, CreateTime = 1498860036126, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=52,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=459,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:3,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4efc180e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [17 [0 : 1931]] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 390 bytes written to log topic-0 beginning at offset 480 and ending at offset 489 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 17 [0 : 1931] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@bd4dc25, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@25084a1e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036123,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2d71c33e,SendAction) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 16 and ending at offset 16 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@156b88f5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=28,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=390]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:6,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=480,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=29,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=507]} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 28 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3bf9ce3e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036129,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 480 and error: null. 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 16, requiredOffset: 17] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=29,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=507]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@16610890, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 16, requiredOffset: 17] 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2143064294, CreateTime = 1498860036096, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2664584267, CreateTime = 1498860036098, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2664584267, CreateTime = 1498860036098, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4213177995, CreateTime = 1498860036101, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 507 bytes at offset 490 at position 19110 with largest timestamp 1498860036101 at shallow offset 502 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=429]} to node 1. 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 507 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 490 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036125,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@20b619dd,SendAction) 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1446418279, CreateTime = 1498860036123, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 872103335, CreateTime = 1498860036124, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2935282897, CreateTime = 1498860036125, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2935282897, CreateTime = 1498860036125, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3533043978, CreateTime = 1498860036126, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1335498876, CreateTime = 1498860036127, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3000559678, CreateTime = 1498860036128, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3000559678, CreateTime = 1498860036128, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 490, next offset: 503, and messages: [(offset=490,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2143064294, CreateTime = 1498860036096, key = 0 bytes, value = 5 bytes)), (offset=491,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=492,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=493,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=494,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2664584267, CreateTime = 1498860036098, key = 0 bytes, value = 5 bytes)), (offset=495,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2664584267, CreateTime = 1498860036098, key = 0 bytes, value = 5 bytes)), (offset=496,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=497,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=498,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=499,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=500,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=501,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=502,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4213177995, CreateTime = 1498860036101, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=53,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=459,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:6,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 459 for partition topic-0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [503 [0 : 19617]] 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 459 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@383bfa16, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 21 records in fetch response for partition topic-0 with offset 459 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 503 [0 : 19617] 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 459 for assigned partition topic-0 and update position to 480 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4d465b11, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 459 since the current position is 480 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 480 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@53fdffa1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=480,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5562c41e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@32ee6fee, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 507 bytes written to log topic-0 beginning at offset 490 and ending at offset 502 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=54,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=480,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4d0f2471, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=480, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7133da86, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036133,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=54,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=480,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3232a28a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@73e22a3d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=480,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@47faa49c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036129,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@7ba864dd,SendAction) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 480, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 480 in log topic-0 of length 19617 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@28f2a10f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=55,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=480,metadata=}]}]} 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=490,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 897 bytes 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036135,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036133,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@3f78ce7f,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@f736069, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 942, total bytes written so far: 942, expected bytes to write: 942 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=55,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=480,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=54,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=480,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:3,requestQueueTime:1,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=29,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=507]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:6,requestQueueTime:1,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=503},record_set=[(offset=480,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1555592342, CreateTime = 1498860036090, key = 0 bytes, value = 5 bytes)), (offset=481,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2759474976, CreateTime = 1498860036092, key = 0 bytes, value = 5 bytes)), (offset=482,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2759474976, CreateTime = 1498860036092, key = 0 bytes, value = 5 bytes)), (offset=483,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 964025942, CreateTime = 1498860036093, key = 0 bytes, value = 5 bytes)), (offset=484,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1159003021, CreateTime = 1498860036094, key = 0 bytes, value = 5 bytes)), (offset=485,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1159003021, CreateTime = 1498860036094, key = 0 bytes, value = 5 bytes)), (offset=486,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=487,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=488,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3625655035, CreateTime = 1498860036095, key = 0 bytes, value = 5 bytes)), (offset=489,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2143064294, CreateTime = 1498860036096, key = 0 bytes, value = 5 bytes)), (offset=490,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2143064294, CreateTime = 1498860036096, key = 0 bytes, value = 5 bytes)), (offset=491,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=492,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=493,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3803410832, CreateTime = 1498860036097, key = 0 bytes, value = 5 bytes)), (offset=494,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2664584267, CreateTime = 1498860036098, key = 0 bytes, value = 5 bytes)), (offset=495,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2664584267, CreateTime = 1498860036098, key = 0 bytes, value = 5 bytes)), (offset=496,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=497,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=498,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 64861501, CreateTime = 1498860036099, key = 0 bytes, value = 5 bytes)), (offset=499,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=500,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=501,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1712332797, CreateTime = 1498860036100, key = 0 bytes, value = 5 bytes)), (offset=502,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4213177995, CreateTime = 1498860036101, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=30,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 29 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036137,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 924760692, CreateTime = 1498860036137, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6da21078, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=30,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 490 and error: null. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7fee8714, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 17 at position 1931 with largest timestamp 1498860036137 at shallow offset 17 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 17 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4213177995, CreateTime = 1498860036101, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2911586941, CreateTime = 1498860036106, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2911586941, CreateTime = 1498860036106, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3360088253, CreateTime = 1498860036109, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 17, next offset: 18, and messages: [(offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 924760692, CreateTime = 1498860036137, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@56cdfb3b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=546]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2b91004a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [18 [0 : 2018]] 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 663 bytes at offset 503 at position 19617 with largest timestamp 1498860036109 at shallow offset 519 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 18 [0 : 2018] 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1404447891, CreateTime = 1498860036130, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2876532517, CreateTime = 1498860036132, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2876532517, CreateTime = 1498860036132, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3608494846, CreateTime = 1498860036135, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3608494846, CreateTime = 1498860036135, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2172777992, CreateTime = 1498860036136, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@20ccf40b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 663 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 503 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2fb3536e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@169e6180, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 17 and ending at offset 17 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@35aea049, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 503, next offset: 520, and messages: [(offset=503,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4213177995, CreateTime = 1498860036101, key = 0 bytes, value = 5 bytes)), (offset=504,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=505,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=506,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=507,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=508,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=509,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=510,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2911586941, CreateTime = 1498860036106, key = 0 bytes, value = 5 bytes)), (offset=511,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2911586941, CreateTime = 1498860036106, key = 0 bytes, value = 5 bytes)), (offset=512,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=513,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=514,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=515,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=516,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=517,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=518,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=519,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3360088253, CreateTime = 1498860036109, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7205765b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@47987356, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@22ef9844, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 17, requiredOffset: 18] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6283d8b8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [520 [0 : 20280]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3b6ddd1d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 17, requiredOffset: 18] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3f6b0be5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 520 [0 : 20280] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@611889f4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1da2cb77, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@48f278eb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036135,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2116e185,SendAction) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 663 bytes written to log topic-0 beginning at offset 503 and ending at offset 519 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2f217633, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=55,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=480,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:7,requestQueueTime:0,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 480 for partition topic-0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@a530d0a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036137,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2ddbeaa,SendAction) 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 480 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1a18644, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=503,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 23 records in fetch response for partition topic-0 with offset 480 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 30 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5acf93bb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=30,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:6,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7e7be63f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=31,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 503 and error: null. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036143,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=31,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 480 for assigned partition topic-0 and update position to 503 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=819]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6cd28fa7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 479074174, CreateTime = 1498860036137, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1626288805, CreateTime = 1498860036138, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1626288805, CreateTime = 1498860036138, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4259369939, CreateTime = 1498860036139, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4259369939, CreateTime = 1498860036139, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 480 since the current position is 503 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 503 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4738a206, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3360088253, CreateTime = 1498860036109, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 690496528, CreateTime = 1498860036111, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 690496528, CreateTime = 1498860036111, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1701808465, CreateTime = 1498860036115, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@66d3eec0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1e04fa0a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 819 bytes at offset 520 at position 20280 with largest timestamp 1498860036115 at shallow offset 540 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1af2d44a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=503,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@18d87d80, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 819 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 520 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=503, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@618425b5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=503,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=56,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=503,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 520, next offset: 541, and messages: [(offset=520,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3360088253, CreateTime = 1498860036109, key = 0 bytes, value = 5 bytes)), (offset=521,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=522,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=523,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=524,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 690496528, CreateTime = 1498860036111, key = 0 bytes, value = 5 bytes)), (offset=525,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 690496528, CreateTime = 1498860036111, key = 0 bytes, value = 5 bytes)), (offset=526,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=527,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=528,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=529,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=530,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=531,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=532,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=533,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=534,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=535,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=536,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=537,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=538,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=539,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=540,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1701808465, CreateTime = 1498860036115, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@58695725, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [541 [0 : 21099]] 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=57,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=503,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036146,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 541 [0 : 21099] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@543588e6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036146,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=56,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=503,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=57,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=503,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@f5acb9d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 819 bytes written to log topic-0 beginning at offset 520 and ending at offset 540 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 503, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3281797774, CreateTime = 1498860036148, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4fb3ee4e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 18 at position 2018 with largest timestamp 1498860036148 at shallow offset 18 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 503 in log topic-0 of length 21099 bytes 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 18 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036143,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@123527dd,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5d7148e2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@25fb8912, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7c24b813, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 18, next offset: 19, and messages: [(offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3281797774, CreateTime = 1498860036148, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2c35e847, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1482 bytes 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=520,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=31,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:6,requestQueueTime:1,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036146,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@4bc62187,SendAction) 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 31 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=32,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1527, total bytes written so far: 1527, expected bytes to write: 1527 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7bd4937b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@21e360a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=56,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=503,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:0,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036149,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 520 and error: null. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=32,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=541},record_set=[(offset=503,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4213177995, CreateTime = 1498860036101, key = 0 bytes, value = 5 bytes)), (offset=504,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=505,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=506,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1290112720, CreateTime = 1498860036104, key = 0 bytes, value = 5 bytes)), (offset=507,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=508,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=509,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3521802150, CreateTime = 1498860036105, key = 0 bytes, value = 5 bytes)), (offset=510,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2911586941, CreateTime = 1498860036106, key = 0 bytes, value = 5 bytes)), (offset=511,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2911586941, CreateTime = 1498860036106, key = 0 bytes, value = 5 bytes)), (offset=512,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=513,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=514,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 814000907, CreateTime = 1498860036107, key = 0 bytes, value = 5 bytes)), (offset=515,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=516,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=517,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=518,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1430847947, CreateTime = 1498860036108, key = 0 bytes, value = 5 bytes)), (offset=519,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3360088253, CreateTime = 1498860036109, key = 0 bytes, value = 5 bytes)), (offset=520,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3360088253, CreateTime = 1498860036109, key = 0 bytes, value = 5 bytes)), (offset=521,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=522,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=523,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3022505318, CreateTime = 1498860036110, key = 0 bytes, value = 5 bytes)), (offset=524,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 690496528, CreateTime = 1498860036111, key = 0 bytes, value = 5 bytes)), (offset=525,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 690496528, CreateTime = 1498860036111, key = 0 bytes, value = 5 bytes)), (offset=526,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=527,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=528,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=529,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=530,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=531,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 420392074, CreateTime = 1498860036112, key = 0 bytes, value = 5 bytes)), (offset=532,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=533,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=534,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=535,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=536,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2214678012, CreateTime = 1498860036113, key = 0 bytes, value = 5 bytes)), (offset=537,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=538,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=539,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4167067687, CreateTime = 1498860036114, key = 0 bytes, value = 5 bytes)), (offset=540,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1701808465, CreateTime = 1498860036115, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5ba3f27a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [19 [0 : 2105]] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1701808465, CreateTime = 1498860036115, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3788302140, CreateTime = 1498860036118, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3076019146, CreateTime = 1498860036121, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3076019146, CreateTime = 1498860036121, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 663 bytes at offset 541 at position 21099 with largest timestamp 1498860036122 at shallow offset 555 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 19 [0 : 2105] 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 663 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 541 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@74751b3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=663]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@741a8937, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@306e95ec, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 541, next offset: 558, and messages: [(offset=541,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1701808465, CreateTime = 1498860036115, key = 0 bytes, value = 5 bytes)), (offset=542,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=543,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=544,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=545,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=546,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3788302140, CreateTime = 1498860036118, key = 0 bytes, value = 5 bytes)), (offset=547,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=548,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=549,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=550,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=551,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=552,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=553,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3076019146, CreateTime = 1498860036121, key = 0 bytes, value = 5 bytes)), (offset=554,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3076019146, CreateTime = 1498860036121, key = 0 bytes, value = 5 bytes)), (offset=555,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes)), (offset=556,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes)), (offset=557,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@52af26ee, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3563770962, CreateTime = 1498860036144, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3563770962, CreateTime = 1498860036144, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 889458943, CreateTime = 1498860036146, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 889458943, CreateTime = 1498860036146, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2819355017, CreateTime = 1498860036147, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2819355017, CreateTime = 1498860036147, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3452328777, CreateTime = 1498860036148, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3452328777, CreateTime = 1498860036148, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 749248484, CreateTime = 1498860036150, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6fd83fc1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4f2b503c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 18 and ending at offset 18 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@bae7dc0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [558 [0 : 21762]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@209da20d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@e15b7e8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 558 [0 : 21762] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1b2abca6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 18, requiredOffset: 19] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6392827e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2ed2d9cb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 18, requiredOffset: 19] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@d5b810e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@43dac38f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@342c38f8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 663 bytes written to log topic-0 beginning at offset 541 and ending at offset 557 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036146,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2a8327ca,SendAction) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@c88a337, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5d0a1059, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=57,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=503,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:9,requestQueueTime:1,localTime:8,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@485966cc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1de76cc7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036149,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@3c0ff1d6,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@54bff557, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@593aaf41, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 503 for partition topic-0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5a56cdac, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=32,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:7,requestQueueTime:1,localTime:5,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=541,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7c711375, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 503 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@57cf54e1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=33,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=429]} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 32 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036156,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5b03b9fe, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 38 records in fetch response for partition topic-0 with offset 503 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@37d4349f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=33,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=429]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 541 and error: null. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@434a63ab, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 503 for assigned partition topic-0 and update position to 541 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1446418279, CreateTime = 1498860036123, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 872103335, CreateTime = 1498860036124, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2935282897, CreateTime = 1498860036125, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2935282897, CreateTime = 1498860036125, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3533043978, CreateTime = 1498860036126, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1335498876, CreateTime = 1498860036127, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3000559678, CreateTime = 1498860036128, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3000559678, CreateTime = 1498860036128, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 429 bytes at offset 558 at position 21762 with largest timestamp 1498860036129 at shallow offset 566 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 429 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 558 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=1053]} to node 1. 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 558, next offset: 569, and messages: [(offset=558,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1446418279, CreateTime = 1498860036123, key = 0 bytes, value = 5 bytes)), (offset=559,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 872103335, CreateTime = 1498860036124, key = 0 bytes, value = 5 bytes)), (offset=560,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2935282897, CreateTime = 1498860036125, key = 0 bytes, value = 5 bytes)), (offset=561,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2935282897, CreateTime = 1498860036125, key = 0 bytes, value = 5 bytes)), (offset=562,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3533043978, CreateTime = 1498860036126, key = 0 bytes, value = 5 bytes)), (offset=563,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1335498876, CreateTime = 1498860036127, key = 0 bytes, value = 5 bytes)), (offset=564,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3000559678, CreateTime = 1498860036128, key = 0 bytes, value = 5 bytes)), (offset=565,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3000559678, CreateTime = 1498860036128, key = 0 bytes, value = 5 bytes)), (offset=566,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes)), (offset=567,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes)), (offset=568,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [569 [0 : 22191]] 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 749248484, CreateTime = 1498860036150, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2980544146, CreateTime = 1498860036151, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 503 since the current position is 541 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2805d709, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3ee37e5a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 569 [0 : 22191] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2ea41516, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 541 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3a44431a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3c7f66c4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@194bcebf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@17497425, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@f0da945, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=541,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=541, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=541,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4803b726, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@ffaa6af, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@53ce1329, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@316bcf94, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6404f418, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 429 bytes written to log topic-0 beginning at offset 558 and ending at offset 568 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3e11f9e9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=59,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=541,metadata=}]}]} 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=58,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=541,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036161,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036161,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1de5f259, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@729d991e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@31fa1761, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=58,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=541,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 541, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=59,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=541,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 541 in log topic-0 of length 22191 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@957e06, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@32502377, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2c1b194a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4dbb42b7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@66f57048, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@550dbc7a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@21282ed8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036156,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@53482013,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@36916eb0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7bab3f1a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@437da279, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3520993370, CreateTime = 1498860036164, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1092 bytes 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 19 at position 2105 with largest timestamp 1498860036164 at shallow offset 19 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036161,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@b0f4107,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@23c30a20, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1e1a0406, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3cebbb30, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@12aba8be, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@290222c1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=558,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=33,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=429]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:8,requestQueueTime:1,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 33 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 558 and error: null. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@67f639d3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=569},record_set=[(offset=541,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1701808465, CreateTime = 1498860036115, key = 0 bytes, value = 5 bytes)), (offset=542,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=543,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=544,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=545,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2645410535, CreateTime = 1498860036117, key = 0 bytes, value = 5 bytes)), (offset=546,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3788302140, CreateTime = 1498860036118, key = 0 bytes, value = 5 bytes)), (offset=547,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=548,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=549,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2093155914, CreateTime = 1498860036119, key = 0 bytes, value = 5 bytes)), (offset=550,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=551,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=552,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 710390460, CreateTime = 1498860036120, key = 0 bytes, value = 5 bytes)), (offset=553,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3076019146, CreateTime = 1498860036121, key = 0 bytes, value = 5 bytes)), (offset=554,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3076019146, CreateTime = 1498860036121, key = 0 bytes, value = 5 bytes)), (offset=555,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes)), (offset=556,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes)), (offset=557,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3409540625, CreateTime = 1498860036122, key = 0 bytes, value = 5 bytes)), (offset=558,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1446418279, CreateTime = 1498860036123, key = 0 bytes, value = 5 bytes)), (offset=559,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 872103335, CreateTime = 1498860036124, key = 0 bytes, value = 5 bytes)), (offset=560,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2935282897, CreateTime = 1498860036125, key = 0 bytes, value = 5 bytes)), (offset=561,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2935282897, CreateTime = 1498860036125, key = 0 bytes, value = 5 bytes)), (offset=562,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3533043978, CreateTime = 1498860036126, key = 0 bytes, value = 5 bytes)), (offset=563,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1335498876, CreateTime = 1498860036127, key = 0 bytes, value = 5 bytes)), (offset=564,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3000559678, CreateTime = 1498860036128, key = 0 bytes, value = 5 bytes)), (offset=565,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3000559678, CreateTime = 1498860036128, key = 0 bytes, value = 5 bytes)), (offset=566,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes)), (offset=567,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes)), (offset=568,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 802621768, CreateTime = 1498860036129, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1137, total bytes written so far: 1137, expected bytes to write: 1137 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 19 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=58,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=541,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:5,requestQueueTime:1,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=34,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@49049a04, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 19, next offset: 20, and messages: [(offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3520993370, CreateTime = 1498860036164, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@71a8adcf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036166,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes)), (offset=32,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@27462a88, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@82de64a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=34,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@659499f1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@51e69659, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [20 [0 : 2192]] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1404447891, CreateTime = 1498860036130, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2876532517, CreateTime = 1498860036132, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2876532517, CreateTime = 1498860036132, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3608494846, CreateTime = 1498860036135, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3608494846, CreateTime = 1498860036135, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2172777992, CreateTime = 1498860036136, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@47e2e487, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 546 bytes at offset 569 at position 22191 with largest timestamp 1498860036136 at shallow offset 582 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 20 [0 : 2192] 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 546 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 569 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@201a4587, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG OffsetIndex:54 - Adding index entry 569 => 22191 to 00000000000000000000.index. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG TimeIndex:54 - Adding index entry 1498860036136 => 582 to 00000000000000000000.timeindex. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@61001b64, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 569, next offset: 583, and messages: [(offset=569,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1404447891, CreateTime = 1498860036130, key = 0 bytes, value = 5 bytes)), (offset=570,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2876532517, CreateTime = 1498860036132, key = 0 bytes, value = 5 bytes)), (offset=571,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2876532517, CreateTime = 1498860036132, key = 0 bytes, value = 5 bytes)), (offset=572,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=573,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=574,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=575,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=576,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=577,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=578,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=579,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=580,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3608494846, CreateTime = 1498860036135, key = 0 bytes, value = 5 bytes)), (offset=581,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3608494846, CreateTime = 1498860036135, key = 0 bytes, value = 5 bytes)), (offset=582,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2172777992, CreateTime = 1498860036136, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4310d43, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [583 [0 : 22737]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 583 [0 : 22737] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 19 and ending at offset 19 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@54a7079e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 6 ms 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 546 bytes written to log topic-0 beginning at offset 569 and ending at offset 582 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@26e356f0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 19, requiredOffset: 20] 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 19, requiredOffset: 20] 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@47d9a273, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4b8ee4de, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036166,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@68f8fe68,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@27f981c6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036161,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@5b7639ca,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1b11171f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1151e434, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2dc54ad4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=569,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=34,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:6,requestQueueTime:1,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 34 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4659191b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 541 for partition topic-0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=59,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=541,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:11,requestQueueTime:1,localTime:9,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 569 and error: null. 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 541 to buffered record list 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 28 records in fetch response for partition topic-0 with offset 541 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@55634720, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 541 for assigned partition topic-0 and update position to 569 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 541 since the current position is 569 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=35,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=780]} to node 1. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036173,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=35,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 569 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1539886551, CreateTime = 1498860036167, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1539886551, CreateTime = 1498860036167, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2421397591, CreateTime = 1498860036169, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2421397591, CreateTime = 1498860036169, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 479074174, CreateTime = 1498860036137, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1626288805, CreateTime = 1498860036138, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1626288805, CreateTime = 1498860036138, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4259369939, CreateTime = 1498860036139, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4259369939, CreateTime = 1498860036139, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=569,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4c1909a3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@428640fa, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@d9345cd, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 819 bytes at offset 583 at position 22737 with largest timestamp 1498860036143 at shallow offset 601 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2d710f1a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=60,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=569,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=569, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036175,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@29215f06, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 819 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 583 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@59505b48, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=60,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=569,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=569,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 569, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4efac082, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6bd61f98, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 583, next offset: 604, and messages: [(offset=583,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 479074174, CreateTime = 1498860036137, key = 0 bytes, value = 5 bytes)), (offset=584,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1626288805, CreateTime = 1498860036138, key = 0 bytes, value = 5 bytes)), (offset=585,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1626288805, CreateTime = 1498860036138, key = 0 bytes, value = 5 bytes)), (offset=586,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4259369939, CreateTime = 1498860036139, key = 0 bytes, value = 5 bytes)), (offset=587,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4259369939, CreateTime = 1498860036139, key = 0 bytes, value = 5 bytes)), (offset=588,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=589,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=590,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=591,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=592,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=593,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=594,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=595,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=596,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=597,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=598,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=599,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=600,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=601,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes)), (offset=602,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes)), (offset=603,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@48aca48b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=61,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=569,metadata=}]}]} 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 569 in log topic-0 of length 23556 bytes 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036176,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@13fd2ccd, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 546 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@b9b00e0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@506ae4d4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=61,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=569,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7d4f9aae, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036175,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@5c5c98bc,SendAction) 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [604 [0 : 23556]] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3613791102, CreateTime = 1498860036178, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 20 at position 2192 with largest timestamp 1498860036178 at shallow offset 20 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 20 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 591, total bytes written so far: 591, expected bytes to write: 591 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@72e5a8e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=60,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=569,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 20, next offset: 21, and messages: [(offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3613791102, CreateTime = 1498860036178, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=583},record_set=[(offset=569,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1404447891, CreateTime = 1498860036130, key = 0 bytes, value = 5 bytes)), (offset=570,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2876532517, CreateTime = 1498860036132, key = 0 bytes, value = 5 bytes)), (offset=571,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2876532517, CreateTime = 1498860036132, key = 0 bytes, value = 5 bytes)), (offset=572,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=573,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=574,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=575,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 914064979, CreateTime = 1498860036133, key = 0 bytes, value = 5 bytes)), (offset=576,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=577,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=578,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=579,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1243259784, CreateTime = 1498860036134, key = 0 bytes, value = 5 bytes)), (offset=580,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3608494846, CreateTime = 1498860036135, key = 0 bytes, value = 5 bytes)), (offset=581,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3608494846, CreateTime = 1498860036135, key = 0 bytes, value = 5 bytes)), (offset=582,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2172777992, CreateTime = 1498860036136, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 604 [0 : 23556] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@54e1c68b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [21 [0 : 2279]] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 21 [0 : 2279] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@53aac487, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@52b1beb6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 20 and ending at offset 20 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 819 bytes written to log topic-0 beginning at offset 583 and ending at offset 603 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 2 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@273e7444, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 20, requiredOffset: 21] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 6 ms 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 20, requiredOffset: 21] 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036173,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@1834f233,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7db12bb6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@783a467b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@272113c4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@73e9cf30, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=35,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:8,requestQueueTime:0,localTime:8,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@771a660, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=583,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2d52216b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036176,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@aee119e,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@242b836, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3f6f6701, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=36,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=61,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=569,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:6,requestQueueTime:1,localTime:4,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 35 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036182,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=36,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 569 for partition topic-0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3527942a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 569 to buffered record list 2017-06-30 23:00:36 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 583 and error: null. 2017-06-30 23:00:36 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:36 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3563770962, CreateTime = 1498860036144, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3563770962, CreateTime = 1498860036144, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 889458943, CreateTime = 1498860036146, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 889458943, CreateTime = 1498860036146, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2819355017, CreateTime = 1498860036147, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2819355017, CreateTime = 1498860036147, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3452328777, CreateTime = 1498860036148, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3452328777, CreateTime = 1498860036148, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 749248484, CreateTime = 1498860036150, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 14 records in fetch response for partition topic-0 with offset 569 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@942a29c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 663 bytes at offset 604 at position 23556 with largest timestamp 1498860036150 at shallow offset 620 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 569 for assigned partition topic-0 and update position to 583 2017-06-30 23:00:36 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 569 since the current position is 583 2017-06-30 23:00:36 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 2ms 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 663 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 604 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 583 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=1092]} to node 1. 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5a45133e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=583,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4120785559, CreateTime = 1498860036174, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3118047190, CreateTime = 1498860036178, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 618036896, CreateTime = 1498860036179, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 618036896, CreateTime = 1498860036179, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1092342880, CreateTime = 1498860036180, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1092342880, CreateTime = 1498860036180, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=62,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=583,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 604, next offset: 621, and messages: [(offset=604,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3563770962, CreateTime = 1498860036144, key = 0 bytes, value = 5 bytes)), (offset=605,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3563770962, CreateTime = 1498860036144, key = 0 bytes, value = 5 bytes)), (offset=606,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=607,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=608,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=609,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=610,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 889458943, CreateTime = 1498860036146, key = 0 bytes, value = 5 bytes)), (offset=611,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 889458943, CreateTime = 1498860036146, key = 0 bytes, value = 5 bytes)), (offset=612,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2819355017, CreateTime = 1498860036147, key = 0 bytes, value = 5 bytes)), (offset=613,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2819355017, CreateTime = 1498860036147, key = 0 bytes, value = 5 bytes)), (offset=614,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3452328777, CreateTime = 1498860036148, key = 0 bytes, value = 5 bytes)), (offset=615,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3452328777, CreateTime = 1498860036148, key = 0 bytes, value = 5 bytes)), (offset=616,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=617,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=618,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=619,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=620,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 749248484, CreateTime = 1498860036150, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036186,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=583, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@534a5a98, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=583,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=62,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=583,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 583, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [621 [0 : 24219]] 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=63,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=583,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4f80542f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036187,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 621 [0 : 24219] 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 583 in log topic-0 of length 24219 bytes 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=63,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=583,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@60bd273d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@121314f7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1482 bytes 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036186,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@252eae7e,SendAction) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2975835248, CreateTime = 1498860036190, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1527, total bytes written so far: 1527, expected bytes to write: 1527 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=62,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=583,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:5,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@130c12b7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 21 at position 2279 with largest timestamp 1498860036190 at shallow offset 21 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 663 bytes written to log topic-0 beginning at offset 604 and ending at offset 620 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=621},record_set=[(offset=583,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 479074174, CreateTime = 1498860036137, key = 0 bytes, value = 5 bytes)), (offset=584,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1626288805, CreateTime = 1498860036138, key = 0 bytes, value = 5 bytes)), (offset=585,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1626288805, CreateTime = 1498860036138, key = 0 bytes, value = 5 bytes)), (offset=586,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4259369939, CreateTime = 1498860036139, key = 0 bytes, value = 5 bytes)), (offset=587,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4259369939, CreateTime = 1498860036139, key = 0 bytes, value = 5 bytes)), (offset=588,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=589,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=590,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=591,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=592,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2553116947, CreateTime = 1498860036140, key = 0 bytes, value = 5 bytes)), (offset=593,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=594,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=595,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=596,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=597,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 86153317, CreateTime = 1498860036141, key = 0 bytes, value = 5 bytes)), (offset=598,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=599,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=600,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2034482622, CreateTime = 1498860036142, key = 0 bytes, value = 5 bytes)), (offset=601,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes)), (offset=602,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes)), (offset=603,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3830209736, CreateTime = 1498860036143, key = 0 bytes, value = 5 bytes)), (offset=604,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3563770962, CreateTime = 1498860036144, key = 0 bytes, value = 5 bytes)), (offset=605,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3563770962, CreateTime = 1498860036144, key = 0 bytes, value = 5 bytes)), (offset=606,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=607,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=608,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=609,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1231369508, CreateTime = 1498860036145, key = 0 bytes, value = 5 bytes)), (offset=610,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 889458943, CreateTime = 1498860036146, key = 0 bytes, value = 5 bytes)), (offset=611,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 889458943, CreateTime = 1498860036146, key = 0 bytes, value = 5 bytes)), (offset=612,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2819355017, CreateTime = 1498860036147, key = 0 bytes, value = 5 bytes)), (offset=613,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2819355017, CreateTime = 1498860036147, key = 0 bytes, value = 5 bytes)), (offset=614,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3452328777, CreateTime = 1498860036148, key = 0 bytes, value = 5 bytes)), (offset=615,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3452328777, CreateTime = 1498860036148, key = 0 bytes, value = 5 bytes)), (offset=616,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=617,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=618,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=619,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1355397695, CreateTime = 1498860036149, key = 0 bytes, value = 5 bytes)), (offset=620,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 749248484, CreateTime = 1498860036150, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 21 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5e600dd5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 21, next offset: 22, and messages: [(offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2975835248, CreateTime = 1498860036190, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 9 ms 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@576d5deb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [22 [0 : 2366]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5d534f5d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036182,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@254aa515,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2e3967ea, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@70e9c95d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 22 [0 : 2366] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4d5650ae, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@a38c7fe, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=604,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=36,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:11,requestQueueTime:0,localTime:10,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 36 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 604 and error: null. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=37,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1053]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6fdbe764, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036194,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=37,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1053]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2e6a8155, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6221a451, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@52719fb6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3012646b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 749248484, CreateTime = 1498860036150, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2980544146, CreateTime = 1498860036151, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 1053 bytes at offset 621 at position 24219 with largest timestamp 1498860036157 at shallow offset 646 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4a883b15, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=546]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@25641d39, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7b36aa0c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 1053 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 621 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 21 and ending at offset 21 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1031467451, CreateTime = 1498860036183, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4141982779, CreateTime = 1498860036185, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4141982779, CreateTime = 1498860036185, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 395272342, CreateTime = 1498860036187, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1916979798, CreateTime = 1498860036188, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4014811936, CreateTime = 1498860036189, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2469138171, CreateTime = 1498860036190, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 237236109, CreateTime = 1498860036191, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4083228623, CreateTime = 1498860036192, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5824a83d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 621, next offset: 648, and messages: [(offset=621,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 749248484, CreateTime = 1498860036150, key = 0 bytes, value = 5 bytes)), (offset=622,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2980544146, CreateTime = 1498860036151, key = 0 bytes, value = 5 bytes)), (offset=623,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=624,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=625,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=626,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=627,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=628,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=629,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=630,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=631,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=632,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=633,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=634,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=635,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=636,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=637,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=638,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=639,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=640,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=641,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=642,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=643,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=644,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=645,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=646,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes)), (offset=647,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 7 ms 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [648 [0 : 25272]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@537f60bf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 648 [0 : 25272] 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 21, requiredOffset: 22] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5677323c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 21, requiredOffset: 22] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 1053 bytes written to log topic-0 beginning at offset 621 and ending at offset 647 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@18df8434, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@65c7a252, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4d154ccd, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036194,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@4f18601f,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@229c6181, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036187,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@7082a6a5,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4686afc2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1e0b4072, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@791f145a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=37,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1053]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:6,requestQueueTime:0,localTime:5,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=63,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=583,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:14,requestQueueTime:0,localTime:12,remoteTime:0,responseQueueTime:1,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=621,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@38cee291, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 583 for partition topic-0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=38,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 37 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036201,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 583 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4b45a2f5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 38 records in fetch response for partition topic-0 with offset 583 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=38,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 621 and error: null. 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 583 for assigned partition topic-0 and update position to 621 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@f09733f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=780]} to node 1. 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 583 since the current position is 621 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 621 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes)), (offset=32,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=621,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 303029090, CreateTime = 1498860036194, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2399156756, CreateTime = 1498860036195, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2399156756, CreateTime = 1498860036195, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 195253369, CreateTime = 1498860036198, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 195253369, CreateTime = 1498860036198, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2527900943, CreateTime = 1498860036199, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2527900943, CreateTime = 1498860036199, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1563943055, CreateTime = 1498860036201, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1563943055, CreateTime = 1498860036201, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=64,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=621,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=621, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 1287 bytes at offset 648 at position 25272 with largest timestamp 1498860036166 at shallow offset 679 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=621,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 1287 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 648 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036204,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=64,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=621,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@41a0aa7d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 621, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=65,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=621,metadata=}]}]} 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 621 in log topic-0 of length 26559 bytes 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036205,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=65,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=621,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 648, next offset: 681, and messages: [(offset=648,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes)), (offset=649,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=650,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=651,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=652,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=653,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=654,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=655,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=656,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=657,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=658,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=659,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=660,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=661,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=662,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=663,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=664,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=665,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=666,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=667,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=668,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=669,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=670,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=671,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=672,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=673,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=674,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=675,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=676,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=677,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=678,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=679,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes)), (offset=680,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2794eab6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6340e5f0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1053 bytes 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1596146219, CreateTime = 1498860036208, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@45099dd3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 22 at position 2366 with largest timestamp 1498860036208 at shallow offset 22 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 22 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [681 [0 : 26559]] 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036204,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@5f9e7945,SendAction) 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 681 [0 : 26559] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 1287 bytes written to log topic-0 beginning at offset 648 and ending at offset 680 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 22, next offset: 23, and messages: [(offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1596146219, CreateTime = 1498860036208, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@13e344d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=648},record_set=[(offset=621,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 749248484, CreateTime = 1498860036150, key = 0 bytes, value = 5 bytes)), (offset=622,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2980544146, CreateTime = 1498860036151, key = 0 bytes, value = 5 bytes)), (offset=623,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=624,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=625,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=626,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3878931044, CreateTime = 1498860036152, key = 0 bytes, value = 5 bytes)), (offset=627,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=628,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=629,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=630,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=631,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2050763538, CreateTime = 1498860036153, key = 0 bytes, value = 5 bytes)), (offset=632,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=633,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=634,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=635,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 106761929, CreateTime = 1498860036154, key = 0 bytes, value = 5 bytes)), (offset=636,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=637,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=638,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=639,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=640,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2605903807, CreateTime = 1498860036155, key = 0 bytes, value = 5 bytes)), (offset=641,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=642,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=643,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=644,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=645,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4271850879, CreateTime = 1498860036156, key = 0 bytes, value = 5 bytes)), (offset=646,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes)), (offset=647,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 8 ms 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1098, total bytes written so far: 1098, expected bytes to write: 1098 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [23 [0 : 2453]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1ffaf86, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036201,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@a9a2bca,SendAction) 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=64,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=621,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:7,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:3,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 23 [0 : 2453] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6574a52c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=38,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:10,requestQueueTime:1,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=648,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 38 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6c1a5b54, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 22 and ending at offset 22 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 648 and error: null. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=39,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1c7696c6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 22, requiredOffset: 23] 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036212,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 22, requiredOffset: 23] 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=39,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@20140db9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=351]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1e6a3214, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@368247b9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1539886551, CreateTime = 1498860036167, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1539886551, CreateTime = 1498860036167, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2421397591, CreateTime = 1498860036169, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2421397591, CreateTime = 1498860036169, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036205,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@7a084581,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1a6d8329, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1a942c18, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@55a147cc, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@71ba6d4e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@738dc9b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3c77d488, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 559334740, CreateTime = 1498860036202, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3650391778, CreateTime = 1498860036204, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 955927119, CreateTime = 1498860036206, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1958602510, CreateTime = 1498860036210, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3920758392, CreateTime = 1498860036211, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3920758392, CreateTime = 1498860036211, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@63376bed, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 780 bytes at offset 681 at position 26559 with largest timestamp 1498860036172 at shallow offset 697 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 780 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 681 2017-06-30 23:00:36 DEBUG OffsetIndex:54 - Adding index entry 681 => 26559 to 00000000000000000000.index. 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 621 for partition topic-0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=65,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=621,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:9,requestQueueTime:1,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 621 to buffered record list 2017-06-30 23:00:36 DEBUG TimeIndex:54 - Adding index entry 1498860036172 => 697 to 00000000000000000000.timeindex. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4145bad8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@d86a6f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 27 records in fetch response for partition topic-0 with offset 621 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2892d68, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5ab956d7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 681, next offset: 701, and messages: [(offset=681,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes)), (offset=682,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1539886551, CreateTime = 1498860036167, key = 0 bytes, value = 5 bytes)), (offset=683,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1539886551, CreateTime = 1498860036167, key = 0 bytes, value = 5 bytes)), (offset=684,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=685,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=686,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=687,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=688,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=689,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2421397591, CreateTime = 1498860036169, key = 0 bytes, value = 5 bytes)), (offset=690,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2421397591, CreateTime = 1498860036169, key = 0 bytes, value = 5 bytes)), (offset=691,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=692,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=693,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=694,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=695,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=696,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=697,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=698,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=699,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=700,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3646a422, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 621 for assigned partition topic-0 and update position to 648 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@750e2b97, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3e27aa33, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 621 since the current position is 648 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2e385cce, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [701 [0 : 27339]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 701 [0 : 27339] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2ddc9a9f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 648 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@298a5e20, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 780 bytes written to log topic-0 beginning at offset 681 and ending at offset 700 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2a7f1f10, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@46cdf8bd, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 8 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@f0c8a99, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=648,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@740cae06, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@26d9b808, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@f78a47e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@644baf4a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7526515b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1ed4ae0f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036212,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@769cda47,SendAction) 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=648, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@54c5a2ff, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6d4d66d2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=66,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=648,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2a265ea9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=39,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:12,requestQueueTime:1,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=681,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=648,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=40,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1092]} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 39 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 681 and error: null. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@11392934, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036222,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=67,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=648,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036224,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=40,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1092]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6e6f2380, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@76a4ebf2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2e8c1c9b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@53fe15ff, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=66,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=648,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@449a4f23, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2357177528, CreateTime = 1498860036212, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 998628579, CreateTime = 1498860036217, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 998628579, CreateTime = 1498860036217, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3672840270, CreateTime = 1498860036219, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3672840270, CreateTime = 1498860036219, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3206984334, CreateTime = 1498860036220, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3206984334, CreateTime = 1498860036220, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 573133816, CreateTime = 1498860036221, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 573133816, CreateTime = 1498860036221, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes)), (offset=32,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4120785559, CreateTime = 1498860036174, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3118047190, CreateTime = 1498860036178, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 618036896, CreateTime = 1498860036179, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 618036896, CreateTime = 1498860036179, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1092342880, CreateTime = 1498860036180, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1092342880, CreateTime = 1498860036180, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036225,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=67,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=648,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 1092 bytes at offset 701 at position 27339 with largest timestamp 1498860036182 at shallow offset 723 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1530c739, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5b1669c0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 648, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 317522690, CreateTime = 1498860036228, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@78e4deb0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 1092 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 701 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6e9175d8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 23 at position 2453 with largest timestamp 1498860036228 at shallow offset 23 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 648 in log topic-0 of length 28431 bytes 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 23 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7d0b7e3c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 23, next offset: 24, and messages: [(offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 317522690, CreateTime = 1498860036228, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 701, next offset: 729, and messages: [(offset=701,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=702,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4120785559, CreateTime = 1498860036174, key = 0 bytes, value = 5 bytes)), (offset=703,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=704,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=705,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=706,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=707,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=708,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=709,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=710,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=711,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=712,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=713,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=714,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=715,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3118047190, CreateTime = 1498860036178, key = 0 bytes, value = 5 bytes)), (offset=716,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 618036896, CreateTime = 1498860036179, key = 0 bytes, value = 5 bytes)), (offset=717,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 618036896, CreateTime = 1498860036179, key = 0 bytes, value = 5 bytes)), (offset=718,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1092342880, CreateTime = 1498860036180, key = 0 bytes, value = 5 bytes)), (offset=719,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1092342880, CreateTime = 1498860036180, key = 0 bytes, value = 5 bytes)), (offset=720,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=721,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=722,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=723,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=724,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=725,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=726,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=727,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=728,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@15bb5034, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4b741d6d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [24 [0 : 2540]] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 24 [0 : 2540] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2eae8e6e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [729 [0 : 28431]] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@8f2ef19, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@470734c3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 23 and ending at offset 23 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 729 [0 : 28431] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 2067 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2cf3d63b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 23, requiredOffset: 24] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 23, requiredOffset: 24] 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036222,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@2ee80cc8,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7674f035, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@69e153c5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@173ed316, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 1092 bytes written to log topic-0 beginning at offset 701 and ending at offset 728 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036225,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@134eedbf,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@25ce9dc4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 2112, total bytes written so far: 2112, expected bytes to write: 2112 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@74ea2410, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=66,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=648,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:12,requestQueueTime:2,localTime:8,remoteTime:0,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=67,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=648,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:8,requestQueueTime:1,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=701},record_set=[(offset=648,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1670423561, CreateTime = 1498860036157, key = 0 bytes, value = 5 bytes)), (offset=649,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=650,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=651,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2197708964, CreateTime = 1498860036159, key = 0 bytes, value = 5 bytes)), (offset=652,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=653,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=654,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=655,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=656,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1040541463, CreateTime = 1498860036160, key = 0 bytes, value = 5 bytes)), (offset=657,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=658,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=659,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=660,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2735375969, CreateTime = 1498860036161, key = 0 bytes, value = 5 bytes)), (offset=661,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=662,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=663,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=664,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3748373434, CreateTime = 1498860036162, key = 0 bytes, value = 5 bytes)), (offset=665,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=666,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=667,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=668,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=669,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1113866956, CreateTime = 1498860036163, key = 0 bytes, value = 5 bytes)), (offset=670,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=671,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=672,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=673,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=674,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 665446412, CreateTime = 1498860036164, key = 0 bytes, value = 5 bytes)), (offset=675,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=676,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=677,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=678,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3131443578, CreateTime = 1498860036165, key = 0 bytes, value = 5 bytes)), (offset=679,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes)), (offset=680,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes)), (offset=681,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3334941857, CreateTime = 1498860036166, key = 0 bytes, value = 5 bytes)), (offset=682,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1539886551, CreateTime = 1498860036167, key = 0 bytes, value = 5 bytes)), (offset=683,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1539886551, CreateTime = 1498860036167, key = 0 bytes, value = 5 bytes)), (offset=684,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=685,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=686,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=687,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=688,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 224164129, CreateTime = 1498860036168, key = 0 bytes, value = 5 bytes)), (offset=689,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2421397591, CreateTime = 1498860036169, key = 0 bytes, value = 5 bytes)), (offset=690,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2421397591, CreateTime = 1498860036169, key = 0 bytes, value = 5 bytes)), (offset=691,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=692,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=693,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3962748300, CreateTime = 1498860036170, key = 0 bytes, value = 5 bytes)), (offset=694,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=695,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=696,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1899846906, CreateTime = 1498860036171, key = 0 bytes, value = 5 bytes)), (offset=697,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=698,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=699,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=700,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 7 ms 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 648 for partition topic-0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@17f62e33, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036224,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@48515067,SendAction) 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 648 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@76b1e9b8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=701,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 53 records in fetch response for partition topic-0 with offset 648 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 40 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=40,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1092]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:11,requestQueueTime:1,localTime:10,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@27406a17, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2af004b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 701 and error: null. 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 648 for assigned partition topic-0 and update position to 701 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@248e319b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=41,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036235,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=41,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=1014]} to node 1. 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 648 since the current position is 701 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2158910175, CreateTime = 1498860036227, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3848531999, CreateTime = 1498860036228, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3848531999, CreateTime = 1498860036228, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 67974322, CreateTime = 1498860036230, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 67974322, CreateTime = 1498860036230, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2567099844, CreateTime = 1498860036231, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2567099844, CreateTime = 1498860036231, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 788047263, CreateTime = 1498860036234, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3019326697, CreateTime = 1498860036235, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3019326697, CreateTime = 1498860036235, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3594186281, CreateTime = 1498860036236, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1031467451, CreateTime = 1498860036183, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4141982779, CreateTime = 1498860036185, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4141982779, CreateTime = 1498860036185, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 395272342, CreateTime = 1498860036187, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1916979798, CreateTime = 1498860036188, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4014811936, CreateTime = 1498860036189, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2469138171, CreateTime = 1498860036190, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 237236109, CreateTime = 1498860036191, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4083228623, CreateTime = 1498860036192, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 546 bytes at offset 729 at position 28431 with largest timestamp 1498860036193 at shallow offset 738 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@793f29ff, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 701 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3e8c3cb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 546 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 729 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@563f38c4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@543295b0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=701,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 729, next offset: 743, and messages: [(offset=729,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1031467451, CreateTime = 1498860036183, key = 0 bytes, value = 5 bytes)), (offset=730,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4141982779, CreateTime = 1498860036185, key = 0 bytes, value = 5 bytes)), (offset=731,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4141982779, CreateTime = 1498860036185, key = 0 bytes, value = 5 bytes)), (offset=732,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 395272342, CreateTime = 1498860036187, key = 0 bytes, value = 5 bytes)), (offset=733,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1916979798, CreateTime = 1498860036188, key = 0 bytes, value = 5 bytes)), (offset=734,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4014811936, CreateTime = 1498860036189, key = 0 bytes, value = 5 bytes)), (offset=735,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2469138171, CreateTime = 1498860036190, key = 0 bytes, value = 5 bytes)), (offset=736,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 237236109, CreateTime = 1498860036191, key = 0 bytes, value = 5 bytes)), (offset=737,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4083228623, CreateTime = 1498860036192, key = 0 bytes, value = 5 bytes)), (offset=738,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=739,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=740,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=741,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=742,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@54422e18, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=701, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=701,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=68,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=701,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=69,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=701,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@117159c0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3e27ba32, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036240,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036240,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=68,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=701,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [743 [0 : 28977]] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 701, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=69,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=701,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 701 in log topic-0 of length 28977 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7ef82753, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3b0fe47a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@202b0582, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@235ecd9f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 743 [0 : 28977] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1ca3b418, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1638 bytes 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1886510603, CreateTime = 1498860036242, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@58cbafc2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 24 at position 2540 with largest timestamp 1498860036242 at shallow offset 24 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2034b64c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036240,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@16c9e8d1,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@75d3a5e0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1683, total bytes written so far: 1683, expected bytes to write: 1683 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 24 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@74d1dc36, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 24, next offset: 25, and messages: [(offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1886510603, CreateTime = 1498860036242, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 546 bytes written to log topic-0 beginning at offset 729 and ending at offset 742 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=68,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=701,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:4,requestQueueTime:1,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=743},record_set=[(offset=701,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351335994, CreateTime = 1498860036172, key = 0 bytes, value = 5 bytes)), (offset=702,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4120785559, CreateTime = 1498860036174, key = 0 bytes, value = 5 bytes)), (offset=703,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=704,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=705,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=706,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=707,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1754387425, CreateTime = 1498860036175, key = 0 bytes, value = 5 bytes)), (offset=708,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=709,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=710,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1488411515, CreateTime = 1498860036176, key = 0 bytes, value = 5 bytes)), (offset=711,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=712,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=713,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=714,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3317217805, CreateTime = 1498860036177, key = 0 bytes, value = 5 bytes)), (offset=715,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3118047190, CreateTime = 1498860036178, key = 0 bytes, value = 5 bytes)), (offset=716,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 618036896, CreateTime = 1498860036179, key = 0 bytes, value = 5 bytes)), (offset=717,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 618036896, CreateTime = 1498860036179, key = 0 bytes, value = 5 bytes)), (offset=718,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1092342880, CreateTime = 1498860036180, key = 0 bytes, value = 5 bytes)), (offset=719,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1092342880, CreateTime = 1498860036180, key = 0 bytes, value = 5 bytes)), (offset=720,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=721,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=722,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3692311830, CreateTime = 1498860036181, key = 0 bytes, value = 5 bytes)), (offset=723,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=724,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=725,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=726,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=727,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=728,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2692026573, CreateTime = 1498860036182, key = 0 bytes, value = 5 bytes)), (offset=729,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1031467451, CreateTime = 1498860036183, key = 0 bytes, value = 5 bytes)), (offset=730,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4141982779, CreateTime = 1498860036185, key = 0 bytes, value = 5 bytes)), (offset=731,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4141982779, CreateTime = 1498860036185, key = 0 bytes, value = 5 bytes)), (offset=732,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 395272342, CreateTime = 1498860036187, key = 0 bytes, value = 5 bytes)), (offset=733,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1916979798, CreateTime = 1498860036188, key = 0 bytes, value = 5 bytes)), (offset=734,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4014811936, CreateTime = 1498860036189, key = 0 bytes, value = 5 bytes)), (offset=735,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2469138171, CreateTime = 1498860036190, key = 0 bytes, value = 5 bytes)), (offset=736,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 237236109, CreateTime = 1498860036191, key = 0 bytes, value = 5 bytes)), (offset=737,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4083228623, CreateTime = 1498860036192, key = 0 bytes, value = 5 bytes)), (offset=738,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=739,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=740,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=741,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes)), (offset=742,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1852767929, CreateTime = 1498860036193, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 8 ms 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7161d8d1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [25 [0 : 2627]] 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036235,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@70cd20a1,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@74e28667, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 25 [0 : 2627] 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=41,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=546]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:11,requestQueueTime:1,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1cf6d1be, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=42,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=729,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036246,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@663c9e7a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=42,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 24 and ending at offset 24 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 41 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@19e4653c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 24, requiredOffset: 25] 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 729 and error: null. 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 24, requiredOffset: 25] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@795509d9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 303029090, CreateTime = 1498860036194, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2399156756, CreateTime = 1498860036195, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2399156756, CreateTime = 1498860036195, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 195253369, CreateTime = 1498860036198, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 195253369, CreateTime = 1498860036198, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2527900943, CreateTime = 1498860036199, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2527900943, CreateTime = 1498860036199, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1563943055, CreateTime = 1498860036201, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1563943055, CreateTime = 1498860036201, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=858]} to node 1. 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 780 bytes at offset 743 at position 28977 with largest timestamp 1498860036201 at shallow offset 761 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 780 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 743 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036240,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@6013821d,SendAction) 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3594186281, CreateTime = 1498860036236, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 928262788, CreateTime = 1498860036238, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2591900520, CreateTime = 1498860036240, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2591900520, CreateTime = 1498860036240, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 124953118, CreateTime = 1498860036241, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 124953118, CreateTime = 1498860036241, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2064877509, CreateTime = 1498860036242, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2064877509, CreateTime = 1498860036242, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2211564659, CreateTime = 1498860036244, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2211564659, CreateTime = 1498860036244, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 517876997, CreateTime = 1498860036245, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 517876997, CreateTime = 1498860036245, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1656686814, CreateTime = 1498860036246, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1656686814, CreateTime = 1498860036246, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4289784232, CreateTime = 1498860036247, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=69,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=701,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:8,requestQueueTime:1,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5149d738, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 701 for partition topic-0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 743, next offset: 763, and messages: [(offset=743,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 303029090, CreateTime = 1498860036194, key = 0 bytes, value = 5 bytes)), (offset=744,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2399156756, CreateTime = 1498860036195, key = 0 bytes, value = 5 bytes)), (offset=745,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2399156756, CreateTime = 1498860036195, key = 0 bytes, value = 5 bytes)), (offset=746,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=747,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=748,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=749,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=750,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=751,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=752,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 195253369, CreateTime = 1498860036198, key = 0 bytes, value = 5 bytes)), (offset=753,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 195253369, CreateTime = 1498860036198, key = 0 bytes, value = 5 bytes)), (offset=754,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2527900943, CreateTime = 1498860036199, key = 0 bytes, value = 5 bytes)), (offset=755,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2527900943, CreateTime = 1498860036199, key = 0 bytes, value = 5 bytes)), (offset=756,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=757,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=758,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=759,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=760,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=761,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1563943055, CreateTime = 1498860036201, key = 0 bytes, value = 5 bytes)), (offset=762,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1563943055, CreateTime = 1498860036201, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 701 to buffered record list 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6bbe85a8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [763 [0 : 29757]] 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 42 records in fetch response for partition topic-0 with offset 701 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 763 [0 : 29757] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3a7442c7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4be29ed9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@548d708a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4b013c76, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@53fb3dab, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@cb0755b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@33065d67, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@712625fd, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7bba5817, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 701 for assigned partition topic-0 and update position to 743 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@742ff096, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 780 bytes written to log topic-0 beginning at offset 743 and ending at offset 762 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 701 since the current position is 743 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@75437611, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 743 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@350aac89, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1c5920df, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@17f9d882, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=743,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@79e4c792, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@196a42c3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4c60d6e9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@15043a2f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036246,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@454a8b5,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4a83a74a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=42,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:8,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=743, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=743,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1349883, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=70,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=743,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4b29d1d2, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 42 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=743,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=43,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=351]} 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 743 and error: null. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036254,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7f485fda, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036254,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=71,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=743,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=43,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=351]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036255,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=70,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=743,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 559334740, CreateTime = 1498860036202, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3650391778, CreateTime = 1498860036204, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 955927119, CreateTime = 1498860036206, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1958602510, CreateTime = 1498860036210, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3920758392, CreateTime = 1498860036211, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3920758392, CreateTime = 1498860036211, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@d737b89, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 351 bytes at offset 763 at position 29757 with largest timestamp 1498860036211 at shallow offset 770 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=71,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=743,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=936]} to node 1. 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 351 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 763 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 763, next offset: 772, and messages: [(offset=763,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 559334740, CreateTime = 1498860036202, key = 0 bytes, value = 5 bytes)), (offset=764,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3650391778, CreateTime = 1498860036204, key = 0 bytes, value = 5 bytes)), (offset=765,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 955927119, CreateTime = 1498860036206, key = 0 bytes, value = 5 bytes)), (offset=766,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=767,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=768,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=769,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1958602510, CreateTime = 1498860036210, key = 0 bytes, value = 5 bytes)), (offset=770,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3920758392, CreateTime = 1498860036211, key = 0 bytes, value = 5 bytes)), (offset=771,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3920758392, CreateTime = 1498860036211, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@8519cb4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 743, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@35dab4eb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4289784232, CreateTime = 1498860036247, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2837732702, CreateTime = 1498860036248, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 875281448, CreateTime = 1498860036249, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 875281448, CreateTime = 1498860036249, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1374033640, CreateTime = 1498860036254, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1374033640, CreateTime = 1498860036254, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4023239837, CreateTime = 1498860036257, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [772 [0 : 30108]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2d901eb0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 743 in log topic-0 of length 30108 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3ba987b8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 772 [0 : 30108] 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 25 at position 2627 with largest timestamp 1498860036257 at shallow offset 25 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 25 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 780 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3f191845, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5f049ea1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 351 bytes written to log topic-0 beginning at offset 763 and ending at offset 771 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 25, next offset: 26, and messages: [(offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4023239837, CreateTime = 1498860036257, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036254,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@46c40230,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@72cc7e6f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5afa3c9, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@72035809, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036254,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@46c4f928,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@909217e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@18271936, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@606e4010, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@8458f04, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@48075da3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=763,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=43,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=351]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:7,requestQueueTime:1,localTime:5,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [26 [0 : 2714]] 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 43 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=44,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@68c9133c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7a35b0f5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5e2c3d18, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=763},record_set=[(offset=743,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 303029090, CreateTime = 1498860036194, key = 0 bytes, value = 5 bytes)), (offset=744,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2399156756, CreateTime = 1498860036195, key = 0 bytes, value = 5 bytes)), (offset=745,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2399156756, CreateTime = 1498860036195, key = 0 bytes, value = 5 bytes)), (offset=746,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=747,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=748,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3939340500, CreateTime = 1498860036196, key = 0 bytes, value = 5 bytes)), (offset=749,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=750,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=751,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2009231778, CreateTime = 1498860036197, key = 0 bytes, value = 5 bytes)), (offset=752,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 195253369, CreateTime = 1498860036198, key = 0 bytes, value = 5 bytes)), (offset=753,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 195253369, CreateTime = 1498860036198, key = 0 bytes, value = 5 bytes)), (offset=754,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2527900943, CreateTime = 1498860036199, key = 0 bytes, value = 5 bytes)), (offset=755,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2527900943, CreateTime = 1498860036199, key = 0 bytes, value = 5 bytes)), (offset=756,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=757,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=758,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=759,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=760,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3224895993, CreateTime = 1498860036200, key = 0 bytes, value = 5 bytes)), (offset=761,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1563943055, CreateTime = 1498860036201, key = 0 bytes, value = 5 bytes)), (offset=762,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1563943055, CreateTime = 1498860036201, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 825, total bytes written so far: 825, expected bytes to write: 825 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2cb4893b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036262,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 763 and error: null. 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 26 [0 : 2714] 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=44,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=70,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=743,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:9,requestQueueTime:0,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:3,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@cc43f62, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=780]} to node 1. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2357177528, CreateTime = 1498860036212, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 998628579, CreateTime = 1498860036217, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 998628579, CreateTime = 1498860036217, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3672840270, CreateTime = 1498860036219, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3672840270, CreateTime = 1498860036219, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3206984334, CreateTime = 1498860036220, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3206984334, CreateTime = 1498860036220, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 573133816, CreateTime = 1498860036221, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 573133816, CreateTime = 1498860036221, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes)), (offset=32,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3437885342, CreateTime = 1498860036255, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 833292252, CreateTime = 1498860036256, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 833292252, CreateTime = 1498860036256, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3502621553, CreateTime = 1498860036258, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3502621553, CreateTime = 1498860036258, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1305092615, CreateTime = 1498860036259, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1305092615, CreateTime = 1498860036259, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 671582407, CreateTime = 1498860036260, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 671582407, CreateTime = 1498860036260, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 1287 bytes at offset 772 at position 30108 with largest timestamp 1498860036224 at shallow offset 803 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 25 and ending at offset 25 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 1287 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 772 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@645aa696, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 7 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6caf0677, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 25, requiredOffset: 26] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@413d1baf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 25, requiredOffset: 26] 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 772, next offset: 805, and messages: [(offset=772,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2357177528, CreateTime = 1498860036212, key = 0 bytes, value = 5 bytes)), (offset=773,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=774,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=775,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=776,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=777,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=778,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=779,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=780,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=781,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=782,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=783,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=784,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 998628579, CreateTime = 1498860036217, key = 0 bytes, value = 5 bytes)), (offset=785,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 998628579, CreateTime = 1498860036217, key = 0 bytes, value = 5 bytes)), (offset=786,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=787,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=788,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=789,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=790,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3672840270, CreateTime = 1498860036219, key = 0 bytes, value = 5 bytes)), (offset=791,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3672840270, CreateTime = 1498860036219, key = 0 bytes, value = 5 bytes)), (offset=792,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3206984334, CreateTime = 1498860036220, key = 0 bytes, value = 5 bytes)), (offset=793,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3206984334, CreateTime = 1498860036220, key = 0 bytes, value = 5 bytes)), (offset=794,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 573133816, CreateTime = 1498860036221, key = 0 bytes, value = 5 bytes)), (offset=795,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 573133816, CreateTime = 1498860036221, key = 0 bytes, value = 5 bytes)), (offset=796,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=797,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=798,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=799,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=800,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=801,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=802,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=803,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes)), (offset=804,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@16eb3ea3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@273444fe, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036255,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@5f15fa61,SendAction) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=71,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=743,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:12,requestQueueTime:1,localTime:11,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@33bc72d1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [805 [0 : 31395]] 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 743 for partition topic-0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1a75e76a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 743 to buffered record list 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 805 [0 : 31395] 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 20 records in fetch response for partition topic-0 with offset 743 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5524cca1, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 743 for assigned partition topic-0 and update position to 763 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 743 since the current position is 763 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5032714f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 763 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@48bb62, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 1287 bytes written to log topic-0 beginning at offset 772 and ending at offset 804 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=763,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@353352b6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4681c175, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@57a78e3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@402c4085, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6fa51cd4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2767e23c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036262,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@236a88f4,SendAction) 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=763, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=44,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1287]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:9,requestQueueTime:0,localTime:8,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=772,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@710c2b53, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=72,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=763,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5386659f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 44 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=45,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1014]} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=763,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036271,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 772 and error: null. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@14028087, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=73,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=763,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036270,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036273,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=45,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1014]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=741]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1caa0244, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7ce026d3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=73,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=763,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=72,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=763,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 763, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7ce69770, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1750fbeb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2684221596, CreateTime = 1498860036265, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 459183857, CreateTime = 1498860036268, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 459183857, CreateTime = 1498860036268, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1732227882, CreateTime = 1498860036271, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1732227882, CreateTime = 1498860036271, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2158910175, CreateTime = 1498860036227, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3848531999, CreateTime = 1498860036228, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3848531999, CreateTime = 1498860036228, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 67974322, CreateTime = 1498860036230, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 67974322, CreateTime = 1498860036230, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2567099844, CreateTime = 1498860036231, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2567099844, CreateTime = 1498860036231, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 788047263, CreateTime = 1498860036234, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3019326697, CreateTime = 1498860036235, key = 0 bytes, value = 5 bytes)), (offset=24,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3019326697, CreateTime = 1498860036235, key = 0 bytes, value = 5 bytes)), (offset=25,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3594186281, CreateTime = 1498860036236, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5b247367, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 9580788, CreateTime = 1498860036275, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 763 in log topic-0 of length 31395 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@268f106e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 1014 bytes at offset 805 at position 31395 with largest timestamp 1498860036236 at shallow offset 830 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6e9a5ed8, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 26 at position 2714 with largest timestamp 1498860036275 at shallow offset 26 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1638 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7e057f43, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 1014 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 805 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6c284af, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036270,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@6a3ce4e4,SendAction) 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 26 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5890e879, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG OffsetIndex:54 - Adding index entry 805 => 31395 to 00000000000000000000.index. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6440112d, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 26, next offset: 27, and messages: [(offset=26,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 9580788, CreateTime = 1498860036275, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1683, total bytes written so far: 1683, expected bytes to write: 1683 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@31ea9581, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG TimeIndex:54 - Adding index entry 1498860036236 => 830 to 00000000000000000000.timeindex. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@231f98ef, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=805},record_set=[(offset=763,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 559334740, CreateTime = 1498860036202, key = 0 bytes, value = 5 bytes)), (offset=764,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3650391778, CreateTime = 1498860036204, key = 0 bytes, value = 5 bytes)), (offset=765,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 955927119, CreateTime = 1498860036206, key = 0 bytes, value = 5 bytes)), (offset=766,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=767,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=768,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2513642403, CreateTime = 1498860036208, key = 0 bytes, value = 5 bytes)), (offset=769,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1958602510, CreateTime = 1498860036210, key = 0 bytes, value = 5 bytes)), (offset=770,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3920758392, CreateTime = 1498860036211, key = 0 bytes, value = 5 bytes)), (offset=771,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3920758392, CreateTime = 1498860036211, key = 0 bytes, value = 5 bytes)), (offset=772,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2357177528, CreateTime = 1498860036212, key = 0 bytes, value = 5 bytes)), (offset=773,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=774,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=775,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=776,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=777,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=778,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1829857301, CreateTime = 1498860036214, key = 0 bytes, value = 5 bytes)), (offset=779,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=780,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=781,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=782,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=783,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4028533091, CreateTime = 1498860036215, key = 0 bytes, value = 5 bytes)), (offset=784,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 998628579, CreateTime = 1498860036217, key = 0 bytes, value = 5 bytes)), (offset=785,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 998628579, CreateTime = 1498860036217, key = 0 bytes, value = 5 bytes)), (offset=786,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=787,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=788,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=789,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1206188344, CreateTime = 1498860036218, key = 0 bytes, value = 5 bytes)), (offset=790,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3672840270, CreateTime = 1498860036219, key = 0 bytes, value = 5 bytes)), (offset=791,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3672840270, CreateTime = 1498860036219, key = 0 bytes, value = 5 bytes)), (offset=792,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3206984334, CreateTime = 1498860036220, key = 0 bytes, value = 5 bytes)), (offset=793,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3206984334, CreateTime = 1498860036220, key = 0 bytes, value = 5 bytes)), (offset=794,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 573133816, CreateTime = 1498860036221, key = 0 bytes, value = 5 bytes)), (offset=795,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 573133816, CreateTime = 1498860036221, key = 0 bytes, value = 5 bytes)), (offset=796,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=797,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=798,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1581807139, CreateTime = 1498860036222, key = 0 bytes, value = 5 bytes)), (offset=799,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=800,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=801,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=802,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3276248917, CreateTime = 1498860036223, key = 0 bytes, value = 5 bytes)), (offset=803,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes)), (offset=804,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [27 [0 : 2801]] 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=72,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=763,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:8,requestQueueTime:2,localTime:5,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 27 [0 : 2801] 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 805, next offset: 831, and messages: [(offset=805,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes)), (offset=806,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=807,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=808,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=809,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=810,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=811,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2158910175, CreateTime = 1498860036227, key = 0 bytes, value = 5 bytes)), (offset=812,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3848531999, CreateTime = 1498860036228, key = 0 bytes, value = 5 bytes)), (offset=813,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3848531999, CreateTime = 1498860036228, key = 0 bytes, value = 5 bytes)), (offset=814,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=815,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=816,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=817,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 67974322, CreateTime = 1498860036230, key = 0 bytes, value = 5 bytes)), (offset=818,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 67974322, CreateTime = 1498860036230, key = 0 bytes, value = 5 bytes)), (offset=819,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2567099844, CreateTime = 1498860036231, key = 0 bytes, value = 5 bytes)), (offset=820,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2567099844, CreateTime = 1498860036231, key = 0 bytes, value = 5 bytes)), (offset=821,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=822,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=823,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=824,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=825,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=826,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=827,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 788047263, CreateTime = 1498860036234, key = 0 bytes, value = 5 bytes)), (offset=828,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3019326697, CreateTime = 1498860036235, key = 0 bytes, value = 5 bytes)), (offset=829,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3019326697, CreateTime = 1498860036235, key = 0 bytes, value = 5 bytes)), (offset=830,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3594186281, CreateTime = 1498860036236, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7c137fd5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [831 [0 : 32409]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@183ec003, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 831 [0 : 32409] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7d9d0818, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 26 and ending at offset 26 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 1014 bytes written to log topic-0 beginning at offset 805 and ending at offset 830 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@221a3fa4, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 7 ms 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 6 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@451001e5, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 26, requiredOffset: 27] 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036271,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@25a8d2c,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2b40ff9c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 26, requiredOffset: 27] 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=45,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=1014]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:10,requestQueueTime:1,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=805,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3e08ff24, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=46,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=858]} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 45 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 805 and error: null. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036282,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4d1c005e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=819]} to node 1. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=46,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=858]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036273,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@6469cad5,SendAction) 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=73,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=763,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:10,requestQueueTime:0,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3594186281, CreateTime = 1498860036236, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 928262788, CreateTime = 1498860036238, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2591900520, CreateTime = 1498860036240, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2591900520, CreateTime = 1498860036240, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 124953118, CreateTime = 1498860036241, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 124953118, CreateTime = 1498860036241, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2064877509, CreateTime = 1498860036242, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2064877509, CreateTime = 1498860036242, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2211564659, CreateTime = 1498860036244, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2211564659, CreateTime = 1498860036244, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 517876997, CreateTime = 1498860036245, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 517876997, CreateTime = 1498860036245, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1656686814, CreateTime = 1498860036246, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1656686814, CreateTime = 1498860036246, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4289784232, CreateTime = 1498860036247, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 858 bytes at offset 831 at position 32409 with largest timestamp 1498860036247 at shallow offset 852 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1461271472, CreateTime = 1498860036272, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 729292395, CreateTime = 1498860036275, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1320531115, CreateTime = 1498860036276, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1320531115, CreateTime = 1498860036276, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 852791664, CreateTime = 1498860036279, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 852791664, CreateTime = 1498860036279, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1681925510, CreateTime = 1498860036280, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1681925510, CreateTime = 1498860036280, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 858 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 831 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 763 for partition topic-0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 763 to buffered record list 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 42 records in fetch response for partition topic-0 with offset 763 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 763 for assigned partition topic-0 and update position to 805 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 763 since the current position is 805 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 805 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=805,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=805, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=805,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@24569dba, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5ddeb7cb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@70ed52de, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@496bc455, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=74,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=805,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 831, next offset: 853, and messages: [(offset=831,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3594186281, CreateTime = 1498860036236, key = 0 bytes, value = 5 bytes)), (offset=832,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 928262788, CreateTime = 1498860036238, key = 0 bytes, value = 5 bytes)), (offset=833,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=834,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=835,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=836,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2591900520, CreateTime = 1498860036240, key = 0 bytes, value = 5 bytes)), (offset=837,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2591900520, CreateTime = 1498860036240, key = 0 bytes, value = 5 bytes)), (offset=838,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 124953118, CreateTime = 1498860036241, key = 0 bytes, value = 5 bytes)), (offset=839,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 124953118, CreateTime = 1498860036241, key = 0 bytes, value = 5 bytes)), (offset=840,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2064877509, CreateTime = 1498860036242, key = 0 bytes, value = 5 bytes)), (offset=841,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2064877509, CreateTime = 1498860036242, key = 0 bytes, value = 5 bytes)), (offset=842,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=843,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=844,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=845,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=846,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2211564659, CreateTime = 1498860036244, key = 0 bytes, value = 5 bytes)), (offset=847,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2211564659, CreateTime = 1498860036244, key = 0 bytes, value = 5 bytes)), (offset=848,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 517876997, CreateTime = 1498860036245, key = 0 bytes, value = 5 bytes)), (offset=849,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 517876997, CreateTime = 1498860036245, key = 0 bytes, value = 5 bytes)), (offset=850,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1656686814, CreateTime = 1498860036246, key = 0 bytes, value = 5 bytes)), (offset=851,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1656686814, CreateTime = 1498860036246, key = 0 bytes, value = 5 bytes)), (offset=852,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4289784232, CreateTime = 1498860036247, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036285,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@59402b8f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=75,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=805,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7188af83, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6be968ce, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=74,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=805,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 805, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [853 [0 : 33267]] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7c37508a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036286,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@247310d0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 853 [0 : 33267] 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 805 in log topic-0 of length 33267 bytes 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1033576a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=75,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=805,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@303cf2ba, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 858 bytes written to log topic-0 beginning at offset 831 and ending at offset 852 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 8 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@76494737, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1872 bytes 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036282,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@14dff2cb,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4a003cbe, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4082ba93, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@17fc391b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 78666832, CreateTime = 1498860036291, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2b30a42c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 27 at position 2801 with largest timestamp 1498860036291 at shallow offset 27 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=831,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=46,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=858]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:9,requestQueueTime:0,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036285,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@4dc2b27,SendAction) 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=47,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=936]} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 46 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 831 and error: null. 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 27 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@609e8838, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 27, next offset: 28, and messages: [(offset=27,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 78666832, CreateTime = 1498860036291, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036292,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=663]} to node 1. 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=853},record_set=[(offset=805,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4241456900, CreateTime = 1498860036224, key = 0 bytes, value = 5 bytes)), (offset=806,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=807,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=808,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=809,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=810,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 497138601, CreateTime = 1498860036226, key = 0 bytes, value = 5 bytes)), (offset=811,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2158910175, CreateTime = 1498860036227, key = 0 bytes, value = 5 bytes)), (offset=812,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3848531999, CreateTime = 1498860036228, key = 0 bytes, value = 5 bytes)), (offset=813,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3848531999, CreateTime = 1498860036228, key = 0 bytes, value = 5 bytes)), (offset=814,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=815,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=816,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2020348265, CreateTime = 1498860036229, key = 0 bytes, value = 5 bytes)), (offset=817,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 67974322, CreateTime = 1498860036230, key = 0 bytes, value = 5 bytes)), (offset=818,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 67974322, CreateTime = 1498860036230, key = 0 bytes, value = 5 bytes)), (offset=819,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2567099844, CreateTime = 1498860036231, key = 0 bytes, value = 5 bytes)), (offset=820,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2567099844, CreateTime = 1498860036231, key = 0 bytes, value = 5 bytes)), (offset=821,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=822,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=823,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3482738994, CreateTime = 1498860036232, key = 0 bytes, value = 5 bytes)), (offset=824,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=825,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=826,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1385791556, CreateTime = 1498860036233, key = 0 bytes, value = 5 bytes)), (offset=827,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 788047263, CreateTime = 1498860036234, key = 0 bytes, value = 5 bytes)), (offset=828,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3019326697, CreateTime = 1498860036235, key = 0 bytes, value = 5 bytes)), (offset=829,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3019326697, CreateTime = 1498860036235, key = 0 bytes, value = 5 bytes)), (offset=830,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3594186281, CreateTime = 1498860036236, key = 0 bytes, value = 5 bytes)), (offset=831,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3594186281, CreateTime = 1498860036236, key = 0 bytes, value = 5 bytes)), (offset=832,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 928262788, CreateTime = 1498860036238, key = 0 bytes, value = 5 bytes)), (offset=833,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=834,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=835,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2858142706, CreateTime = 1498860036239, key = 0 bytes, value = 5 bytes)), (offset=836,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2591900520, CreateTime = 1498860036240, key = 0 bytes, value = 5 bytes)), (offset=837,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2591900520, CreateTime = 1498860036240, key = 0 bytes, value = 5 bytes)), (offset=838,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 124953118, CreateTime = 1498860036241, key = 0 bytes, value = 5 bytes)), (offset=839,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 124953118, CreateTime = 1498860036241, key = 0 bytes, value = 5 bytes)), (offset=840,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2064877509, CreateTime = 1498860036242, key = 0 bytes, value = 5 bytes)), (offset=841,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2064877509, CreateTime = 1498860036242, key = 0 bytes, value = 5 bytes)), (offset=842,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=843,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=844,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=845,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3860620979, CreateTime = 1498860036243, key = 0 bytes, value = 5 bytes)), (offset=846,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2211564659, CreateTime = 1498860036244, key = 0 bytes, value = 5 bytes)), (offset=847,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2211564659, CreateTime = 1498860036244, key = 0 bytes, value = 5 bytes)), (offset=848,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 517876997, CreateTime = 1498860036245, key = 0 bytes, value = 5 bytes)), (offset=849,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 517876997, CreateTime = 1498860036245, key = 0 bytes, value = 5 bytes)), (offset=850,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1656686814, CreateTime = 1498860036246, key = 0 bytes, value = 5 bytes)), (offset=851,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1656686814, CreateTime = 1498860036246, key = 0 bytes, value = 5 bytes)), (offset=852,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4289784232, CreateTime = 1498860036247, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2234442027, CreateTime = 1498860036282, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 26054470, CreateTime = 1498860036287, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 26054470, CreateTime = 1498860036287, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 544827779, CreateTime = 1498860036289, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 544827779, CreateTime = 1498860036289, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1545096280, CreateTime = 1498860036290, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1545096280, CreateTime = 1498860036290, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1917, total bytes written so far: 1917, expected bytes to write: 1917 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=47,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=936]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=74,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=805,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:9,requestQueueTime:2,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:3,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [28 [0 : 2888]] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4289784232, CreateTime = 1498860036247, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2837732702, CreateTime = 1498860036248, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 875281448, CreateTime = 1498860036249, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 875281448, CreateTime = 1498860036249, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=21,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=22,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1374033640, CreateTime = 1498860036254, key = 0 bytes, value = 5 bytes)), (offset=23,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1374033640, CreateTime = 1498860036254, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 936 bytes at offset 853 at position 33267 with largest timestamp 1498860036254 at shallow offset 875 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 936 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 853 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 28 [0 : 2888] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 853, next offset: 877, and messages: [(offset=853,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4289784232, CreateTime = 1498860036247, key = 0 bytes, value = 5 bytes)), (offset=854,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2837732702, CreateTime = 1498860036248, key = 0 bytes, value = 5 bytes)), (offset=855,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 875281448, CreateTime = 1498860036249, key = 0 bytes, value = 5 bytes)), (offset=856,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 875281448, CreateTime = 1498860036249, key = 0 bytes, value = 5 bytes)), (offset=857,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=858,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=859,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=860,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=861,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=862,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=863,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=864,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=865,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=866,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=867,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=868,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=869,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=870,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=871,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=872,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=873,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=874,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=875,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1374033640, CreateTime = 1498860036254, key = 0 bytes, value = 5 bytes)), (offset=876,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1374033640, CreateTime = 1498860036254, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 27 and ending at offset 27 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@43df23d3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 27, requiredOffset: 28] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 27, requiredOffset: 28] 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6d60fe40, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036286,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@6305f58c,SendAction) 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [877 [0 : 34203]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 877 [0 : 34203] 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@792b749c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@23e84203, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 805 for partition topic-0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=75,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=805,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:11,requestQueueTime:2,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 805 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@19932c16, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 48 records in fetch response for partition topic-0 with offset 805 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 805 for assigned partition topic-0 and update position to 853 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@73eb439a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 805 since the current position is 853 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 936 bytes written to log topic-0 beginning at offset 853 and ending at offset 876 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 853 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@514646ef, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 5 ms 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=853,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@305ffe9e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@302c971f, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=853, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036292,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@3560372d,SendAction) 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=76,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=853,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=853,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=47,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=936]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:8,requestQueueTime:0,localTime:8,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1972e513, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7ae0a9ec, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036300,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=853,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=76,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=853,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@35841320, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=48,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@61c4eee0, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6f10d5b6, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 853, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 47 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 853 in log topic-0 of length 34203 bytes 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@1040be71, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@548a24a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@433defed, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@2a693f59, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036301,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=77,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=853,metadata=}]}]} 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=48,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@3f4faf53, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 936 bytes 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 853 and error: null. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7fd50002, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036301,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3437885342, CreateTime = 1498860036255, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 833292252, CreateTime = 1498860036256, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 833292252, CreateTime = 1498860036256, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3502621553, CreateTime = 1498860036258, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3502621553, CreateTime = 1498860036258, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1305092615, CreateTime = 1498860036259, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1305092615, CreateTime = 1498860036259, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 671582407, CreateTime = 1498860036260, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 671582407, CreateTime = 1498860036260, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036300,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@5d8ac40d,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@304bb45b, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=780]} to node 1. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=77,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=853,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@723ca036, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 981, total bytes written so far: 981, expected bytes to write: 981 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 780 bytes at offset 877 at position 34203 with largest timestamp 1498860036263 at shallow offset 895 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2765752302, CreateTime = 1498860036292, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3636142645, CreateTime = 1498860036295, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2385483459, CreateTime = 1498860036296, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 320894901, CreateTime = 1498860036297, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1866551918, CreateTime = 1498860036298, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1866551918, CreateTime = 1498860036298, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4065243928, CreateTime = 1498860036299, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4065243928, CreateTime = 1498860036299, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=877},record_set=[(offset=853,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4289784232, CreateTime = 1498860036247, key = 0 bytes, value = 5 bytes)), (offset=854,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2837732702, CreateTime = 1498860036248, key = 0 bytes, value = 5 bytes)), (offset=855,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 875281448, CreateTime = 1498860036249, key = 0 bytes, value = 5 bytes)), (offset=856,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 875281448, CreateTime = 1498860036249, key = 0 bytes, value = 5 bytes)), (offset=857,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=858,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=859,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=860,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=861,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=862,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=863,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1212848627, CreateTime = 1498860036250, key = 0 bytes, value = 5 bytes)), (offset=864,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=865,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=866,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3578099845, CreateTime = 1498860036251, key = 0 bytes, value = 5 bytes)), (offset=867,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=868,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=869,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=870,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2961756741, CreateTime = 1498860036252, key = 0 bytes, value = 5 bytes)), (offset=871,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=872,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=873,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=874,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 763835187, CreateTime = 1498860036253, key = 0 bytes, value = 5 bytes)), (offset=875,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1374033640, CreateTime = 1498860036254, key = 0 bytes, value = 5 bytes)), (offset=876,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1374033640, CreateTime = 1498860036254, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@25be7b63, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1643578547, CreateTime = 1498860036306, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 780 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 877 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=76,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=853,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:6,requestQueueTime:0,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:3,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 28 at position 2888 with largest timestamp 1498860036306 at shallow offset 28 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 28 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@28dcca0c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 28, next offset: 29, and messages: [(offset=28,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1643578547, CreateTime = 1498860036306, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 877, next offset: 897, and messages: [(offset=877,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3437885342, CreateTime = 1498860036255, key = 0 bytes, value = 5 bytes)), (offset=878,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 833292252, CreateTime = 1498860036256, key = 0 bytes, value = 5 bytes)), (offset=879,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 833292252, CreateTime = 1498860036256, key = 0 bytes, value = 5 bytes)), (offset=880,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3502621553, CreateTime = 1498860036258, key = 0 bytes, value = 5 bytes)), (offset=881,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3502621553, CreateTime = 1498860036258, key = 0 bytes, value = 5 bytes)), (offset=882,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1305092615, CreateTime = 1498860036259, key = 0 bytes, value = 5 bytes)), (offset=883,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1305092615, CreateTime = 1498860036259, key = 0 bytes, value = 5 bytes)), (offset=884,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 671582407, CreateTime = 1498860036260, key = 0 bytes, value = 5 bytes)), (offset=885,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 671582407, CreateTime = 1498860036260, key = 0 bytes, value = 5 bytes)), (offset=886,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=887,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=888,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=889,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=890,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=891,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=892,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=893,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=894,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=895,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes)), (offset=896,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@45d84a20, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [29 [0 : 2975]] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 29 [0 : 2975] 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@52f27fbd, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [897 [0 : 34983]] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4c163e3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 28 and ending at offset 28 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 897 [0 : 34983] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4a8355dd, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 28, requiredOffset: 29] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 28, requiredOffset: 29] 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4d0d9fe7, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036301,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@1f757c36,SendAction) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 780 bytes written to log topic-0 beginning at offset 877 and ending at offset 896 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@c430e6c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 7 ms 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=77,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=853,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:9,requestQueueTime:2,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@312aa7c, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 853 for partition topic-0 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036301,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@74d78cb9,SendAction) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@536f2a7e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@72bc6553, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 853 to buffered record list 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@66982506, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=48,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:9,requestQueueTime:0,localTime:9,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=877,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 48 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@70cf32e3, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 24 records in fetch response for partition topic-0 with offset 853 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5a59ca5e, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 877 and error: null. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=49,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=741]} 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4bdeaabb, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 853 for assigned partition topic-0 and update position to 877 2017-06-30 23:00:36 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036311,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=49,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=741]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaProducer:480 - Waking up the sender since topic topic partition 0 is either full or getting a new batch 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 853 since the current position is 877 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@65987993, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=663]} to node 1. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2684221596, CreateTime = 1498860036265, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 459183857, CreateTime = 1498860036268, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 459183857, CreateTime = 1498860036268, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1732227882, CreateTime = 1498860036271, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1732227882, CreateTime = 1498860036271, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@71075444, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 877 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3957472259, CreateTime = 1498860036303, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3687101593, CreateTime = 1498860036304, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3687101593, CreateTime = 1498860036304, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1187730927, CreateTime = 1498860036305, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2812645698, CreateTime = 1498860036307, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2812645698, CreateTime = 1498860036307, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3261610882, CreateTime = 1498860036308, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3261610882, CreateTime = 1498860036308, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 587661103, CreateTime = 1498860036310, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 587661103, CreateTime = 1498860036310, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4f32a3ad, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6b695b06, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@4d1bf319, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@6f53b8a, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@5c80cf32, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=topic, partition=null, key=null, value=[B@7d900ecf, timestamp=null) with callback null to topic topic partition 0 2017-06-30 23:00:36 TRACE KafkaProducer:617 - Flushing accumulated records in producer. 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 741 bytes at offset 897 at position 34983 with largest timestamp 1498860036271 at shallow offset 914 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 741 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 897 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 897, next offset: 916, and messages: [(offset=897,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes)), (offset=898,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2684221596, CreateTime = 1498860036265, key = 0 bytes, value = 5 bytes)), (offset=899,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=900,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=901,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=902,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=903,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=904,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=905,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 459183857, CreateTime = 1498860036268, key = 0 bytes, value = 5 bytes)), (offset=906,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 459183857, CreateTime = 1498860036268, key = 0 bytes, value = 5 bytes)), (offset=907,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=908,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=909,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=910,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=911,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=912,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=913,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=914,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1732227882, CreateTime = 1498860036271, key = 0 bytes, value = 5 bytes)), (offset=915,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1732227882, CreateTime = 1498860036271, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [916 [0 : 35724]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 916 [0 : 35724] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 741 bytes written to log topic-0 beginning at offset 897 and ending at offset 915 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=877,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=877, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=877,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=79,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=877,metadata=}]}]} 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036311,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@38b2be3a,SendAction) 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=78,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=877,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=897,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 49 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 897 and error: null. 2017-06-30 23:00:36 TRACE Sender:216 - Nodes with data ready to send: [localhost:52135 (id: 1 rack: null)] 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[topic-0=351]} to node 1. 2017-06-30 23:00:36 TRACE Sender:365 - Sent produce request to 1: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({topic-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3902646959, CreateTime = 1498860036312, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3902646959, CreateTime = 1498860036312, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes))]})) 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036316,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=49,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=741]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:5,requestQueueTime:1,localTime:3,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=79,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=877,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036316,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=78,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=877,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=50,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 877, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036317,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 121957240, CreateTime = 1498860036322, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=50,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 877 in log topic-0 of length 35724 bytes 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 29 at position 2975 with largest timestamp 1498860036322 at shallow offset 29 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 29 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1461271472, CreateTime = 1498860036272, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 729292395, CreateTime = 1498860036275, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1320531115, CreateTime = 1498860036276, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1320531115, CreateTime = 1498860036276, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 852791664, CreateTime = 1498860036279, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 852791664, CreateTime = 1498860036279, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1681925510, CreateTime = 1498860036280, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1681925510, CreateTime = 1498860036280, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes)), (offset=20,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 819 bytes at offset 916 at position 35724 with largest timestamp 1498860036281 at shallow offset 934 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 819 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 916 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 29, next offset: 30, and messages: [(offset=29,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 121957240, CreateTime = 1498860036322, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG OffsetIndex:54 - Adding index entry 916 => 35724 to 00000000000000000000.index. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1521 bytes 2017-06-30 23:00:36 DEBUG TimeIndex:54 - Adding index entry 1498860036281 => 934 to 00000000000000000000.timeindex. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [30 [0 : 3062]] 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036316,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@3c666b2d,SendAction) 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 30 [0 : 3062] 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 916, next offset: 937, and messages: [(offset=916,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1461271472, CreateTime = 1498860036272, key = 0 bytes, value = 5 bytes)), (offset=917,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=918,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=919,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=920,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 729292395, CreateTime = 1498860036275, key = 0 bytes, value = 5 bytes)), (offset=921,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1320531115, CreateTime = 1498860036276, key = 0 bytes, value = 5 bytes)), (offset=922,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1320531115, CreateTime = 1498860036276, key = 0 bytes, value = 5 bytes)), (offset=923,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=924,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=925,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=926,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=927,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=928,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=929,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=930,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 852791664, CreateTime = 1498860036279, key = 0 bytes, value = 5 bytes)), (offset=931,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 852791664, CreateTime = 1498860036279, key = 0 bytes, value = 5 bytes)), (offset=932,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1681925510, CreateTime = 1498860036280, key = 0 bytes, value = 5 bytes)), (offset=933,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1681925510, CreateTime = 1498860036280, key = 0 bytes, value = 5 bytes)), (offset=934,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes)), (offset=935,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes)), (offset=936,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1566, total bytes written so far: 1566, expected bytes to write: 1566 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 29 and ending at offset 29 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=916},record_set=[(offset=877,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3437885342, CreateTime = 1498860036255, key = 0 bytes, value = 5 bytes)), (offset=878,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 833292252, CreateTime = 1498860036256, key = 0 bytes, value = 5 bytes)), (offset=879,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 833292252, CreateTime = 1498860036256, key = 0 bytes, value = 5 bytes)), (offset=880,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3502621553, CreateTime = 1498860036258, key = 0 bytes, value = 5 bytes)), (offset=881,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3502621553, CreateTime = 1498860036258, key = 0 bytes, value = 5 bytes)), (offset=882,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1305092615, CreateTime = 1498860036259, key = 0 bytes, value = 5 bytes)), (offset=883,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1305092615, CreateTime = 1498860036259, key = 0 bytes, value = 5 bytes)), (offset=884,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 671582407, CreateTime = 1498860036260, key = 0 bytes, value = 5 bytes)), (offset=885,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 671582407, CreateTime = 1498860036260, key = 0 bytes, value = 5 bytes)), (offset=886,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=887,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=888,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=889,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=890,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3037227441, CreateTime = 1498860036261, key = 0 bytes, value = 5 bytes)), (offset=891,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=892,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=893,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=894,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3379121258, CreateTime = 1498860036262, key = 0 bytes, value = 5 bytes)), (offset=895,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes)), (offset=896,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes)), (offset=897,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1416015132, CreateTime = 1498860036263, key = 0 bytes, value = 5 bytes)), (offset=898,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2684221596, CreateTime = 1498860036265, key = 0 bytes, value = 5 bytes)), (offset=899,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=900,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=901,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3818708295, CreateTime = 1498860036266, key = 0 bytes, value = 5 bytes)), (offset=902,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=903,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=904,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2123578417, CreateTime = 1498860036267, key = 0 bytes, value = 5 bytes)), (offset=905,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 459183857, CreateTime = 1498860036268, key = 0 bytes, value = 5 bytes)), (offset=906,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 459183857, CreateTime = 1498860036268, key = 0 bytes, value = 5 bytes)), (offset=907,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=908,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=909,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2253485959, CreateTime = 1498860036269, key = 0 bytes, value = 5 bytes)), (offset=910,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=911,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=912,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=913,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4197470812, CreateTime = 1498860036270, key = 0 bytes, value = 5 bytes)), (offset=914,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1732227882, CreateTime = 1498860036271, key = 0 bytes, value = 5 bytes)), (offset=915,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1732227882, CreateTime = 1498860036271, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=78,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=877,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:9,requestQueueTime:1,localTime:7,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 29, requiredOffset: 30] 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [937 [0 : 36543]] 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 29, requiredOffset: 30] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 937 [0 : 36543] 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036316,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@cdf2f5e,SendAction) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 819 bytes written to log topic-0 beginning at offset 916 and ending at offset 936 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=79,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=877,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:10,requestQueueTime:0,localTime:10,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036317,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@387f763f,SendAction) 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 877 for partition topic-0 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=916,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 877 to buffered record list 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=50,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=819]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:9,requestQueueTime:5,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 39 records in fetch response for partition topic-0 with offset 877 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 50 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=51,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 877 for assigned partition topic-0 and update position to 916 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036327,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 916 and error: null. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=51,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 877 since the current position is 916 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 916 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2234442027, CreateTime = 1498860036282, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 26054470, CreateTime = 1498860036287, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 26054470, CreateTime = 1498860036287, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 544827779, CreateTime = 1498860036289, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 544827779, CreateTime = 1498860036289, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1545096280, CreateTime = 1498860036290, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1545096280, CreateTime = 1498860036290, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=916,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 663 bytes at offset 937 at position 36543 with largest timestamp 1498860036291 at shallow offset 950 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=916, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 663 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 937 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=80,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=916,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=916,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036328,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 937, next offset: 954, and messages: [(offset=937,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2234442027, CreateTime = 1498860036282, key = 0 bytes, value = 5 bytes)), (offset=938,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=939,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=940,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=941,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 26054470, CreateTime = 1498860036287, key = 0 bytes, value = 5 bytes)), (offset=942,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 26054470, CreateTime = 1498860036287, key = 0 bytes, value = 5 bytes)), (offset=943,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=944,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=945,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=946,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 544827779, CreateTime = 1498860036289, key = 0 bytes, value = 5 bytes)), (offset=947,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 544827779, CreateTime = 1498860036289, key = 0 bytes, value = 5 bytes)), (offset=948,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1545096280, CreateTime = 1498860036290, key = 0 bytes, value = 5 bytes)), (offset=949,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1545096280, CreateTime = 1498860036290, key = 0 bytes, value = 5 bytes)), (offset=950,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=951,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=952,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=953,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=80,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=916,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=81,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=916,metadata=}]}]} 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 916, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 916 in log topic-0 of length 37206 bytes 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036328,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [954 [0 : 37206]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 954 [0 : 37206] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=81,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=916,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 663 bytes written to log topic-0 beginning at offset 937 and ending at offset 953 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 819 bytes 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 3 ms 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036328,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@31f0b381,SendAction) 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036327,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@700587cd,SendAction) 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 864, total bytes written so far: 864, expected bytes to write: 864 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=51,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:3,requestQueueTime:0,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=80,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=916,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:2,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2042435472, CreateTime = 1498860036330, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=937,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 30 at position 3062 with largest timestamp 1498860036330 at shallow offset 30 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=52,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=937},record_set=[(offset=916,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1461271472, CreateTime = 1498860036272, key = 0 bytes, value = 5 bytes)), (offset=917,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=918,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=919,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3061317405, CreateTime = 1498860036274, key = 0 bytes, value = 5 bytes)), (offset=920,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 729292395, CreateTime = 1498860036275, key = 0 bytes, value = 5 bytes)), (offset=921,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1320531115, CreateTime = 1498860036276, key = 0 bytes, value = 5 bytes)), (offset=922,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1320531115, CreateTime = 1498860036276, key = 0 bytes, value = 5 bytes)), (offset=923,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=924,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=925,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3552204253, CreateTime = 1498860036277, key = 0 bytes, value = 5 bytes)), (offset=926,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=927,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=928,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=929,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2950393862, CreateTime = 1498860036278, key = 0 bytes, value = 5 bytes)), (offset=930,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 852791664, CreateTime = 1498860036279, key = 0 bytes, value = 5 bytes)), (offset=931,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 852791664, CreateTime = 1498860036279, key = 0 bytes, value = 5 bytes)), (offset=932,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1681925510, CreateTime = 1498860036280, key = 0 bytes, value = 5 bytes)), (offset=933,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1681925510, CreateTime = 1498860036280, key = 0 bytes, value = 5 bytes)), (offset=934,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes)), (offset=935,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes)), (offset=936,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4182754544, CreateTime = 1498860036281, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036331,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 30 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 51 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 30, next offset: 31, and messages: [(offset=30,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2042435472, CreateTime = 1498860036330, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=52,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 937 and error: null. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [31 [0 : 3149]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 31 [0 : 3149] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2765752302, CreateTime = 1498860036292, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3636142645, CreateTime = 1498860036295, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2385483459, CreateTime = 1498860036296, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 320894901, CreateTime = 1498860036297, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1866551918, CreateTime = 1498860036298, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1866551918, CreateTime = 1498860036298, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4065243928, CreateTime = 1498860036299, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4065243928, CreateTime = 1498860036299, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=17,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=18,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=19,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 780 bytes at offset 954 at position 37206 with largest timestamp 1498860036302 at shallow offset 970 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 780 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 954 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 30 and ending at offset 30 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 2 ms 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 30, requiredOffset: 31] 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 954, next offset: 974, and messages: [(offset=954,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2765752302, CreateTime = 1498860036292, key = 0 bytes, value = 5 bytes)), (offset=955,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3636142645, CreateTime = 1498860036295, key = 0 bytes, value = 5 bytes)), (offset=956,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2385483459, CreateTime = 1498860036296, key = 0 bytes, value = 5 bytes)), (offset=957,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 320894901, CreateTime = 1498860036297, key = 0 bytes, value = 5 bytes)), (offset=958,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1866551918, CreateTime = 1498860036298, key = 0 bytes, value = 5 bytes)), (offset=959,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1866551918, CreateTime = 1498860036298, key = 0 bytes, value = 5 bytes)), (offset=960,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4065243928, CreateTime = 1498860036299, key = 0 bytes, value = 5 bytes)), (offset=961,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4065243928, CreateTime = 1498860036299, key = 0 bytes, value = 5 bytes)), (offset=962,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=963,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=964,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=965,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=966,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=967,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=968,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=969,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=970,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=971,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=972,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=973,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 30, requiredOffset: 31] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [974 [0 : 37986]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 974 [0 : 37986] 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036328,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@5d6bb499,SendAction) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=81,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=916,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:5,requestQueueTime:1,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 780 bytes written to log topic-0 beginning at offset 954 and ending at offset 973 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 916 for partition topic-0 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 2 ms 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 916 to buffered record list 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 21 records in fetch response for partition topic-0 with offset 916 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 916 for assigned partition topic-0 and update position to 937 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036331,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@283bd5b5,SendAction) 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 916 since the current position is 937 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=954,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=52,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=780]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:3,requestQueueTime:0,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 937 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 52 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=53,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036335,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=937,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 954 and error: null. 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=53,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=937, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=82,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=937,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=937,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036335,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3957472259, CreateTime = 1498860036303, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3687101593, CreateTime = 1498860036304, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3687101593, CreateTime = 1498860036304, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1187730927, CreateTime = 1498860036305, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2812645698, CreateTime = 1498860036307, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2812645698, CreateTime = 1498860036307, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3261610882, CreateTime = 1498860036308, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3261610882, CreateTime = 1498860036308, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=9,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=10,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=11,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 587661103, CreateTime = 1498860036310, key = 0 bytes, value = 5 bytes)), (offset=12,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 587661103, CreateTime = 1498860036310, key = 0 bytes, value = 5 bytes)), (offset=13,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=14,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=15,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=16,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=82,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=937,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=83,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=937,metadata=}]}]} 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 937, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 663 bytes at offset 974 at position 37986 with largest timestamp 1498860036311 at shallow offset 987 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 937 in log topic-0 of length 37986 bytes 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036336,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 663 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 974 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=83,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=937,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1443 bytes 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 974, next offset: 991, and messages: [(offset=974,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3957472259, CreateTime = 1498860036303, key = 0 bytes, value = 5 bytes)), (offset=975,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3687101593, CreateTime = 1498860036304, key = 0 bytes, value = 5 bytes)), (offset=976,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3687101593, CreateTime = 1498860036304, key = 0 bytes, value = 5 bytes)), (offset=977,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1187730927, CreateTime = 1498860036305, key = 0 bytes, value = 5 bytes)), (offset=978,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2812645698, CreateTime = 1498860036307, key = 0 bytes, value = 5 bytes)), (offset=979,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2812645698, CreateTime = 1498860036307, key = 0 bytes, value = 5 bytes)), (offset=980,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3261610882, CreateTime = 1498860036308, key = 0 bytes, value = 5 bytes)), (offset=981,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3261610882, CreateTime = 1498860036308, key = 0 bytes, value = 5 bytes)), (offset=982,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=983,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=984,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=985,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 587661103, CreateTime = 1498860036310, key = 0 bytes, value = 5 bytes)), (offset=986,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 587661103, CreateTime = 1498860036310, key = 0 bytes, value = 5 bytes)), (offset=987,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=988,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=989,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=990,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351045122, CreateTime = 1498860036337, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036335,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@5490338b,SendAction) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1488, total bytes written so far: 1488, expected bytes to write: 1488 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 31 at position 3149 with largest timestamp 1498860036337 at shallow offset 31 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [991 [0 : 38649]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 991 [0 : 38649] 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 31 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=82,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=937,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:3,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=974},record_set=[(offset=937,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2234442027, CreateTime = 1498860036282, key = 0 bytes, value = 5 bytes)), (offset=938,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=939,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=940,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2625793584, CreateTime = 1498860036286, key = 0 bytes, value = 5 bytes)), (offset=941,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 26054470, CreateTime = 1498860036287, key = 0 bytes, value = 5 bytes)), (offset=942,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 26054470, CreateTime = 1498860036287, key = 0 bytes, value = 5 bytes)), (offset=943,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=944,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=945,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3178662133, CreateTime = 1498860036288, key = 0 bytes, value = 5 bytes)), (offset=946,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 544827779, CreateTime = 1498860036289, key = 0 bytes, value = 5 bytes)), (offset=947,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 544827779, CreateTime = 1498860036289, key = 0 bytes, value = 5 bytes)), (offset=948,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1545096280, CreateTime = 1498860036290, key = 0 bytes, value = 5 bytes)), (offset=949,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1545096280, CreateTime = 1498860036290, key = 0 bytes, value = 5 bytes)), (offset=950,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=951,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=952,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=953,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3239554350, CreateTime = 1498860036291, key = 0 bytes, value = 5 bytes)), (offset=954,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2765752302, CreateTime = 1498860036292, key = 0 bytes, value = 5 bytes)), (offset=955,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3636142645, CreateTime = 1498860036295, key = 0 bytes, value = 5 bytes)), (offset=956,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2385483459, CreateTime = 1498860036296, key = 0 bytes, value = 5 bytes)), (offset=957,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 320894901, CreateTime = 1498860036297, key = 0 bytes, value = 5 bytes)), (offset=958,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1866551918, CreateTime = 1498860036298, key = 0 bytes, value = 5 bytes)), (offset=959,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1866551918, CreateTime = 1498860036298, key = 0 bytes, value = 5 bytes)), (offset=960,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4065243928, CreateTime = 1498860036299, key = 0 bytes, value = 5 bytes)), (offset=961,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4065243928, CreateTime = 1498860036299, key = 0 bytes, value = 5 bytes)), (offset=962,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=963,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=964,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2541951448, CreateTime = 1498860036300, key = 0 bytes, value = 5 bytes)), (offset=965,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=966,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=967,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=968,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=969,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 177010862, CreateTime = 1498860036301, key = 0 bytes, value = 5 bytes)), (offset=970,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=971,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=972,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes)), (offset=973,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1995300213, CreateTime = 1498860036302, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 31, next offset: 32, and messages: [(offset=31,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 351045122, CreateTime = 1498860036337, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 663 bytes written to log topic-0 beginning at offset 974 and ending at offset 990 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [32 [0 : 3236]] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 4 ms 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 32 [0 : 3236] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036335,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@6b369003,SendAction) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 31 and ending at offset 31 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 2 ms 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=53,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=663]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:4,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 31, requiredOffset: 32] 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=974,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=0,api_version=2,correlation_id=54,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=351]} 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 31, requiredOffset: 32] 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036340,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 53 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=0,api_version=2,correlation_id=54,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=351]} from connection 127.0.0.1:52135-127.0.0.1:52146;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 974 and error: null. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(topic-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=1,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3902646959, CreateTime = 1498860036312, key = 0 bytes, value = 5 bytes)), (offset=2,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3902646959, CreateTime = 1498860036312, key = 0 bytes, value = 5 bytes)), (offset=3,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=4,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=5,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=6,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=7,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=8,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes))])] to local log 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036336,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@37d15947,SendAction) 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 351 bytes at offset 991 at position 38649 with largest timestamp 1498860036313 at shallow offset 994 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=83,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=937,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:5,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 351 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/topic-0/00000000000000000000.log at offset 991 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 937 for partition topic-0 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log topic-0 with first offset: 991, next offset: 1000, and messages: [(offset=991,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=992,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3902646959, CreateTime = 1498860036312, key = 0 bytes, value = 5 bytes)), (offset=993,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3902646959, CreateTime = 1498860036312, key = 0 bytes, value = 5 bytes)), (offset=994,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=995,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=996,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=997,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=998,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=999,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes))] 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 937 to buffered record list 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 37 records in fetch response for partition topic-0 with offset 937 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition topic-0 to [1000 [0 : 39000]] 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 937 for assigned partition topic-0 and update position to 974 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [topic,0] on broker 1: High watermark for partition [topic,0] updated to 1000 [0 : 39000] 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 937 since the current position is 974 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 974 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key topic-0 unblocked 0 producer requests. 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 351 bytes written to log topic-0 beginning at offset 991 and ending at offset 999 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=974,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 2 ms 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=974, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=84,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=974,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=974,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52146,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036340,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@379eec58,SendAction) 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036343,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=84,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=974,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=85,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=974,metadata=}]}]} 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 974, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 0, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0,base_offset=991,log_append_time=-1}]}],throttle_time_ms=0} 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 974 in log topic-0 of length 39000 bytes 2017-06-30 23:00:36 TRACE Sender:262 - Received produce response from node 1 with correlation id 54 2017-06-30 23:00:36 TRACE RecordBatch:97 - Produced messages to topic-partition topic-0 with base offset offset 991 and error: null. 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=0,api_version=2,correlation_id=54,client_id=producer-1} -- {acks=1,timeout=30000,partitionSizes=[topic-0=351]} from connection 127.0.0.1:52135-127.0.0.1:52146;totalTime:3,requestQueueTime:0,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036343,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 1014 bytes 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=85,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=974,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036343,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@5fb13fb8,SendAction) 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 1059, total bytes written so far: 1059, expected bytes to write: 1059 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 819309848, CreateTime = 1498860036345, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=84,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=974,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:2,requestQueueTime:0,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 32 at position 3236 with largest timestamp 1498860036345 at shallow offset 32 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[(offset=974,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3957472259, CreateTime = 1498860036303, key = 0 bytes, value = 5 bytes)), (offset=975,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3687101593, CreateTime = 1498860036304, key = 0 bytes, value = 5 bytes)), (offset=976,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3687101593, CreateTime = 1498860036304, key = 0 bytes, value = 5 bytes)), (offset=977,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1187730927, CreateTime = 1498860036305, key = 0 bytes, value = 5 bytes)), (offset=978,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2812645698, CreateTime = 1498860036307, key = 0 bytes, value = 5 bytes)), (offset=979,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2812645698, CreateTime = 1498860036307, key = 0 bytes, value = 5 bytes)), (offset=980,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3261610882, CreateTime = 1498860036308, key = 0 bytes, value = 5 bytes)), (offset=981,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3261610882, CreateTime = 1498860036308, key = 0 bytes, value = 5 bytes)), (offset=982,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=983,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=984,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1600641780, CreateTime = 1498860036309, key = 0 bytes, value = 5 bytes)), (offset=985,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 587661103, CreateTime = 1498860036310, key = 0 bytes, value = 5 bytes)), (offset=986,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 587661103, CreateTime = 1498860036310, key = 0 bytes, value = 5 bytes)), (offset=987,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=988,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=989,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=990,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=991,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3188268633, CreateTime = 1498860036311, key = 0 bytes, value = 5 bytes)), (offset=992,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3902646959, CreateTime = 1498860036312, key = 0 bytes, value = 5 bytes)), (offset=993,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3902646959, CreateTime = 1498860036312, key = 0 bytes, value = 5 bytes)), (offset=994,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=995,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=996,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=997,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=998,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes)), (offset=999,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1972521945, CreateTime = 1498860036313, key = 0 bytes, value = 5 bytes))]}]}]} 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 32 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 32, next offset: 33, and messages: [(offset=32,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 819309848, CreateTime = 1498860036345, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [33 [0 : 3323]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 33 [0 : 3323] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 32 and ending at offset 32 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 1 ms 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 32, requiredOffset: 33] 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 32, requiredOffset: 33] 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036343,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@41fe1163,SendAction) 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=85,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=974,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:4,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 974 for partition topic-0 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 974 to buffered record list 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 26 records in fetch response for partition topic-0 with offset 974 2017-06-30 23:00:36 TRACE Fetcher:525 - Returning fetched records at offset 974 for assigned partition topic-0 and update position to 1000 2017-06-30 23:00:36 DEBUG Fetcher:539 - Ignoring fetched records for topic-0 at offset 974 since the current position is 1000 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=1000, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=86,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036348,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=86,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=87,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036349,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=87,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 76344028, CreateTime = 1498860036349, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:36 TRACE LogSegment:36 - Inserting 87 bytes at offset 33 at position 3323 with largest timestamp 1498860036349 at shallow offset 33 2017-06-30 23:00:36 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 33 2017-06-30 23:00:36 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 33, next offset: 34, and messages: [(offset=33,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 76344028, CreateTime = 1498860036349, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [34 [0 : 3410]] 2017-06-30 23:00:36 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 34 [0 : 3410] 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 33 and ending at offset 33 2017-06-30 23:00:36 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 1 ms 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 33, requiredOffset: 34] 2017-06-30 23:00:36 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 33, requiredOffset: 34] 2017-06-30 23:00:36 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036349,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@1e1727d7,SendAction) 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=87,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:3,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:36 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 1000 for partition topic-0 2017-06-30 23:00:36 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:36 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:36 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Evaluating ISR list of partitions to see which replicas can be removed from the ISR 2017-06-30 23:00:36 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:36 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:36 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:36 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:36 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:36 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:36 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:36 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036348,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@50811860,SendAction) 2017-06-30 23:00:36 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:36 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:36 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=86,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:508,requestQueueTime:0,localTime:1,remoteTime:506,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:36 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:36 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:36 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:36 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:36 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=88,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:36 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036857,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:36 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=88,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:36 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:36 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:37 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:37 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:37 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:37 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:37 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:37 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860036857,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@64d9d54a,SendAction) 2017-06-30 23:00:37 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:37 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:37 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=88,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:504,requestQueueTime:0,localTime:1,remoteTime:502,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:37 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:37 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:37 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:37 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:37 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:37 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:37 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=89,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:37 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860037362,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:37 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=89,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:37 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:37 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:37 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:37 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:37 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:37 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:37 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:37 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:37 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:37 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:37 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:37 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860037362,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@3100ae31,SendAction) 2017-06-30 23:00:37 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:37 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:37 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:37 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=89,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:505,requestQueueTime:1,localTime:0,remoteTime:502,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:37 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:37 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:37 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:37 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:37 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:37 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=90,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:37 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860037868,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:37 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=90,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:37 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:37 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:38 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:38 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:38 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:38 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:38 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:00:38 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:38 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} to node 2147483646. 2017-06-30 23:00:38 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:38 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=12,api_version=0,correlation_id=91,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} 2017-06-30 23:00:38 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860038342,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:38 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=91,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:38 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 91 to client consumer-1. 2017-06-30 23:00:38 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860038342,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@23b15e33,SendAction) 2017-06-30 23:00:38 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:38 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=91,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:2,requestQueueTime:1,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:38 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:38 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:38 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:38 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:38 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} to node 2147483646. 2017-06-30 23:00:38 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=12,api_version=0,correlation_id=12,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} 2017-06-30 23:00:38 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860038347,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:38 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=12,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:38 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 12 to client consumer-2. 2017-06-30 23:00:38 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860038347,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@58a56459,SendAction) 2017-06-30 23:00:38 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=12,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:0,requestQueueTime:0,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:38 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:38 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:38 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:38 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:38 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:38 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860037868,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@671a1b56,SendAction) 2017-06-30 23:00:38 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:38 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:38 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=90,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:505,requestQueueTime:1,localTime:1,remoteTime:503,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:38 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:38 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:38 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:38 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:38 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:38 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:38 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=92,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:38 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860038375,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:38 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=92,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:38 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:38 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:38 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:38 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:38 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:38 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:38 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:38 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:38 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:38 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:38 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:38 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860038375,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@3f804dcd,SendAction) 2017-06-30 23:00:38 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:38 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:38 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=92,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:502,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:38 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:38 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:38 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:38 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:38 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:38 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:38 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=93,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:38 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860038880,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:38 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=93,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:38 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:38 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:39 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:39 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:39 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:39 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:39 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:39 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860038880,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@15d9acf2,SendAction) 2017-06-30 23:00:39 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:39 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:39 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=93,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:0,localTime:0,remoteTime:502,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:39 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:39 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:39 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:39 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:39 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:39 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:39 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=94,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:39 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860039384,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:39 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=94,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:39 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:39 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:39 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:39 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:39 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:39 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:39 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:39 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:39 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:39 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:39 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:39 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860039384,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@219ce95e,SendAction) 2017-06-30 23:00:39 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:39 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:39 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=94,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:505,requestQueueTime:0,localTime:1,remoteTime:504,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:39 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:39 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:39 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:39 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:39 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:39 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:39 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=95,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:39 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860039891,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:39 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=95,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:39 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:39 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:40 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:40 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:40 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:40 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:40 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 4ms 2017-06-30 23:00:40 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:40 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:40 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:40 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860039891,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@16eb9690,SendAction) 2017-06-30 23:00:40 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:40 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:40 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=95,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:501,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:40 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:40 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:40 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:40 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:40 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:40 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:40 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=96,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:40 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860040395,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:40 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=96,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:40 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:40 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:40 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:40 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:40 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:40 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:40 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:40 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:40 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:40 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:40 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:40 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860040395,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@2bb85fa5,SendAction) 2017-06-30 23:00:40 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:40 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:40 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:40 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:40 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=96,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:505,requestQueueTime:1,localTime:1,remoteTime:501,responseQueueTime:0,sendTime:2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:40 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:40 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:40 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:40 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:40 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=97,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:40 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860040902,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:40 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=97,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:40 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:40 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:41 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:41 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} to node 2147483646. 2017-06-30 23:00:41 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:41 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=12,api_version=0,correlation_id=98,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} 2017-06-30 23:00:41 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860041345,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:41 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=98,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:41 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 98 to client consumer-1. 2017-06-30 23:00:41 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860041345,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@630d9a31,SendAction) 2017-06-30 23:00:41 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:41 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=98,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:2,requestQueueTime:1,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:41 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:41 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:41 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:41 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:41 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} to node 2147483646. 2017-06-30 23:00:41 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=12,api_version=0,correlation_id=13,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} 2017-06-30 23:00:41 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860041350,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:41 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=13,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:41 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 13 to client consumer-2. 2017-06-30 23:00:41 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860041350,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@52e2a965,SendAction) 2017-06-30 23:00:41 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=13,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:3,requestQueueTime:1,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:41 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:41 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:41 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:41 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:41 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:41 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860040902,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@735ec81c,SendAction) 2017-06-30 23:00:41 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:41 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:41 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=97,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:501,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:41 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:41 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:41 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:41 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:41 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:41 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:41 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=99,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:41 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860041406,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:41 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=99,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:41 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:41 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:41 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:41 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Evaluating ISR list of partitions to see which replicas can be removed from the ISR 2017-06-30 23:00:41 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:41 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:41 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:41 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:41 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:41 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:41 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:41 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:41 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:41 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:41 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:41 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:41 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860041406,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@35ce1930,SendAction) 2017-06-30 23:00:41 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:41 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:41 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=99,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:501,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:41 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:41 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:41 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:41 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:41 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:41 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:41 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=100,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:41 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860041910,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:41 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=100,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:41 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:41 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:42 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:42 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:42 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:42 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:42 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:42 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:42 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 3ms 2017-06-30 23:00:42 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:42 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:42 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:42 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860041910,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@7fdb460f,SendAction) 2017-06-30 23:00:42 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:42 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:42 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=100,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:507,requestQueueTime:0,localTime:1,remoteTime:505,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:42 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:42 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:42 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:42 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:42 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:42 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:42 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=101,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:42 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860042418,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:42 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=101,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:42 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:42 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:42 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:42 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:42 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:42 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:42 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:42 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:42 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:42 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:42 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:42 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860042418,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@16f76b26,SendAction) 2017-06-30 23:00:42 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:42 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:42 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=101,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:501,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:42 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:42 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:42 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:42 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:42 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:42 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:42 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=102,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:42 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860042925,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:42 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=102,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:42 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:42 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:43 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:43 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:43 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:43 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860042925,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@13ec4fcc,SendAction) 2017-06-30 23:00:43 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:43 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:43 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=102,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:506,requestQueueTime:0,localTime:1,remoteTime:504,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:43 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:43 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:43 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:43 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:43 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:43 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:43 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:43 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=103,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:43 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860043432,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:43 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=103,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:43 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:43 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:43 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:43 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:43 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:43 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:43 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:43 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:43 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:43 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:43 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:43 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860043432,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@562ec318,SendAction) 2017-06-30 23:00:43 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:43 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:43 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:43 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=103,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:506,requestQueueTime:0,localTime:1,remoteTime:503,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:43 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:43 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:43 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:43 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:43 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:43 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=104,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:43 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860043941,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:43 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=104,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:43 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:43 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:44 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:44 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:44 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:44 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:44 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:44 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:44 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:00:44 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:44 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} to node 2147483646. 2017-06-30 23:00:44 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:44 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=12,api_version=0,correlation_id=105,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} 2017-06-30 23:00:44 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860044348,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:44 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=105,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:44 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 105 to client consumer-1. 2017-06-30 23:00:44 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860044348,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@52c9fa3a,SendAction) 2017-06-30 23:00:44 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:44 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=105,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:2,requestQueueTime:0,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:44 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:44 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:44 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:44 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:44 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} to node 2147483646. 2017-06-30 23:00:44 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=12,api_version=0,correlation_id=14,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} 2017-06-30 23:00:44 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860044397,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:44 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=14,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:44 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 14 to client consumer-2. 2017-06-30 23:00:44 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860044397,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@3961b374,SendAction) 2017-06-30 23:00:44 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:44 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=14,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:1,requestQueueTime:0,localTime:1,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:44 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:44 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:44 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:44 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:44 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860043941,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@73e01cec,SendAction) 2017-06-30 23:00:44 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:44 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:44 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=104,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:504,requestQueueTime:0,localTime:1,remoteTime:503,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:44 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:44 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:44 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:44 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:44 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:44 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:44 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=106,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:44 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860044446,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:44 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=106,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:44 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:44 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:44 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:44 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:44 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:44 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:44 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:44 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:44 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:44 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:44 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:44 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860044446,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@5e63e7ed,SendAction) 2017-06-30 23:00:44 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:44 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:44 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=106,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:507,requestQueueTime:0,localTime:2,remoteTime:503,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:44 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:44 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:44 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:44 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:44 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:44 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:44 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=107,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:44 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860044953,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:44 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=107,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:44 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:44 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:45 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:45 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:45 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:45 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860044953,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@2f0051c2,SendAction) 2017-06-30 23:00:45 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:45 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:45 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=107,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:504,requestQueueTime:1,localTime:0,remoteTime:502,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:45 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:45 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:45 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:45 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:45 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:45 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:45 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=108,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:45 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860045458,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:45 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=108,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:45 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:45 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:45 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:45 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:45 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:45 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:45 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:45 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:45 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:45 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:45 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:45 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860045458,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@f167139,SendAction) 2017-06-30 23:00:45 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:45 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:45 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=108,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:504,requestQueueTime:0,localTime:0,remoteTime:503,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:45 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:45 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:45 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:45 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:45 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:45 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:45 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=109,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:45 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860045963,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:45 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=109,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:45 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:45 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:46 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:46 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:46 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:46 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:46 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:00:46 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=1000, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:46 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:46 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=110,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} 2017-06-30 23:00:46 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860046357,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:46 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=110,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:46 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2592396465, CreateTime = 1498860046358, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:46 TRACE LogSegment:36 - Inserting 87 bytes at offset 34 at position 3410 with largest timestamp 1498860046358 at shallow offset 34 2017-06-30 23:00:46 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 34 2017-06-30 23:00:46 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 34, next offset: 35, and messages: [(offset=34,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2592396465, CreateTime = 1498860046358, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:46 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:46 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [35 [0 : 3497]] 2017-06-30 23:00:46 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 35 [0 : 3497] 2017-06-30 23:00:46 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:46 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:46 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 34 and ending at offset 34 2017-06-30 23:00:46 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 1 ms 2017-06-30 23:00:46 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 34, requiredOffset: 35] 2017-06-30 23:00:46 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 34, requiredOffset: 35] 2017-06-30 23:00:46 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:46 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860046357,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@7547462b,SendAction) 2017-06-30 23:00:46 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=110,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:4,requestQueueTime:1,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:46 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:46 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 1000 for partition topic-0 2017-06-30 23:00:46 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:46 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:46 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:46 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:46 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:46 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860045963,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@7c621b4b,SendAction) 2017-06-30 23:00:46 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:46 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:46 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:46 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=109,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:504,requestQueueTime:0,localTime:1,remoteTime:502,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:46 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:46 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:46 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:46 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:46 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:46 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=111,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:46 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860046468,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:46 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=111,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:46 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:46 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:46 DEBUG LogCleanerManager$:54 - Finding range of cleanable offsets for log=__consumer_offsets-0 topicPartition=__consumer_offsets-0. Last clean offset=None now=1498860046505 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 2017-06-30 23:00:46 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:46 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:46 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:46 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Evaluating ISR list of partitions to see which replicas can be removed from the ISR 2017-06-30 23:00:46 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:46 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:46 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:46 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:46 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:46 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:46 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:46 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:46 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:46 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:46 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860046468,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@3d7fd7a5,SendAction) 2017-06-30 23:00:46 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:46 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:46 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=111,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:504,requestQueueTime:0,localTime:1,remoteTime:502,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:46 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:46 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:46 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:46 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:46 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:46 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:46 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=112,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:46 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860046974,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:46 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=112,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:46 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:46 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:47 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:47 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:47 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:47 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} to node 2147483646. 2017-06-30 23:00:47 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:47 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=12,api_version=0,correlation_id=113,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} 2017-06-30 23:00:47 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860047351,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:47 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=113,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:47 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 113 to client consumer-1. 2017-06-30 23:00:47 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860047351,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@5c2ede76,SendAction) 2017-06-30 23:00:47 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=113,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:2,requestQueueTime:1,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:47 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:47 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:47 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:47 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:47 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:47 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} to node 2147483646. 2017-06-30 23:00:47 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=12,api_version=0,correlation_id=15,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} 2017-06-30 23:00:47 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860047401,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:47 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=15,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:47 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 15 to client consumer-2. 2017-06-30 23:00:47 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860047401,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@59b4ede4,SendAction) 2017-06-30 23:00:47 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:47 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=15,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:2,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:47 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:47 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:47 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:47 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:47 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860046974,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@105c0f89,SendAction) 2017-06-30 23:00:47 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:47 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:47 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=112,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:502,requestQueueTime:0,localTime:0,remoteTime:501,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:47 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:47 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:47 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:47 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:47 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:47 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:47 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=114,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:47 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860047477,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:47 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=114,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:47 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:47 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:47 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:47 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:47 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:47 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:47 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:47 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:47 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:47 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:47 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:47 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860047477,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@2cff2b02,SendAction) 2017-06-30 23:00:47 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:47 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:47 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=114,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:501,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:47 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:47 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:47 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:47 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:47 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:47 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:47 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=115,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:47 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860047980,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:47 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=115,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:47 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:47 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:48 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:48 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:48 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:48 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:48 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 0ms 2017-06-30 23:00:48 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:48 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:48 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:48 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860047980,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@40abd595,SendAction) 2017-06-30 23:00:48 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:48 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:48 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=115,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:1,localTime:0,remoteTime:501,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:48 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:48 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:48 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:48 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:48 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:48 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:48 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=116,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:48 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860048484,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:48 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=116,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:48 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:48 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:48 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:48 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:48 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:48 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:48 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:48 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:48 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:48 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:48 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:48 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860048484,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@32af0da,SendAction) 2017-06-30 23:00:48 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:48 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:48 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=116,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:502,requestQueueTime:0,localTime:0,remoteTime:501,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:48 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:48 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:48 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:48 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:48 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:48 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:48 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=117,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:48 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860048986,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:48 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=117,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:48 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:48 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:49 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:49 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:49 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:49 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:49 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:49 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860048986,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@73fa8771,SendAction) 2017-06-30 23:00:49 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:49 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:49 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=117,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:504,requestQueueTime:1,localTime:0,remoteTime:503,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:49 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:49 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:49 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:49 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:49 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:49 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:49 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=118,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:49 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860049491,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:49 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=118,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:49 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:49 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:49 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:49 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:49 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:49 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:49 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:49 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:49 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:49 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:49 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:49 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860049491,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@26881537,SendAction) 2017-06-30 23:00:49 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:49 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:49 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=118,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:505,requestQueueTime:0,localTime:1,remoteTime:504,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:49 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:49 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:49 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:49 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:49 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:49 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:49 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=119,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:49 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860049997,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:49 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=119,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:49 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:49 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:50 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:50 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:50 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:50 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:50 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 0ms 2017-06-30 23:00:50 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:50 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} to node 2147483646. 2017-06-30 23:00:50 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:50 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=12,api_version=0,correlation_id=120,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} 2017-06-30 23:00:50 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860050353,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:50 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=120,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:50 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 120 to client consumer-1. 2017-06-30 23:00:50 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860050353,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@537d0bd0,SendAction) 2017-06-30 23:00:50 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:50 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=120,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:1,requestQueueTime:1,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:50 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:50 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:50 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:50 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:50 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} to node 2147483646. 2017-06-30 23:00:50 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=12,api_version=0,correlation_id=16,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} 2017-06-30 23:00:50 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860050409,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:50 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=16,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:50 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 16 to client consumer-2. 2017-06-30 23:00:50 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860050409,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2a40dd27,SendAction) 2017-06-30 23:00:50 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=16,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:0,requestQueueTime:0,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:50 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:50 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:50 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:50 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:50 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:50 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860049997,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@38117b0e,SendAction) 2017-06-30 23:00:50 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:50 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:50 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=119,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:0,localTime:0,remoteTime:502,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:50 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:50 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:50 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:50 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:50 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:50 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:50 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=121,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:50 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860050501,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:50 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=121,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:50 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:50 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:50 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:50 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:50 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:50 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:50 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:50 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:51 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:51 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:51 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:51 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860050501,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@6c69f0f6,SendAction) 2017-06-30 23:00:51 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:51 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:51 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=121,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:504,requestQueueTime:0,localTime:0,remoteTime:503,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:51 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:51 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:51 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:51 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:51 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:51 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:51 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=122,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:51 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860051006,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:51 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=122,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:51 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:51 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:51 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:51 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:51 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:51 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860051006,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@4b0f2305,SendAction) 2017-06-30 23:00:51 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:51 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:51 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=122,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:506,requestQueueTime:0,localTime:0,remoteTime:506,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:51 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:51 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:51 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:51 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:51 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:51 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:51 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=123,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:51 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860051513,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:51 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=123,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:51 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:51 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:51 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:51 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:51 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Evaluating ISR list of partitions to see which replicas can be removed from the ISR 2017-06-30 23:00:51 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:51 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:51 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:51 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:51 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:51 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:51 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:51 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:52 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:52 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:52 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:52 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860051513,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@2dc8a6fe,SendAction) 2017-06-30 23:00:52 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:52 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:52 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=123,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:1,localTime:0,remoteTime:502,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:52 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:52 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:52 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:52 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:52 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:52 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:52 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=124,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:52 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860052017,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:52 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=124,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:52 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:52 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:52 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:52 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:52 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:52 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:52 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:52 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:52 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:00:52 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:52 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:52 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:52 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860052017,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@1eb27142,SendAction) 2017-06-30 23:00:52 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:52 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:52 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=124,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:505,requestQueueTime:1,localTime:0,remoteTime:503,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:52 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:52 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:52 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:52 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:52 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:52 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:52 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=125,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:52 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860052523,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:52 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=125,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:52 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:52 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:52 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:52 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:52 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:52 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:52 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:52 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:53 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:53 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:53 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:53 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860052523,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@3dffdc22,SendAction) 2017-06-30 23:00:53 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:53 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:53 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=125,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:504,requestQueueTime:0,localTime:1,remoteTime:502,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:53 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:53 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:53 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:53 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:53 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:53 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:53 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=126,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:53 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860053028,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:53 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=126,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:53 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:53 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:53 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:53 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} to node 2147483646. 2017-06-30 23:00:53 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:53 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=12,api_version=0,correlation_id=127,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} 2017-06-30 23:00:53 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860053356,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:53 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=127,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:53 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 127 to client consumer-1. 2017-06-30 23:00:53 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860053356,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@4e7833af,SendAction) 2017-06-30 23:00:53 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:53 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=127,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:3,requestQueueTime:1,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:53 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:53 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:53 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:53 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:53 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} to node 2147483646. 2017-06-30 23:00:53 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=12,api_version=0,correlation_id=17,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} 2017-06-30 23:00:53 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860053476,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:53 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=17,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:53 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 17 to client consumer-2. 2017-06-30 23:00:53 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860053476,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@6daee08b,SendAction) 2017-06-30 23:00:53 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:53 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=17,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:1,requestQueueTime:0,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:53 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:53 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:53 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:53 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:53 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860053028,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@fdad793,SendAction) 2017-06-30 23:00:53 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:53 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:53 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=126,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:507,requestQueueTime:0,localTime:1,remoteTime:505,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:53 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:53 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:53 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:53 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:53 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:53 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:53 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=128,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:53 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860053536,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:53 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=128,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:53 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:53 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:53 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:53 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:53 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:53 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:53 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:53 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:54 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:54 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:54 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:54 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860053536,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@67cd6fc0,SendAction) 2017-06-30 23:00:54 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:54 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:54 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=128,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:504,requestQueueTime:1,localTime:0,remoteTime:502,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:54 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:54 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:54 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:54 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:54 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:54 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:54 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=129,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:54 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860054041,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:54 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=129,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:54 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:54 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:54 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:54 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:54 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:54 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:54 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:54 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:54 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 2ms 2017-06-30 23:00:54 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:54 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:54 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:54 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860054041,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@6a783a1a,SendAction) 2017-06-30 23:00:54 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:54 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:54 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=129,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:505,requestQueueTime:0,localTime:1,remoteTime:503,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:54 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:54 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:54 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:54 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:54 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:54 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:54 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=130,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:54 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860054547,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:54 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=130,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:54 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:54 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:54 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:54 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:54 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:54 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:54 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:54 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:55 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:55 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:55 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:55 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860054547,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@2925f5bb,SendAction) 2017-06-30 23:00:55 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:55 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:55 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=130,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:501,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:55 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:55 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:55 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:55 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:55 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:55 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:55 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=131,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:55 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860055051,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:55 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=131,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:55 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:55 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:55 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:55 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:55 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:55 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860055051,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@701ac943,SendAction) 2017-06-30 23:00:55 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:55 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:55 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=131,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:504,requestQueueTime:0,localTime:1,remoteTime:502,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:55 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:55 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:55 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:55 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:55 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:55 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:55 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=132,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:55 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860055556,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:55 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=132,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:55 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:55 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:55 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:55 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:55 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:55 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:55 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:55 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:56 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:56 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:56 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860055556,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@7ca50bef,SendAction) 2017-06-30 23:00:56 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:56 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:56 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=132,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:505,requestQueueTime:0,localTime:1,remoteTime:503,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:56 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:56 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:56 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:56 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:56 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:56 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:56 TRACE RequestChannel$:36 - Processor 1 received request : {api_key=1,api_version=3,correlation_id=133,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:56 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056062,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=133,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:56 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:56 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:56 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:56 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:56 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:56 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:56 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:00:56 INFO KafkaProducer:689 - Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 2017-06-30 23:00:56 DEBUG Sender:132 - Beginning shutdown of Kafka producer I/O thread, sending remaining records. 2017-06-30 23:00:56 DEBUG Selector:375 - Connection with /127.0.0.1 disconnected java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:83) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:169) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:150) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:355) at org.apache.kafka.common.network.Selector.poll(Selector.java:303) at kafka.network.Processor.poll(SocketServer.scala:494) at kafka.network.Processor.run(SocketServer.scala:432) at java.lang.Thread.run(Thread.java:745) 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name connections-closed: 2017-06-30 23:00:56 DEBUG Selector:375 - Connection with /127.0.0.1 disconnected java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:83) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:169) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:150) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:355) at org.apache.kafka.common.network.Selector.poll(Selector.java:303) at kafka.network.Processor.poll(SocketServer.scala:494) at kafka.network.Processor.run(SocketServer.scala:432) at java.lang.Thread.run(Thread.java:745) 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name connections-created: 2017-06-30 23:00:56 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name bytes-sent-received: 2017-06-30 23:00:56 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} to node 2147483646. 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name bytes-sent: 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name bytes-received: 2017-06-30 23:00:56 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name select-time: 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name io-time: 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node--1.bytes-sent 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node--1.bytes-received 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node--1.latency 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node-1.bytes-sent 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node-1.bytes-received 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node-1.latency 2017-06-30 23:00:56 DEBUG Sender:155 - Shutdown of Kafka producer I/O thread has completed. 2017-06-30 23:00:56 DEBUG KafkaProducer:732 - The Kafka producer has closed. 2017-06-30 23:00:56 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=12,api_version=0,correlation_id=134,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} 2017-06-30 23:00:56 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056359,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=134,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 134 to client consumer-1. 2017-06-30 23:00:56 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056359,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@1f44e0b9,SendAction) 2017-06-30 23:00:56 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:56 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=134,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:1,requestQueueTime:1,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:56 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:56 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=1000, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:56 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} to node 2147483646. 2017-06-30 23:00:56 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=8,api_version=2,correlation_id=135,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} 2017-06-30 23:00:56 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056361,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=135,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:56 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1543924798, CreateTime = 1498860056362, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:00:56 TRACE LogSegment:36 - Inserting 87 bytes at offset 35 at position 3497 with largest timestamp 1498860056362 at shallow offset 35 2017-06-30 23:00:56 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 35 2017-06-30 23:00:56 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 35, next offset: 36, and messages: [(offset=35,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1543924798, CreateTime = 1498860056362, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:00:56 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:56 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [36 [0 : 3584]] 2017-06-30 23:00:56 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 36 [0 : 3584] 2017-06-30 23:00:56 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:56 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:56 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 35 and ending at offset 35 2017-06-30 23:00:56 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 1 ms 2017-06-30 23:00:56 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 35, requiredOffset: 36] 2017-06-30 23:00:56 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 35, requiredOffset: 36] 2017-06-30 23:00:56 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:56 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056361,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@149c4afe,SendAction) 2017-06-30 23:00:56 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=135,client_id=consumer-1} -- {group_id=test-group,group_generation_id=2,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:3,requestQueueTime:1,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:56 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:00:56 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 1000 for partition topic-0 2017-06-30 23:00:56 TRACE KafkaConsumer:1552 - Closing the Kafka consumer. 2017-06-30 23:00:56 DEBUG AbstractCoordinator:967 - Heartbeat thread for group test-group has closed 2017-06-30 23:00:56 DEBUG AbstractCoordinator:697 - Sending LeaveGroup request to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:00:56 TRACE NetworkClient:316 - Sending {group_id=test-group,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} to node 2147483646. 2017-06-30 23:00:56 TRACE RequestChannel$:36 - Processor 2 received request : {api_key=13,api_version=0,correlation_id=136,client_id=consumer-1} -- {group_id=test-group,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} 2017-06-30 23:00:56 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056365,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=13,api_version=0,correlation_id=136,client_id=consumer-1} -- {group_id=test-group,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:56 TRACE GroupCoordinator:36 - [GroupCoordinator 1]: Member consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c in group test-group has failed 2017-06-30 23:00:56 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Preparing to restabilize group test-group with old generation 2 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Sending leave group response {error_code=0} for correlation id 136 to client consumer-1. 2017-06-30 23:00:56 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(2,Request(2,127.0.0.1:52135-127.0.0.1:52143,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056365,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@83d3c41,SendAction) 2017-06-30 23:00:56 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 13, received {error_code=0} 2017-06-30 23:00:56 TRACE logger:157 - Completed request:{api_key=13,api_version=0,correlation_id=136,client_id=consumer-1} -- {group_id=test-group,member_id=consumer-1-0ee65cb7-792e-4f9c-879a-f116ba44c27c} from connection 127.0.0.1:52135-127.0.0.1:52143;totalTime:2,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:56 DEBUG AbstractCoordinator:713 - LeaveGroup request for group test-group returned successfully 2017-06-30 23:00:56 DEBUG Selector:375 - Connection with /127.0.0.1 disconnected java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:83) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:169) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:150) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:355) at org.apache.kafka.common.network.Selector.poll(Selector.java:303) at kafka.network.Processor.poll(SocketServer.scala:494) at kafka.network.Processor.run(SocketServer.scala:432) at java.lang.Thread.run(Thread.java:745) 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name connections-closed: 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name connections-created: 2017-06-30 23:00:56 DEBUG Selector:375 - Connection with /127.0.0.1 disconnected java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:83) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:169) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:150) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:355) at org.apache.kafka.common.network.Selector.poll(Selector.java:303) at kafka.network.Processor.poll(SocketServer.scala:494) at kafka.network.Processor.run(SocketServer.scala:432) at java.lang.Thread.run(Thread.java:745) 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name bytes-sent-received: 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name bytes-sent: 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name bytes-received: 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name select-time: 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name io-time: 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node--1.bytes-sent 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node--1.bytes-received 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node--1.latency 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node-1.bytes-sent 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node-1.bytes-received 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node-1.latency 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node-2147483646.bytes-sent 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node-2147483646.bytes-received 2017-06-30 23:00:56 DEBUG Metrics:368 - Removed sensor with name node-2147483646.latency 2017-06-30 23:00:56 DEBUG KafkaConsumer:1568 - The Kafka consumer has closed. 2017-06-30 23:00:56 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:56 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:56 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Evaluating ISR list of partitions to see which replicas can be removed from the ISR 2017-06-30 23:00:56 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:56 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-expiration'. 2017-06-30 23:00:56 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:56 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-1 of 0 bytes 2017-06-30 23:00:56 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(1,Request(1,127.0.0.1:52135-127.0.0.1:52142,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056062,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@1f2862e6,SendAction) 2017-06-30 23:00:56 DEBUG Selector:375 - Connection with /127.0.0.1 disconnected java.io.IOException: Broken pipe at sun.nio.ch.FileDispatcherImpl.writev0(Native Method) at sun.nio.ch.SocketDispatcher.writev(SocketDispatcher.java:51) at sun.nio.ch.IOUtil.write(IOUtil.java:148) at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:504) at java.nio.channels.SocketChannel.write(SocketChannel.java:502) at org.apache.kafka.common.network.PlaintextTransportLayer.write(PlaintextTransportLayer.java:159) at org.apache.kafka.common.network.ByteBufferSend.writeTo(ByteBufferSend.java:56) at org.apache.kafka.common.network.MultiSend.writeTo(MultiSend.java:76) at org.apache.kafka.common.network.KafkaChannel.send(KafkaChannel.java:173) at org.apache.kafka.common.network.KafkaChannel.write(KafkaChannel.java:161) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:361) at org.apache.kafka.common.network.Selector.poll(Selector.java:303) at kafka.network.Processor.poll(SocketServer.scala:494) at kafka.network.Processor.run(SocketServer.scala:432) at java.lang.Thread.run(Thread.java:745) 2017-06-30 23:00:56 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=133,client_id=consumer-1} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52142;totalTime:502,requestQueueTime:0,localTime:1,remoteTime:500,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:56 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:56 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} to node 2147483646. 2017-06-30 23:00:56 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=12,api_version=0,correlation_id=18,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} 2017-06-30 23:00:56 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056576,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=18,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=27} for correlation id 18 to client consumer-2. 2017-06-30 23:00:56 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056576,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@59601459,SendAction) 2017-06-30 23:00:56 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=27} 2017-06-30 23:00:56 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=18,client_id=consumer-2} -- {group_id=test-group,group_generation_id=2,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:0,requestQueueTime:0,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:56 DEBUG AbstractCoordinator:746 - Attempt to heartbeat failed for group test-group since it is rebalancing. 2017-06-30 23:00:56 INFO ConsumerCoordinator:397 - Revoking previously assigned partitions [] for group test-group 2017-06-30 23:00:56 TRACE AbstractCoordinator:866 - Disabling heartbeat thread for group test-group 2017-06-30 23:00:56 INFO AbstractCoordinator:420 - (Re-)joining group test-group 2017-06-30 23:00:56 DEBUG AbstractCoordinator:428 - Sending JoinGroup ((type: JoinGroupRequest, groupId=test-group, sessionTimeout=10000, rebalanceTimeout=300000, memberId=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71, protocolType=consumer, groupProtocols=org.apache.kafka.common.requests.JoinGroupRequest$ProtocolMetadata@492ceed9)) to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:56 TRACE NetworkClient:316 - Sending {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} to node 2147483646. 2017-06-30 23:00:56 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=11,api_version=1,correlation_id=19,client_id=consumer-2} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} 2017-06-30 23:00:56 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056577,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=11,api_version=1,correlation_id=19,client_id=consumer-2} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:56 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Stabilized group test-group generation 3 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Sending join group response {error_code=0,generation_id=3,group_protocol=range,leader_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,members=[{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} for correlation id 19 to client consumer-2. 2017-06-30 23:00:56 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056577,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@27c5195c,SendAction) 2017-06-30 23:00:56 TRACE logger:157 - Completed request:{api_key=11,api_version=1,correlation_id=19,client_id=consumer-2} -- {group_id=test-group,session_timeout=10000,rebalance_timeout=300000,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,protocol_type=consumer,group_protocols=[{protocol_name=range,protocol_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:3,requestQueueTime:1,localTime:1,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:56 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 11, received {error_code=0,generation_id=3,group_protocol=range,leader_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,members=[{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} 2017-06-30 23:00:56 DEBUG AbstractCoordinator:438 - Received successful JoinGroup response for group test-group: {error_code=0,generation_id=3,group_protocol=range,leader_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,members=[{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_metadata=java.nio.HeapByteBuffer[pos=0 lim=17 cap=17]}]} 2017-06-30 23:00:56 DEBUG ConsumerCoordinator:340 - Performing assignment for group test-group using strategy range with subscriptions {consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71=Subscription(topics=[topic])} 2017-06-30 23:00:56 DEBUG ConsumerCoordinator:379 - Finished assignment for group test-group: {consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71=Assignment(partitions=[topic-0])} 2017-06-30 23:00:56 DEBUG AbstractCoordinator:506 - Sending leader SyncGroup for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null): (type=SyncGroupRequest, groupId=test-group, generationId=3, memberId=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71, groupAssignment=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71) 2017-06-30 23:00:56 TRACE NetworkClient:316 - Sending {group_id=test-group,generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,group_assignment=[{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25]}]} to node 2147483646. 2017-06-30 23:00:56 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=14,api_version=0,correlation_id=20,client_id=consumer-2} -- {group_id=test-group,generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,group_assignment=[{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25]}]} 2017-06-30 23:00:56 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056581,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=14,api_version=0,correlation_id=20,client_id=consumer-2} -- {group_id=test-group,generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,group_assignment=[{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25]}]} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:56 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Assignment received from leader for group test-group for generation 3 2017-06-30 23:00:56 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4272783248, CreateTime = 1498860056581, key = 14 bytes, value = 207 bytes))])] to local log 2017-06-30 23:00:56 TRACE LogSegment:36 - Inserting 255 bytes at offset 36 at position 3584 with largest timestamp 1498860056581 at shallow offset 36 2017-06-30 23:00:56 TRACE LogSegment:36 - Appended 255 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 36 2017-06-30 23:00:56 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 36, next offset: 37, and messages: [(offset=36,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 4272783248, CreateTime = 1498860056581, key = 14 bytes, value = 207 bytes))] 2017-06-30 23:00:56 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:56 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [37 [0 : 3839]] 2017-06-30 23:00:56 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 37 [0 : 3839] 2017-06-30 23:00:56 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:00:56 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:00:56 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 255 bytes written to log __consumer_offsets-0 beginning at offset 36 and ending at offset 36 2017-06-30 23:00:56 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 1 ms 2017-06-30 23:00:56 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 36, requiredOffset: 37] 2017-06-30 23:00:56 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 36, requiredOffset: 37] 2017-06-30 23:00:56 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:00:56 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056581,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@bc04166,SendAction) 2017-06-30 23:00:56 TRACE logger:157 - Completed request:{api_key=14,api_version=0,correlation_id=20,client_id=consumer-2} -- {group_id=test-group,generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,group_assignment=[{member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25]}]} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:2,requestQueueTime:0,localTime:2,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:56 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 14, received {error_code=0,member_assignment=java.nio.HeapByteBuffer[pos=0 lim=25 cap=25]} 2017-06-30 23:00:56 INFO AbstractCoordinator:388 - Successfully joined group test-group with generation 3 2017-06-30 23:00:56 TRACE AbstractCoordinator:857 - Enabling heartbeat thread for group test-group 2017-06-30 23:00:56 INFO ConsumerCoordinator:256 - Setting newly assigned partitions [topic-0] for group test-group 2017-06-30 23:00:56 DEBUG ConsumerCoordinator:804 - Group test-group fetching committed offsets for partitions: [topic-0] 2017-06-30 23:00:56 TRACE NetworkClient:316 - Sending {group_id=test-group,topics=[{topic=topic,partitions=[{partition=0}]}]} to node 2147483646. 2017-06-30 23:00:56 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=9,api_version=2,correlation_id=21,client_id=consumer-2} -- {group_id=test-group,topics=[{topic=topic,partitions=[{partition=0}]}]} 2017-06-30 23:00:56 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056584,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=9,api_version=2,correlation_id=21,client_id=consumer-2} -- {group_id=test-group,topics=[{topic=topic,partitions=[{partition=0}]}]} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:56 TRACE GroupMetadataManager:36 - [Group Metadata Manager on Broker 1]: Getting offsets of ArrayBuffer(topic-0) for group test-group. 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Sending offset fetch response {responses=[{topic=topic,partition_responses=[{partition=0,offset=1000,metadata=,error_code=0}]}],error_code=0} for correlation id 21 to client consumer-2. 2017-06-30 23:00:56 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056584,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@11f0522d,SendAction) 2017-06-30 23:00:56 TRACE logger:157 - Completed request:{api_key=9,api_version=2,correlation_id=21,client_id=consumer-2} -- {group_id=test-group,topics=[{topic=topic,partitions=[{partition=0}]}]} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:0,requestQueueTime:0,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:56 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 9, received {responses=[{topic=topic,partition_responses=[{partition=0,offset=1000,metadata=,error_code=0}]}],error_code=0} 2017-06-30 23:00:56 DEBUG Fetcher:251 - Resetting offset for partition topic-0 to the committed offset 1000 2017-06-30 23:00:56 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:56 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:56 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:56 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:56 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=1,api_version=3,correlation_id=22,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:56 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056585,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:56 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=22,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:56 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:56 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:56 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:56 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:56 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:56 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:56 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:56 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:57 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:57 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:57 DEBUG Metrics:335 - Added sensor with name Fetch-:consumer-2 2017-06-30 23:00:57 DEBUG Metrics:335 - Added sensor with name FetchThrottleTime-:consumer-2 2017-06-30 23:00:57 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-2 of 0 bytes 2017-06-30 23:00:57 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860056585,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@48eb5e96,SendAction) 2017-06-30 23:00:57 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:57 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:57 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=22,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:503,requestQueueTime:0,localTime:0,remoteTime:502,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:57 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:57 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:57 DEBUG Metrics:335 - Added sensor with name topic.topic.bytes-fetched 2017-06-30 23:00:57 DEBUG Metrics:335 - Added sensor with name topic.topic.records-fetched 2017-06-30 23:00:57 DEBUG Metrics:335 - Added sensor with name topic-0.records-lag 2017-06-30 23:00:57 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:57 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:57 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:57 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:57 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=1,api_version=3,correlation_id=23,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:57 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860057090,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:57 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=23,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:57 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:57 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:57 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:57 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:00:57 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:57 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:57 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-2 of 0 bytes 2017-06-30 23:00:57 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860057090,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@476ba12e,SendAction) 2017-06-30 23:00:57 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:57 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:57 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=23,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:505,requestQueueTime:0,localTime:1,remoteTime:504,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:57 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:57 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:57 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:57 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:57 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:57 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:57 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=1,api_version=3,correlation_id=24,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:57 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860057596,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:57 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=24,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:57 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:57 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:57 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:57 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:57 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:57 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:57 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:57 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:58 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:58 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:58 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-2 of 0 bytes 2017-06-30 23:00:58 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860057596,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@4ea903d4,SendAction) 2017-06-30 23:00:58 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:58 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:58 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=24,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:505,requestQueueTime:1,localTime:0,remoteTime:503,responseQueueTime:1,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:58 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:58 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:58 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:58 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:58 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:58 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:58 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=1,api_version=3,correlation_id=25,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:58 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860058102,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:58 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=25,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:58 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:58 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:58 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:00:58 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:58 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:00:58 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:00:58 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:00:58 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:58 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:58 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-2 of 0 bytes 2017-06-30 23:00:58 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860058102,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@5ddb4116,SendAction) 2017-06-30 23:00:58 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:58 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:58 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=25,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:502,requestQueueTime:0,localTime:1,remoteTime:500,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:58 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:58 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:58 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:58 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:58 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:58 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:58 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=1,api_version=3,correlation_id=26,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:58 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860058605,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:58 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=26,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:58 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:58 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:58 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:58 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:58 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:58 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:58 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:58 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:59 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:59 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:00:59 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:59 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:59 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-2 of 0 bytes 2017-06-30 23:00:59 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860058605,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@4fd6abd5,SendAction) 2017-06-30 23:00:59 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:59 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:59 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=26,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:505,requestQueueTime:0,localTime:1,remoteTime:503,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:59 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:59 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:59 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:59 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:59 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:59 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:59 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=1,api_version=3,correlation_id=27,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:59 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860059111,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:59 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=27,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:59 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:59 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:59 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group test-group to coordinator localhost:52135 (id: 2147483646 rack: null) 2017-06-30 23:00:59 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} to node 2147483646. 2017-06-30 23:00:59 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:59 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=12,api_version=0,correlation_id=28,client_id=consumer-2} -- {group_id=test-group,group_generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} 2017-06-30 23:00:59 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860059587,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:59 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=12,api_version=0,correlation_id=28,client_id=consumer-2} -- {group_id=test-group,group_generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:59 TRACE KafkaApis:36 - [KafkaApi-1] Sending heartbeat response {error_code=0} for correlation id 28 to client consumer-2. 2017-06-30 23:00:59 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860059587,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@552e01d0,SendAction) 2017-06-30 23:00:59 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 12, received {error_code=0} 2017-06-30 23:00:59 TRACE logger:157 - Completed request:{api_key=12,api_version=0,correlation_id=28,client_id=consumer-2} -- {group_id=test-group,group_generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:2,requestQueueTime:1,localTime:0,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:59 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group test-group 2017-06-30 23:00:59 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:59 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:59 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:59 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:59 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-2 of 0 bytes 2017-06-30 23:00:59 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860059111,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@531f1f02,SendAction) 2017-06-30 23:00:59 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:00:59 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:00:59 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=27,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:501,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:00:59 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:00:59 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:00:59 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:59 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:59 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:00:59 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:00:59 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=1,api_version=3,correlation_id=29,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:00:59 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860059615,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:00:59 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=29,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:00:59 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:00:59 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:00:59 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:00:59 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:00:59 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:00:59 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:00:59 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:00:59 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:00 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:01:00 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:01:00 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-2 of 0 bytes 2017-06-30 23:01:00 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860059615,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@54cb2786,SendAction) 2017-06-30 23:01:00 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:01:00 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:01:00 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=29,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:502,requestQueueTime:0,localTime:1,remoteTime:500,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:01:00 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:01:00 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:01:00 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:00 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:00 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:01:00 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:00 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=1,api_version=3,correlation_id=30,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:01:00 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860060118,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:01:00 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=30,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:01:00 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:01:00 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:01:00 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:00 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:00 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:00 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:00 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:01:00 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:01:00 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:01:00 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-2 of 0 bytes 2017-06-30 23:01:00 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860060118,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@2e39b6c9,SendAction) 2017-06-30 23:01:00 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:01:00 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:01:00 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=30,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:504,requestQueueTime:0,localTime:1,remoteTime:502,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:01:00 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:01:00 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:01:00 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:00 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:00 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:01:00 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:00 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=1,api_version=3,correlation_id=31,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:01:00 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860060623,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:01:00 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=31,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:01:00 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:01:00 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:01:00 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:00 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:00 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:00 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:00 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:00 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:01 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:01:01 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:01:01 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-2 of 0 bytes 2017-06-30 23:01:01 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860060623,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@b3c025f,SendAction) 2017-06-30 23:01:01 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:01:01 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:01:01 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=31,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:502,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:01:01 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:01:01 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:01:01 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:01 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:01 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:01:01 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:01 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=1,api_version=3,correlation_id=32,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:01:01 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860061127,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:01:01 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=32,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:01:01 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:01:01 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'kafka-log-retention'. 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'kafka-delete-logs'. 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'kafka-log-flusher'. 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'kafka-recovery-point-checkpoint'. 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'kafka-delete-logs'. 2017-06-30 23:01:01 DEBUG LogManager:54 - Beginning log cleanup... 2017-06-30 23:01:01 DEBUG LogManager:54 - Checking for dirty logs to flush... 2017-06-30 23:01:01 DEBUG LogManager:54 - Garbage collecting 'topic-0' 2017-06-30 23:01:01 DEBUG LogManager:54 - Checking if flush is needed on __consumer_offsets flush interval 9223372036854775807 last flushed 1498860032179 time since last flush: 29324 2017-06-30 23:01:01 DEBUG LogManager:54 - Checking if flush is needed on topic flush interval 9223372036854775807 last flushed 1498860032087 time since last flush: 29416 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'kafka-log-flusher'. 2017-06-30 23:01:01 DEBUG LogManager:54 - Log cleanup completed. 0 files deleted in 0 seconds 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'kafka-log-retention'. 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'kafka-recovery-point-checkpoint'. 2017-06-30 23:01:01 DEBUG LogCleanerManager$:54 - Finding range of cleanable offsets for log=__consumer_offsets-0 topicPartition=__consumer_offsets-0. Last clean offset=None now=1498860061516 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-expiration'. 2017-06-30 23:01:01 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Evaluating ISR list of partitions to see which replicas can be removed from the ISR 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-expiration'. 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:01 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:01:01 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:01:01 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-2 of 0 bytes 2017-06-30 23:01:01 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860061127,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@20f0fb35,SendAction) 2017-06-30 23:01:01 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:01:01 TRACE NetworkClient:534 - Completed receive from node 1, for key 1, received {throttle_time_ms=0,responses=[{topic=topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=1000},record_set=[]}]}]} 2017-06-30 23:01:01 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=32,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:504,requestQueueTime:1,localTime:0,remoteTime:503,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:01:01 TRACE Fetcher:796 - Adding fetched record for partition topic-0 with offset 1000 to buffered record list 2017-06-30 23:01:01 TRACE Fetcher:818 - Received 0 records in fetch response for partition topic-0 with offset 1000 2017-06-30 23:01:01 TRACE Fetcher:739 - Added fetch request for partition topic-0 at offset 1000 to node localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:01 DEBUG Fetcher:181 - Sending fetch for partitions [topic-0] to broker localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:01 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} to node 1. 2017-06-30 23:01:01 TRACE Fetcher:741 - Skipping fetch for partition topic-0 because there is an in-flight request to localhost:52135 (id: 1 rack: null) 2017-06-30 23:01:01 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=1,api_version=3,correlation_id=33,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} 2017-06-30 23:01:01 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860061632,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:01:01 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=1,api_version=3,correlation_id=33,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:01:01 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:01:01 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:01 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:01 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:01 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:01 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:01 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:01 TRACE ConsumerCoordinator:710 - Sending OffsetCommit request with {topic-0=OffsetAndMetadata{offset=1000, metadata=''}} to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:01:01 TRACE NetworkClient:316 - Sending {group_id=test-group,group_generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} to node 2147483646. 2017-06-30 23:01:01 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=8,api_version=2,correlation_id=34,client_id=consumer-2} -- {group_id=test-group,group_generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} 2017-06-30 23:01:01 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860061926,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:01:01 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=8,api_version=2,correlation_id=34,client_id=consumer-2} -- {group_id=test-group,group_generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:01:01 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3034988815, CreateTime = 1498860061927, key = 25 bytes, value = 28 bytes))])] to local log 2017-06-30 23:01:01 TRACE LogSegment:36 - Inserting 87 bytes at offset 37 at position 3839 with largest timestamp 1498860061927 at shallow offset 37 2017-06-30 23:01:01 TRACE LogSegment:36 - Appended 87 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 37 2017-06-30 23:01:01 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 37, next offset: 38, and messages: [(offset=37,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3034988815, CreateTime = 1498860061927, key = 25 bytes, value = 28 bytes))] 2017-06-30 23:01:01 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:01:01 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [38 [0 : 3926]] 2017-06-30 23:01:01 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 38 [0 : 3926] 2017-06-30 23:01:01 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:01:01 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:01:01 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 87 bytes written to log __consumer_offsets-0 beginning at offset 37 and ending at offset 37 2017-06-30 23:01:01 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 1 ms 2017-06-30 23:01:01 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 37, requiredOffset: 38] 2017-06-30 23:01:01 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 37, requiredOffset: 38] 2017-06-30 23:01:01 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:01:01 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860061926,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@2d8a0fba,SendAction) 2017-06-30 23:01:01 TRACE logger:157 - Completed request:{api_key=8,api_version=2,correlation_id=34,client_id=consumer-2} -- {group_id=test-group,group_generation_id=3,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71,retention_time=-1,topics=[{topic=topic,partitions=[{partition=0,offset=1000,metadata=}]}]} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:3,requestQueueTime:0,localTime:3,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:01:01 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 8, received {responses=[{topic=topic,partition_responses=[{partition=0,error_code=0}]}]} 2017-06-30 23:01:01 DEBUG ConsumerCoordinator:736 - Group test-group committed offset 1000 for partition topic-0 2017-06-30 23:01:01 TRACE KafkaConsumer:1552 - Closing the Kafka consumer. 2017-06-30 23:01:01 DEBUG AbstractCoordinator:967 - Heartbeat thread for group test-group has closed 2017-06-30 23:01:01 DEBUG AbstractCoordinator:697 - Sending LeaveGroup request to coordinator localhost:52135 (id: 2147483646 rack: null) for group test-group 2017-06-30 23:01:01 TRACE NetworkClient:316 - Sending {group_id=test-group,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} to node 2147483646. 2017-06-30 23:01:01 TRACE RequestChannel$:36 - Processor 0 received request : {api_key=13,api_version=0,correlation_id=35,client_id=consumer-2} -- {group_id=test-group,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} 2017-06-30 23:01:01 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860061930,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:01:01 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:{api_key=13,api_version=0,correlation_id=35,client_id=consumer-2} -- {group_id=test-group,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:01:01 TRACE GroupCoordinator:36 - [GroupCoordinator 1]: Member consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71 in group test-group has failed 2017-06-30 23:01:01 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Preparing to restabilize group test-group with old generation 3 2017-06-30 23:01:01 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Group test-group with generation 4 is now empty 2017-06-30 23:01:01 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Append [Map(__consumer_offsets-0 -> [(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3949101029, CreateTime = 1498860061932, key = 14 bytes, value = 24 bytes))])] to local log 2017-06-30 23:01:01 TRACE LogSegment:36 - Inserting 72 bytes at offset 38 at position 3926 with largest timestamp 1498860061932 at shallow offset 38 2017-06-30 23:01:01 TRACE LogSegment:36 - Appended 72 to /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/__consumer_offsets-0/00000000000000000000.log at offset 38 2017-06-30 23:01:01 TRACE Log:36 - Appended message set to log __consumer_offsets-0 with first offset: 38, next offset: 39, and messages: [(offset=38,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3949101029, CreateTime = 1498860061932, key = 14 bytes, value = 24 bytes))] 2017-06-30 23:01:01 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:01:01 TRACE Replica:36 - Setting high watermark for replica 1 partition __consumer_offsets-0 to [39 [0 : 3998]] 2017-06-30 23:01:01 DEBUG Partition:54 - Partition [__consumer_offsets,0] on broker 1: High watermark for partition [__consumer_offsets,0] updated to 39 [0 : 3998] 2017-06-30 23:01:01 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 fetch requests. 2017-06-30 23:01:01 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Request key __consumer_offsets-0 unblocked 0 producer requests. 2017-06-30 23:01:01 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: 72 bytes written to log __consumer_offsets-0 beginning at offset 38 and ending at offset 38 2017-06-30 23:01:01 DEBUG ReplicaManager:54 - [Replica Manager on Broker 1]: Produce to local log in 1 ms 2017-06-30 23:01:01 TRACE DelayedProduce:36 - Initial partition status for __consumer_offsets-0 is [acksPending: true, error: 7, startOffset: 38, requiredOffset: 39] 2017-06-30 23:01:01 TRACE DelayedProduce:36 - Checking produce satisfaction for __consumer_offsets-0, current status [acksPending: true, error: 7, startOffset: 38, requiredOffset: 39] 2017-06-30 23:01:01 TRACE Partition:36 - Partition [__consumer_offsets,0] on broker 1: 1 acks satisfied for __consumer_offsets-0 with acks = -1 2017-06-30 23:01:01 TRACE KafkaApis:36 - [KafkaApi-1] Sending leave group response {error_code=0} for correlation id 35 to client consumer-2. 2017-06-30 23:01:01 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52144,Session(User:ANONYMOUS,/127.0.0.1),null,1498860061930,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.NetworkSend@4e667b3c,SendAction) 2017-06-30 23:01:01 TRACE logger:157 - Completed request:{api_key=13,api_version=0,correlation_id=35,client_id=consumer-2} -- {group_id=test-group,member_id=consumer-2-13eb4e4b-b75c-42dd-bba8-fcdbbc2ecc71} from connection 127.0.0.1:52135-127.0.0.1:52144;totalTime:4,requestQueueTime:0,localTime:4,remoteTime:0,responseQueueTime:0,sendTime:0,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:01:01 TRACE NetworkClient:534 - Completed receive from node 2147483646, for key 13, received {error_code=0} 2017-06-30 23:01:01 DEBUG AbstractCoordinator:713 - LeaveGroup request for group test-group returned successfully 2017-06-30 23:01:01 DEBUG Selector:375 - Connection with /127.0.0.1 disconnected java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:83) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:169) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:150) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:355) at org.apache.kafka.common.network.Selector.poll(Selector.java:303) at kafka.network.Processor.poll(SocketServer.scala:494) at kafka.network.Processor.run(SocketServer.scala:432) at java.lang.Thread.run(Thread.java:745) 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name connections-closed: 2017-06-30 23:01:01 DEBUG Selector:375 - Connection with /127.0.0.1 disconnected java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:83) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:169) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:150) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:355) at org.apache.kafka.common.network.Selector.poll(Selector.java:303) at kafka.network.Processor.poll(SocketServer.scala:494) at kafka.network.Processor.run(SocketServer.scala:432) at java.lang.Thread.run(Thread.java:745) 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name connections-created: 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name bytes-sent-received: 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name bytes-sent: 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name bytes-received: 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name select-time: 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name io-time: 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name node--1.bytes-sent 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name node--1.bytes-received 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name node--1.latency 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name node-1.bytes-sent 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name node-1.bytes-received 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name node-1.latency 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name node-2147483646.bytes-sent 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name node-2147483646.bytes-received 2017-06-30 23:01:01 DEBUG Metrics:368 - Removed sensor with name node-2147483646.latency 2017-06-30 23:01:01 DEBUG KafkaConsumer:1568 - The Kafka consumer has closed. 2017-06-30 23:01:02 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Fetching log segment for partition topic-0, offset 1000, partition fetch size 1048576, remaining response limit 52428800, ignoring response/partition size limits 2017-06-30 23:01:02 TRACE Log:36 - Reading 1048576 bytes from offset 1000 in log topic-0 of length 39000 bytes 2017-06-30 23:01:02 TRACE KafkaApis:36 - [KafkaApi-1] Sending fetch response to client consumer-2 of 0 bytes 2017-06-30 23:01:02 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52141,Session(User:ANONYMOUS,/127.0.0.1),null,1498860061632,ListenerName(PLAINTEXT),PLAINTEXT),org.apache.kafka.common.network.MultiSend@22dd897,SendAction) 2017-06-30 23:01:02 TRACE MultiSend:88 - Bytes written as part of multi-send call: 45, total bytes written so far: 45, expected bytes to write: 45 2017-06-30 23:01:02 TRACE logger:157 - Completed request:{api_key=1,api_version=3,correlation_id=33,client_id=consumer-2} -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=topic,partitions=[{partition=0,fetch_offset=1000,max_bytes=1048576}]}]} from connection 127.0.0.1:52135-127.0.0.1:52141;totalTime:503,requestQueueTime:0,localTime:1,remoteTime:501,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:01:02 DEBUG Selector:375 - Connection with /127.0.0.1 disconnected java.io.IOException: Connection reset by peer at sun.nio.ch.FileDispatcherImpl.read0(Native Method) at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) at sun.nio.ch.IOUtil.read(IOUtil.java:197) at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380) at org.apache.kafka.common.network.PlaintextTransportLayer.read(PlaintextTransportLayer.java:110) at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:81) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:169) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:150) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:355) at org.apache.kafka.common.network.Selector.poll(Selector.java:303) at kafka.network.Processor.poll(SocketServer.scala:494) at kafka.network.Processor.run(SocketServer.scala:432) at java.lang.Thread.run(Thread.java:745) 2017-06-30 23:01:02 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:01:02 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:01:02 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:02 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:02 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:02 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:02 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:01:02 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:02 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:02 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:02 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:02 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:02 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:03 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:03 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:03 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:03 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:03 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:03 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:04 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:04 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:04 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:04 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:04 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:04 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:04 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:01:04 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:04 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:04 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:04 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:04 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:04 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:05 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:05 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:05 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:05 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:05 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:05 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:06 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:06 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:06 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:06 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:06 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:01:06 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-expiration'. 2017-06-30 23:01:06 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Evaluating ISR list of partitions to see which replicas can be removed from the ISR 2017-06-30 23:01:06 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:06 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-expiration'. 2017-06-30 23:01:06 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:06 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:06 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:06 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:06 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:06 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:06 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:07 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:01:07 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:01:07 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:07 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:07 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:07 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:07 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:07 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:08 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:08 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:08 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:08 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:08 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:01:08 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:08 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:08 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:08 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:08 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:08 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:09 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:09 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:09 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:09 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:09 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:09 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:09 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:09 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:10 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:10 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:10 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:10 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:10 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:01:10 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:10 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:10 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:10 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:10 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:10 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:11 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-expiration'. 2017-06-30 23:01:11 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Evaluating ISR list of partitions to see which replicas can be removed from the ISR 2017-06-30 23:01:11 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:11 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-expiration'. 2017-06-30 23:01:11 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:11 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:11 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:11 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:11 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:11 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:11 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:12 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:01:12 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:01:12 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:12 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:12 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:12 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:12 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 0ms 2017-06-30 23:01:12 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:12 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:12 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:12 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:12 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:12 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:13 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:13 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:13 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:13 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:13 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:13 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:14 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:14 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:14 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:14 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:14 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:14 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:14 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 3ms 2017-06-30 23:01:14 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:14 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:14 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:14 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:14 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:14 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:15 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:15 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:15 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:15 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:15 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:15 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:16 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:16 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:16 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:16 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:16 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:01:16 DEBUG LogCleanerManager$:54 - Finding range of cleanable offsets for log=__consumer_offsets-0 topicPartition=__consumer_offsets-0. Last clean offset=None now=1498860076516 => firstDirtyOffset=0 firstUncleanableOffset=0 activeSegment.baseOffset=0 2017-06-30 23:01:16 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-expiration'. 2017-06-30 23:01:16 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Evaluating ISR list of partitions to see which replicas can be removed from the ISR 2017-06-30 23:01:16 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:16 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-expiration'. 2017-06-30 23:01:16 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:16 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:16 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:16 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:16 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:16 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:16 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:17 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:01:17 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:01:17 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:17 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:17 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:17 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:17 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:17 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:18 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:18 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:18 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:18 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:18 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:01:18 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:18 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:18 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:18 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:18 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:18 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:19 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:19 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:19 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:19 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:19 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:19 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:19 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:19 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:20 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:20 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:20 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:20 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:20 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:01:20 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:20 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:20 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:20 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:20 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:20 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:21 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-expiration'. 2017-06-30 23:01:21 TRACE ReplicaManager:36 - [Replica Manager on Broker 1]: Evaluating ISR list of partitions to see which replicas can be removed from the ISR 2017-06-30 23:01:21 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:21 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-expiration'. 2017-06-30 23:01:21 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:21 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:21 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:21 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:21 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:21 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:21 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:22 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:01:22 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'highwatermark-checkpoint'. 2017-06-30 23:01:22 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:22 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:22 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:22 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:22 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:01:22 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:22 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:22 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:22 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:22 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:22 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:23 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:23 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:23 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:23 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:23 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:23 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:24 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:24 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'isr-change-propagation'. 2017-06-30 23:01:24 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:24 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:24 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:24 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:24 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 0ms 2017-06-30 23:01:24 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:24 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:24 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:24 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:24 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:24 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:25 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:25 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:25 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:25 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:25 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:25 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:26 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:26 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:26 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:ping cxid:0xfffffffffffffffe zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:26 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:26 DEBUG ClientCnxn:843 - Got ping response for sessionid: 0x10000f6eb680000 after 1ms 2017-06-30 23:01:26 INFO EphemeralKafkaBroker:157 - Shutting down Kafka Server 2017-06-30 23:01:26 INFO KafkaServer:70 - [Kafka Server 1], shutting down 2017-06-30 23:01:26 INFO KafkaServer:70 - [Kafka Server 1], Starting controlled shutdown 2017-06-30 23:01:26 DEBUG Metrics:335 - Added sensor with name connections-closed: 2017-06-30 23:01:26 DEBUG Metrics:335 - Added sensor with name connections-created: 2017-06-30 23:01:26 DEBUG Metrics:335 - Added sensor with name bytes-sent-received: 2017-06-30 23:01:26 DEBUG Metrics:335 - Added sensor with name bytes-sent: 2017-06-30 23:01:26 DEBUG Metrics:335 - Added sensor with name bytes-received: 2017-06-30 23:01:26 DEBUG Metrics:335 - Added sensor with name select-time: 2017-06-30 23:01:26 DEBUG Metrics:335 - Added sensor with name io-time: 2017-06-30 23:01:26 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x86 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:01:26 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:26 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x86 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:01:26 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x86 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:01:26 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x86 zxid:0xfffffffffffffffe txntype:unknown reqpath:/controller 2017-06-30 23:01:26 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:01:26 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:01:26 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:01:26 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:26 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 134,4 replyHeader:: 134,51,0 request:: '/controller,T response:: #7b2276657273696f6e223a312c2262726f6b65726964223a312c2274696d657374616d70223a2231343938383630303331353638227d,s{20,20,1498860031573,1498860031573,0,0,0,72058654549344256,54,0,20} 2017-06-30 23:01:26 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:getData cxid:0x87 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:01:26 DEBUG SessionTrackerImpl:291 - Checking session 0x10000f6eb680000 2017-06-30 23:01:26 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:getData cxid:0x87 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:01:26 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:getData cxid:0x87 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:01:26 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:getData cxid:0x87 zxid:0xfffffffffffffffe txntype:unknown reqpath:/brokers/ids/1 2017-06-30 23:01:26 DEBUG PrepRequestProcessor:300 - Permission requested: 1 2017-06-30 23:01:26 DEBUG PrepRequestProcessor:301 - ACLs for node: [31,s{'world,'anyone} ] 2017-06-30 23:01:26 DEBUG PrepRequestProcessor:302 - Client credentials: ['ip,'127.0.0.1 ] 2017-06-30 23:01:26 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:26 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 135,4 replyHeader:: 135,51,0 request:: '/brokers/ids/1,F response:: #7b226c697374656e65725f73656375726974795f70726f746f636f6c5f6d6170223a7b22504c41494e54455854223a22504c41494e54455854227d2c22656e64706f696e7473223a5b22504c41494e544558543a2f2f6c6f63616c686f73743a3532313335225d2c226a6d785f706f7274223a2d312c22686f7374223a226c6f63616c686f7374222c2274696d657374616d70223a2231343938383630303331383130222c22706f7274223a35323133352c2276657273696f6e223a347d,s{26,26,1498860031814,1498860031814,0,0,0,72058654549344256,190,0,26} 2017-06-30 23:01:26 DEBUG NetworkClient:627 - Initiating connection to node 1 at localhost:52135. 2017-06-30 23:01:26 DEBUG Selector:339 - Created socket with SO_RCVBUF = 408300, SO_SNDBUF = 146988, SO_TIMEOUT = 0 to node 1 2017-06-30 23:01:26 DEBUG Acceptor:54 - Accepted connection from /127.0.0.1:52178 on /127.0.0.1:52135 and assigned it to processor 0, sendBufferSize [actual|requested]: [102400|102400] recvBufferSize [actual|requested]: [375636|102400] 2017-06-30 23:01:26 DEBUG NetworkClient:593 - Completed connection to node 1. Ready. 2017-06-30 23:01:26 DEBUG Processor:54 - Processor 0 listening to new connection from /127.0.0.1:52178 2017-06-30 23:01:26 TRACE NetworkClient:316 - Sending {broker_id=1} to node 1. 2017-06-30 23:01:26 TRACE RequestChannel$:36 - Processor 0 received request : Name: ControlledShutdownRequest; Version: 1; CorrelationId: 0;ClientId:Some(1); BrokerId: 1 2017-06-30 23:01:26 TRACE KafkaRequestHandler:36 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 handling request Request(0,127.0.0.1:52135-127.0.0.1:52178,Session(User:ANONYMOUS,/127.0.0.1),null,1498860086375,ListenerName(PLAINTEXT),PLAINTEXT) 2017-06-30 23:01:26 TRACE KafkaApis:36 - [KafkaApi-1] Handling request:Name: ControlledShutdownRequest; Version: 1; CorrelationId: 0;ClientId:Some(1); BrokerId: 1 from connection 127.0.0.1:52135-127.0.0.1:52178;securityProtocol:PLAINTEXT,principal:User:ANONYMOUS 2017-06-30 23:01:26 INFO KafkaController:70 - [Controller 1]: Shutting down broker 1 2017-06-30 23:01:26 DEBUG KafkaController:54 - [Controller 1]: All shutting down brokers: 1 2017-06-30 23:01:26 DEBUG KafkaController:54 - [Controller 1]: Live brokers: 2017-06-30 23:01:26 TRACE KafkaController:36 - [Controller 1]: All leaders = [topic,0] -> (Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1),[__consumer_offsets,0] -> (Leader:1,ISR:1,LeaderEpoch:0,ControllerEpoch:1) 2017-06-30 23:01:26 TRACE Processor:36 - Socket server received response to send, registering for write and sending data: Response(0,Request(0,127.0.0.1:52135-127.0.0.1:52178,Session(User:ANONYMOUS,/127.0.0.1),null,1498860086375,ListenerName(PLAINTEXT),PLAINTEXT),kafka.network.RequestOrResponseSend@7a8dece7,SendAction) 2017-06-30 23:01:26 TRACE logger:157 - Completed request:Name: ControlledShutdownRequest; Version: 1; CorrelationId: 0;ClientId:Some(1); BrokerId: 1 from connection 127.0.0.1:52135-127.0.0.1:52178;totalTime:8,requestQueueTime:1,localTime:6,remoteTime:0,responseQueueTime:0,sendTime:1,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT 2017-06-30 23:01:26 TRACE NetworkClient:534 - Completed receive from node 1, for key 7, received {error_code=0,partitions_remaining=[]} 2017-06-30 23:01:26 INFO KafkaServer:70 - [Kafka Server 1], Controlled shutdown succeeded 2017-06-30 23:01:26 DEBUG Selector:375 - Connection with /127.0.0.1 disconnected java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:83) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:169) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:150) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:355) at org.apache.kafka.common.network.Selector.poll(Selector.java:303) at kafka.network.Processor.poll(SocketServer.scala:494) at kafka.network.Processor.run(SocketServer.scala:432) at java.lang.Thread.run(Thread.java:745) 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name connections-closed: 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name connections-created: 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-sent-received: 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-sent: 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-received: 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name select-time: 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name io-time: 2017-06-30 23:01:26 INFO SocketServer:70 - [Socket Server on Broker 1], Shutting down 2017-06-30 23:01:26 DEBUG Acceptor:54 - Closing server socket and selector. 2017-06-30 23:01:26 DEBUG Processor:54 - Closing selector - processor 0 2017-06-30 23:01:26 DEBUG Processor:54 - Closing selector connection 127.0.0.1:52135-127.0.0.1:52138 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name connections-closed:networkProcessor-0 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name connections-created:networkProcessor-0 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-sent-received:networkProcessor-0 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-sent:networkProcessor-0 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-received:networkProcessor-0 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name select-time:networkProcessor-0 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name io-time:networkProcessor-0 2017-06-30 23:01:26 DEBUG Processor:54 - Closing selector - processor 1 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name connections-closed:networkProcessor-1 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name connections-created:networkProcessor-1 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-sent-received:networkProcessor-1 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-sent:networkProcessor-1 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-received:networkProcessor-1 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name select-time:networkProcessor-1 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name io-time:networkProcessor-1 2017-06-30 23:01:26 DEBUG Processor:54 - Closing selector - processor 2 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name connections-closed:networkProcessor-2 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name connections-created:networkProcessor-2 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-sent-received:networkProcessor-2 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-sent:networkProcessor-2 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name bytes-received:networkProcessor-2 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name select-time:networkProcessor-2 2017-06-30 23:01:26 DEBUG Metrics:368 - Removed sensor with name io-time:networkProcessor-2 2017-06-30 23:01:26 INFO SocketServer:70 - [Socket Server on Broker 1], Shutdown completed 2017-06-30 23:01:26 INFO KafkaRequestHandlerPool:70 - [Kafka Request Handler on Broker 1], shutting down 2017-06-30 23:01:26 DEBUG KafkaRequestHandler:54 - [Kafka Request Handler 1 on Broker 1], Kafka request handler 1 on broker 1 received shut down command 2017-06-30 23:01:26 DEBUG KafkaRequestHandler:54 - [Kafka Request Handler 5 on Broker 1], Kafka request handler 5 on broker 1 received shut down command 2017-06-30 23:01:26 DEBUG KafkaRequestHandler:54 - [Kafka Request Handler 4 on Broker 1], Kafka request handler 4 on broker 1 received shut down command 2017-06-30 23:01:26 DEBUG KafkaRequestHandler:54 - [Kafka Request Handler 6 on Broker 1], Kafka request handler 6 on broker 1 received shut down command 2017-06-30 23:01:26 DEBUG KafkaRequestHandler:54 - [Kafka Request Handler 2 on Broker 1], Kafka request handler 2 on broker 1 received shut down command 2017-06-30 23:01:26 DEBUG KafkaRequestHandler:54 - [Kafka Request Handler 7 on Broker 1], Kafka request handler 7 on broker 1 received shut down command 2017-06-30 23:01:26 DEBUG KafkaRequestHandler:54 - [Kafka Request Handler 0 on Broker 1], Kafka request handler 0 on broker 1 received shut down command 2017-06-30 23:01:26 DEBUG KafkaRequestHandler:54 - [Kafka Request Handler 3 on Broker 1], Kafka request handler 3 on broker 1 received shut down command 2017-06-30 23:01:26 INFO KafkaRequestHandlerPool:70 - [Kafka Request Handler on Broker 1], shut down completely 2017-06-30 23:01:26 DEBUG KafkaScheduler:54 - Shutting down task scheduler. 2017-06-30 23:01:26 INFO ClientQuotaManager$ThrottledRequestReaper:70 - [ThrottledRequestReaper-Fetch], Shutting down 2017-06-30 23:01:26 INFO ClientQuotaManager$ThrottledRequestReaper:70 - [ThrottledRequestReaper-Fetch], Shutdown completed 2017-06-30 23:01:26 INFO ClientQuotaManager$ThrottledRequestReaper:70 - [ThrottledRequestReaper-Produce], Shutting down 2017-06-30 23:01:26 INFO ClientQuotaManager$ThrottledRequestReaper:70 - [ThrottledRequestReaper-Fetch], Stopped 2017-06-30 23:01:26 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:26 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:26 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:26 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:26 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:26 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:27 INFO ClientQuotaManager$ThrottledRequestReaper:70 - [ThrottledRequestReaper-Produce], Stopped 2017-06-30 23:01:27 INFO ClientQuotaManager$ThrottledRequestReaper:70 - [ThrottledRequestReaper-Produce], Shutdown completed 2017-06-30 23:01:27 INFO KafkaApis:70 - [KafkaApi-1] Shutdown complete. 2017-06-30 23:01:27 INFO ReplicaManager:70 - [Replica Manager on Broker 1]: Shutting down 2017-06-30 23:01:27 INFO ReplicaFetcherManager:70 - [ReplicaFetcherManager on broker 1] shutting down 2017-06-30 23:01:27 INFO ReplicaFetcherManager:70 - [ReplicaFetcherManager on broker 1] shutdown completed 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Shutting down 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Stopped 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Shutdown completed 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Shutting down 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Stopped 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Shutdown completed 2017-06-30 23:01:27 INFO ReplicaManager:70 - [Replica Manager on Broker 1]: Shut down completely 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Shutting down 2017-06-30 23:01:27 TRACE KafkaScheduler:36 - Beginning execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:27 TRACE KafkaController:36 - [Controller 1]: checking need to trigger partition rebalance 2017-06-30 23:01:27 DEBUG KafkaController:54 - [Controller 1]: preferred replicas by broker Map(1 -> Map([topic,0] -> List(1), [__consumer_offsets,0] -> List(1))) 2017-06-30 23:01:27 DEBUG KafkaController:54 - [Controller 1]: topics not in preferred replica Map() 2017-06-30 23:01:27 TRACE KafkaController:36 - [Controller 1]: leader imbalance ratio for broker 1 is 0.000000 2017-06-30 23:01:27 TRACE KafkaScheduler:36 - Completed execution of scheduled task 'partition-rebalance-thread'. 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Stopped 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Shutdown completed 2017-06-30 23:01:27 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Shutting down. 2017-06-30 23:01:27 DEBUG KafkaScheduler:54 - Shutting down task scheduler. 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Shutting down 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Shutdown completed 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Stopped 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Shutting down 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Stopped 2017-06-30 23:01:27 INFO DelayedOperationPurgatory$ExpiredOperationReaper:70 - [ExpirationReaper-1], Shutdown completed 2017-06-30 23:01:27 INFO GroupCoordinator:70 - [GroupCoordinator 1]: Shutdown complete. 2017-06-30 23:01:27 INFO LogManager:70 - Shutting down. 2017-06-30 23:01:27 INFO LogCleaner:70 - Shutting down the log cleaner. 2017-06-30 23:01:27 INFO LogCleaner:70 - [kafka-log-cleaner-thread-0], Shutting down 2017-06-30 23:01:27 INFO LogCleaner:70 - [kafka-log-cleaner-thread-0], Stopped 2017-06-30 23:01:27 INFO LogCleaner:70 - [kafka-log-cleaner-thread-0], Shutdown completed 2017-06-30 23:01:27 DEBUG LogManager:54 - Flushing and closing logs at /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832 2017-06-30 23:01:27 DEBUG Log:54 - Flushing log '__consumer_offsets-0 up to offset 39, last flushed: 1498860032179 current time: 1498860087903 unflushed = 39 2017-06-30 23:01:27 DEBUG Log:54 - Closing log __consumer_offsets-0 2017-06-30 23:01:27 DEBUG TimeIndex:54 - Adding index entry 1498860061932 => 38 to 00000000000000000000.timeindex. 2017-06-30 23:01:27 DEBUG Log:54 - Flushing log 'topic-0 up to offset 1000, last flushed: 1498860032087 current time: 1498860087909 unflushed = 1000 2017-06-30 23:01:27 DEBUG Log:54 - Closing log topic-0 2017-06-30 23:01:27 DEBUG TimeIndex:54 - Adding index entry 1498860036313 => 994 to 00000000000000000000.timeindex. 2017-06-30 23:01:27 DEBUG LogManager:54 - Updating recovery points at /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832 2017-06-30 23:01:27 DEBUG LogManager:54 - Writing clean shutdown marker at /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832 2017-06-30 23:01:27 TRACE FileLock:36 - Releasing lock on /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832/.lock 2017-06-30 23:01:27 INFO LogManager:70 - Shutdown complete. 2017-06-30 23:01:27 DEBUG KafkaController:54 - [Controller 1]: Controller resigning, broker id 1 2017-06-30 23:01:27 DEBUG KafkaController:54 - [Controller 1]: De-registering IsrChangeNotificationListener 2017-06-30 23:01:27 DEBUG KafkaScheduler:54 - Shutting down task scheduler. 2017-06-30 23:01:27 INFO PartitionStateMachine:70 - [Partition state machine on Controller 1]: Stopped partition state machine 2017-06-30 23:01:27 INFO ReplicaStateMachine:70 - [Replica state machine on controller 1]: Stopped replica state machine 2017-06-30 23:01:27 INFO RequestSendThread:70 - [Controller-1-to-broker-1-send-thread], Shutting down 2017-06-30 23:01:27 INFO RequestSendThread:70 - [Controller-1-to-broker-1-send-thread], Stopped 2017-06-30 23:01:27 INFO RequestSendThread:70 - [Controller-1-to-broker-1-send-thread], Shutdown completed 2017-06-30 23:01:27 DEBUG Metrics:368 - Removed sensor with name connections-closed:broker-id-1 2017-06-30 23:01:27 DEBUG Metrics:368 - Removed sensor with name connections-created:broker-id-1 2017-06-30 23:01:27 DEBUG Metrics:368 - Removed sensor with name bytes-sent-received:broker-id-1 2017-06-30 23:01:27 DEBUG Metrics:368 - Removed sensor with name bytes-sent:broker-id-1 2017-06-30 23:01:27 DEBUG Metrics:368 - Removed sensor with name bytes-received:broker-id-1 2017-06-30 23:01:27 DEBUG Metrics:368 - Removed sensor with name select-time:broker-id-1 2017-06-30 23:01:27 DEBUG Metrics:368 - Removed sensor with name io-time:broker-id-1 2017-06-30 23:01:27 INFO KafkaController:70 - [Controller 1]: Broker 1 resigned as the controller 2017-06-30 23:01:27 DEBUG ZkClient:1269 - Closing ZkClient... 2017-06-30 23:01:27 INFO ZkEventThread:83 - Terminate ZkClient event thread. 2017-06-30 23:01:27 DEBUG ZkConnection:84 - Closing ZooKeeper connected to 127.0.0.1:52131 2017-06-30 23:01:27 DEBUG ZooKeeper:1099 - Closing session: 0x10000f6eb680000 2017-06-30 23:01:27 DEBUG ClientCnxn:1471 - Closing client for session: 0x10000f6eb680000 2017-06-30 23:01:27 TRACE PrepRequestProcessor:90 - :Psessionid:0x10000f6eb680000 type:closeSession cxid:0x88 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:27 TRACE SessionTrackerImpl:208 - Session closing: 0x10000f6eb680000 2017-06-30 23:01:27 INFO PrepRequestProcessor:649 - Processed session termination for sessionid: 0x10000f6eb680000 2017-06-30 23:01:27 DEBUG FinalRequestProcessor:91 - Processing request:: sessionid:0x10000f6eb680000 type:closeSession cxid:0x88 zxid:0x34 txntype:-11 reqpath:n/a 2017-06-30 23:01:27 TRACE FinalRequestProcessor:90 - :Esessionid:0x10000f6eb680000 type:closeSession cxid:0x88 zxid:0x34 txntype:-11 reqpath:n/a 2017-06-30 23:01:27 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:27 DEBUG DataTree:1034 - Deleting ephemeral node /controller for session 0x10000f6eb680000 2017-06-30 23:01:27 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:27 DEBUG DataTree:1034 - Deleting ephemeral node /brokers/ids/1 for session 0x10000f6eb680000 2017-06-30 23:01:27 DEBUG SessionTrackerImpl:218 - Removing session 0x10000f6eb680000 2017-06-30 23:01:27 DEBUG ClientCnxn:867 - Got notification sessionid:0x10000f6eb680000 2017-06-30 23:01:27 TRACE SessionTrackerImpl:71 - SessionTrackerImpl --- Removing session 0x10000f6eb680000 2017-06-30 23:01:27 DEBUG ClientCnxn:889 - Got WatchedEvent state:SyncConnected type:NodeDeleted path:/controller for sessionid 0x10000f6eb680000 2017-06-30 23:01:27 DEBUG FinalRequestProcessor:178 - sessionid:0x10000f6eb680000 type:closeSession cxid:0x88 zxid:0x34 txntype:-11 reqpath:n/a 2017-06-30 23:01:27 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:27 DEBUG ClientCnxn:867 - Got notification sessionid:0x10000f6eb680000 2017-06-30 23:01:27 DEBUG ZkClient:615 - Received event: WatchedEvent state:SyncConnected type:NodeDeleted path:/controller 2017-06-30 23:01:27 DEBUG ClientCnxn:889 - Got WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/ids for sessionid 0x10000f6eb680000 2017-06-30 23:01:27 TRACE NIOServerCnxn:155 - Add a buffer to outgoingBuffers, sk sun.nio.ch.SelectionKeyImpl@4fa84d3e is valid: true 2017-06-30 23:01:27 DEBUG ClientCnxn:944 - Reading reply sessionid:0x10000f6eb680000, packet:: clientPath:null serverPath:null finished:false header:: 136,-11 replyHeader:: 136,52,0 request:: null response:: null 2017-06-30 23:01:27 DEBUG ClientCnxn:1455 - Disconnecting client for session: 0x10000f6eb680000 2017-06-30 23:01:27 INFO NIOServerCnxn:606 - Closed socket connection for client /127.0.0.1:52137 which had sessionid 0x10000f6eb680000 2017-06-30 23:01:27 INFO ZooKeeper:1110 - Session: 0x10000f6eb680000 closed 2017-06-30 23:01:27 DEBUG ZkClient:1282 - Closing ZkClient...done 2017-06-30 23:01:27 DEBUG ZkClient:628 - ignoring event '{NodeDeleted | /controller}' since shutdown triggered 2017-06-30 23:01:27 DEBUG ZkClient:659 - Leaving process event 2017-06-30 23:01:27 DEBUG ZkClient:615 - Received event: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/brokers/ids 2017-06-30 23:01:27 DEBUG ZkClient:628 - ignoring event '{NodeChildrenChanged | /brokers/ids}' since shutdown triggered 2017-06-30 23:01:27 DEBUG ZkClient:659 - Leaving process event 2017-06-30 23:01:27 INFO ClientCnxn:542 - EventThread shut down for session: 0x10000f6eb680000 2017-06-30 23:01:27 INFO KafkaServer:70 - [Kafka Server 1], shut down completed 2017-06-30 23:01:27 INFO EphemeralKafkaBroker:162 - Shutting down Zookeeper 2017-06-30 23:01:27 INFO NIOServerCnxnFactory:583 - ConnnectionExpirerThread interrupted 2017-06-30 23:01:27 INFO NIOServerCnxnFactory:420 - selector thread exitted run method 2017-06-30 23:01:27 INFO NIOServerCnxnFactory:420 - selector thread exitted run method 2017-06-30 23:01:27 INFO NIOServerCnxnFactory:219 - accept thread exitted run method 2017-06-30 23:01:27 INFO ZooKeeperServer:498 - shutting down 2017-06-30 23:01:27 INFO SessionTrackerImpl:232 - Shutting down 2017-06-30 23:01:27 TRACE SessionTrackerImpl:71 - Shutdown SessionTrackerImpl! 2017-06-30 23:01:27 INFO PrepRequestProcessor:967 - Shutting down 2017-06-30 23:01:27 INFO SyncRequestProcessor:191 - Shutting down 2017-06-30 23:01:27 TRACE PrepRequestProcessor:90 - :Psessionid:0x0 type:notification cxid:0x0 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a 2017-06-30 23:01:27 INFO PrepRequestProcessor:154 - PrepRequestProcessor exited loop! 2017-06-30 23:01:27 INFO SyncRequestProcessor:169 - SyncRequestProcessor exited! 2017-06-30 23:01:27 INFO FinalRequestProcessor:492 - shutdown of request processor complete 2017-06-30 23:01:27 DEBUG ZooKeeperServer:495 - ZooKeeper server is not running, so not proceeding to shutdown! 2017-06-30 23:01:27 DEBUG ZooKeeperServer:495 - ZooKeeper server is not running, so not proceeding to shutdown! 2017-06-30 23:01:27 INFO EphemeralKafkaBroker:167 - Deleting the log dir: /var/folders/xp/flh7dpc1597f6rqkg0gbgjkdpstf0x/T/kafka_junit5948362805256522832