[2018-02-15 07:36:20,742] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Returning fetched records at offset 39115 for assigned partition test_topic-0 and update position to 39118 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,742] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Added READ_UNCOMMITTED fetch request for partition test_topic-0 at offset 39118 to node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,742] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Built incremental fetch (sessionId=864348683, epoch=2608) for node 2. Added (), altered (test_topic-0), removed () out of (test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,742] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(test_topic-0), toForget=(), implied=()) to broker worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,742] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending FETCH {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=864348683,epoch=2608,topics=[{topic=test_topic,partitions=[{partition=0,fetch_offset=39118,log_start_offset=-1,max_bytes=1048576}]}],forgetten_topics_data=[]} with correlation id 39320 to node 2 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,742] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OffsetCommit request with {test_topic-0=OffsetAndMetadata{offset=39118, metadata=''}} to coordinator worker6:9092 (id: 2147483645 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,742] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OFFSET_COMMIT {group_id=test_group_id,generation_id=1,member_id=consumer-1-6703d8d9-9b72-44aa-b967-1be3ebc17eec,retention_time=-1,topics=[{topic=test_topic,partitions=[{partition=0,offset=39118,metadata=}]}]} with correlation id 39321 to node 2147483645 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,747] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2 for FETCH with correlation id 39320, received {throttle_time_ms=0,error_code=0,session_id=864348683,responses=[{topic=test_topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=39122,last_stable_offset=-1,log_start_offset=0,aborted_transactions=null},record_set=[(record=DefaultRecord(offset=39118, timestamp=1518680180697, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39119, timestamp=1518680180699, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39120, timestamp=1518680180699, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39121, timestamp=1518680180701, key=0 bytes, value=5 bytes))]}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,747] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Node 2 sent an incremental fetch response for session 864348683 with response=(test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,747] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Fetch READ_UNCOMMITTED at offset 39118 for partition test_topic-0 returned fetch data (error=NONE, highWaterMark=39122, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=109) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,749] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2147483645 for OFFSET_COMMIT with correlation id 39321, received {throttle_time_ms=0,responses=[{topic=test_topic,partition_responses=[{partition=0,error_code=0}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,749] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Committed offset 39118 for partition test_topic-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,749] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Preparing to read 109 bytes of data for partition test_topic-0 with offset 39118 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,749] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Updating high watermark for partition test_topic-0 to 39122 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,749] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Returning fetched records at offset 39118 for assigned partition test_topic-0 and update position to 39122 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,749] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Added READ_UNCOMMITTED fetch request for partition test_topic-0 at offset 39122 to node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,749] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Built incremental fetch (sessionId=864348683, epoch=2609) for node 2. Added (), altered (test_topic-0), removed () out of (test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,749] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(test_topic-0), toForget=(), implied=()) to broker worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,749] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending FETCH {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=864348683,epoch=2609,topics=[{topic=test_topic,partitions=[{partition=0,fetch_offset=39122,log_start_offset=-1,max_bytes=1048576}]}],forgetten_topics_data=[]} with correlation id 39322 to node 2 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,749] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OffsetCommit request with {test_topic-0=OffsetAndMetadata{offset=39122, metadata=''}} to coordinator worker6:9092 (id: 2147483645 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,749] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OFFSET_COMMIT {group_id=test_group_id,generation_id=1,member_id=consumer-1-6703d8d9-9b72-44aa-b967-1be3ebc17eec,retention_time=-1,topics=[{topic=test_topic,partitions=[{partition=0,offset=39122,metadata=}]}]} with correlation id 39323 to node 2147483645 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,752] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2 for FETCH with correlation id 39322, received {throttle_time_ms=0,error_code=0,session_id=864348683,responses=[{topic=test_topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=39125,last_stable_offset=-1,log_start_offset=0,aborted_transactions=null},record_set=[(record=DefaultRecord(offset=39122, timestamp=1518680180703, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39123, timestamp=1518680180705, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39124, timestamp=1518680180707, key=0 bytes, value=5 bytes))]}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,752] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Node 2 sent an incremental fetch response for session 864348683 with response=(test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,752] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Fetch READ_UNCOMMITTED at offset 39122 for partition test_topic-0 returned fetch data (error=NONE, highWaterMark=39125, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=97) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2147483645 for OFFSET_COMMIT with correlation id 39323, received {throttle_time_ms=0,responses=[{topic=test_topic,partition_responses=[{partition=0,error_code=0}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,754] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Committed offset 39122 for partition test_topic-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Preparing to read 97 bytes of data for partition test_topic-0 with offset 39122 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Updating high watermark for partition test_topic-0 to 39125 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Returning fetched records at offset 39122 for assigned partition test_topic-0 and update position to 39125 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,754] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Added READ_UNCOMMITTED fetch request for partition test_topic-0 at offset 39125 to node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,754] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Built incremental fetch (sessionId=864348683, epoch=2610) for node 2. Added (), altered (test_topic-0), removed () out of (test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,754] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(test_topic-0), toForget=(), implied=()) to broker worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending FETCH {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=864348683,epoch=2610,topics=[{topic=test_topic,partitions=[{partition=0,fetch_offset=39125,log_start_offset=-1,max_bytes=1048576}]}],forgetten_topics_data=[]} with correlation id 39324 to node 2 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OffsetCommit request with {test_topic-0=OffsetAndMetadata{offset=39125, metadata=''}} to coordinator worker6:9092 (id: 2147483645 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OFFSET_COMMIT {group_id=test_group_id,generation_id=1,member_id=consumer-1-6703d8d9-9b72-44aa-b967-1be3ebc17eec,retention_time=-1,topics=[{topic=test_topic,partitions=[{partition=0,offset=39125,metadata=}]}]} with correlation id 39325 to node 2147483645 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,757] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2 for FETCH with correlation id 39324, received {throttle_time_ms=0,error_code=0,session_id=864348683,responses=[{topic=test_topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=39128,last_stable_offset=-1,log_start_offset=0,aborted_transactions=null},record_set=[(record=DefaultRecord(offset=39125, timestamp=1518680180709, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39126, timestamp=1518680180712, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39127, timestamp=1518680180714, key=0 bytes, value=5 bytes))]}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,757] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Node 2 sent an incremental fetch response for session 864348683 with response=(test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,757] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Fetch READ_UNCOMMITTED at offset 39125 for partition test_topic-0 returned fetch data (error=NONE, highWaterMark=39128, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=97) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,759] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2147483645 for OFFSET_COMMIT with correlation id 39325, received {throttle_time_ms=0,responses=[{topic=test_topic,partition_responses=[{partition=0,error_code=0}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,759] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Committed offset 39125 for partition test_topic-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,759] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Preparing to read 97 bytes of data for partition test_topic-0 with offset 39125 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,759] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Updating high watermark for partition test_topic-0 to 39128 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,759] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Returning fetched records at offset 39125 for assigned partition test_topic-0 and update position to 39128 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,759] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Added READ_UNCOMMITTED fetch request for partition test_topic-0 at offset 39128 to node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,759] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Built incremental fetch (sessionId=864348683, epoch=2611) for node 2. Added (), altered (test_topic-0), removed () out of (test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,759] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(test_topic-0), toForget=(), implied=()) to broker worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,759] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending FETCH {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=864348683,epoch=2611,topics=[{topic=test_topic,partitions=[{partition=0,fetch_offset=39128,log_start_offset=-1,max_bytes=1048576}]}],forgetten_topics_data=[]} with correlation id 39326 to node 2 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,759] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OffsetCommit request with {test_topic-0=OffsetAndMetadata{offset=39128, metadata=''}} to coordinator worker6:9092 (id: 2147483645 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,759] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OFFSET_COMMIT {group_id=test_group_id,generation_id=1,member_id=consumer-1-6703d8d9-9b72-44aa-b967-1be3ebc17eec,retention_time=-1,topics=[{topic=test_topic,partitions=[{partition=0,offset=39128,metadata=}]}]} with correlation id 39327 to node 2147483645 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,762] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2 for FETCH with correlation id 39326, received {throttle_time_ms=0,error_code=0,session_id=864348683,responses=[{topic=test_topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=39131,last_stable_offset=-1,log_start_offset=0,aborted_transactions=null},record_set=[(record=DefaultRecord(offset=39128, timestamp=1518680180716, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39129, timestamp=1518680180718, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39130, timestamp=1518680180720, key=0 bytes, value=5 bytes))]}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,762] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Node 2 sent an incremental fetch response for session 864348683 with response=(test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,762] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Fetch READ_UNCOMMITTED at offset 39128 for partition test_topic-0 returned fetch data (error=NONE, highWaterMark=39131, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=97) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,764] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2147483645 for OFFSET_COMMIT with correlation id 39327, received {throttle_time_ms=0,responses=[{topic=test_topic,partition_responses=[{partition=0,error_code=0}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,764] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Committed offset 39128 for partition test_topic-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,764] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Preparing to read 97 bytes of data for partition test_topic-0 with offset 39128 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,764] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Updating high watermark for partition test_topic-0 to 39131 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,764] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Returning fetched records at offset 39128 for assigned partition test_topic-0 and update position to 39131 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,764] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Added READ_UNCOMMITTED fetch request for partition test_topic-0 at offset 39131 to node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,764] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Built incremental fetch (sessionId=864348683, epoch=2612) for node 2. Added (), altered (test_topic-0), removed () out of (test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,764] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(test_topic-0), toForget=(), implied=()) to broker worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,764] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending FETCH {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=864348683,epoch=2612,topics=[{topic=test_topic,partitions=[{partition=0,fetch_offset=39131,log_start_offset=-1,max_bytes=1048576}]}],forgetten_topics_data=[]} with correlation id 39328 to node 2 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,764] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OffsetCommit request with {test_topic-0=OffsetAndMetadata{offset=39131, metadata=''}} to coordinator worker6:9092 (id: 2147483645 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,764] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OFFSET_COMMIT {group_id=test_group_id,generation_id=1,member_id=consumer-1-6703d8d9-9b72-44aa-b967-1be3ebc17eec,retention_time=-1,topics=[{topic=test_topic,partitions=[{partition=0,offset=39131,metadata=}]}]} with correlation id 39329 to node 2147483645 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,767] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2147483645 for OFFSET_COMMIT with correlation id 39329, received {throttle_time_ms=0,responses=[{topic=test_topic,partition_responses=[{partition=0,error_code=0}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,767] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Committed offset 39131 for partition test_topic-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,767] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Skipping fetch for partition test_topic-0 because there is an in-flight request to worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,789] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Skipping fetch for partition test_topic-0 because there is an in-flight request to worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,789] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Skipping fetch for partition test_topic-0 because there is an in-flight request to worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,789] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2 for FETCH with correlation id 39328, received {throttle_time_ms=0,error_code=0,session_id=864348683,responses=[{topic=test_topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=39151,last_stable_offset=-1,log_start_offset=0,aborted_transactions=null},record_set=[(record=DefaultRecord(offset=39131, timestamp=1518680180722, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39132, timestamp=1518680180724, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39133, timestamp=1518680180726, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39134, timestamp=1518680180729, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39135, timestamp=1518680180729, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39136, timestamp=1518680180731, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39137, timestamp=1518680180733, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39138, timestamp=1518680180735, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39139, timestamp=1518680180737, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39140, timestamp=1518680180739, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39141, timestamp=1518680180741, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39142, timestamp=1518680180743, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39143, timestamp=1518680180746, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39144, timestamp=1518680180748, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39145, timestamp=1518680180750, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39146, timestamp=1518680180752, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39147, timestamp=1518680180754, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39148, timestamp=1518680180756, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39149, timestamp=1518680180758, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39150, timestamp=1518680180760, key=0 bytes, value=5 bytes))]}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,789] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Node 2 sent an incremental fetch response for session 864348683 with response=(test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,789] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Fetch READ_UNCOMMITTED at offset 39131 for partition test_topic-0 returned fetch data (error=NONE, highWaterMark=39151, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=301) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,789] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Preparing to read 301 bytes of data for partition test_topic-0 with offset 39131 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,789] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Updating high watermark for partition test_topic-0 to 39151 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,789] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Returning fetched records at offset 39131 for assigned partition test_topic-0 and update position to 39151 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,789] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Added READ_UNCOMMITTED fetch request for partition test_topic-0 at offset 39151 to node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,789] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Built incremental fetch (sessionId=864348683, epoch=2613) for node 2. Added (), altered (test_topic-0), removed () out of (test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,789] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(test_topic-0), toForget=(), implied=()) to broker worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,789] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending FETCH {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=864348683,epoch=2613,topics=[{topic=test_topic,partitions=[{partition=0,fetch_offset=39151,log_start_offset=-1,max_bytes=1048576}]}],forgetten_topics_data=[]} with correlation id 39330 to node 2 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,789] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OffsetCommit request with {test_topic-0=OffsetAndMetadata{offset=39151, metadata=''}} to coordinator worker6:9092 (id: 2147483645 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,789] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OFFSET_COMMIT {group_id=test_group_id,generation_id=1,member_id=consumer-1-6703d8d9-9b72-44aa-b967-1be3ebc17eec,retention_time=-1,topics=[{topic=test_topic,partitions=[{partition=0,offset=39151,metadata=}]}]} with correlation id 39331 to node 2147483645 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,793] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2 for FETCH with correlation id 39330, received {throttle_time_ms=0,error_code=0,session_id=864348683,responses=[{topic=test_topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=39157,last_stable_offset=-1,log_start_offset=0,aborted_transactions=null},record_set=[(record=DefaultRecord(offset=39151, timestamp=1518680180763, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39152, timestamp=1518680180763, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39153, timestamp=1518680180765, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39154, timestamp=1518680180767, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39155, timestamp=1518680180769, key=0 bytes, value=5 bytes)), (record=DefaultRecord(offset=39156, timestamp=1518680180771, key=0 bytes, value=5 bytes))]}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,793] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Node 2 sent an incremental fetch response for session 864348683 with response=(test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,793] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Fetch READ_UNCOMMITTED at offset 39151 for partition test_topic-0 returned fetch data (error=NONE, highWaterMark=39157, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=133) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,795] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2147483645 for OFFSET_COMMIT with correlation id 39331, received {throttle_time_ms=0,responses=[{topic=test_topic,partition_responses=[{partition=0,error_code=0}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,795] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Committed offset 39151 for partition test_topic-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,795] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Preparing to read 133 bytes of data for partition test_topic-0 with offset 39151 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,795] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Updating high watermark for partition test_topic-0 to 39157 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,795] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Returning fetched records at offset 39151 for assigned partition test_topic-0 and update position to 39157 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,795] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Added READ_UNCOMMITTED fetch request for partition test_topic-0 at offset 39157 to node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,795] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Built incremental fetch (sessionId=864348683, epoch=2614) for node 2. Added (), altered (test_topic-0), removed () out of (test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,795] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(test_topic-0), toForget=(), implied=()) to broker worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,795] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending FETCH {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=864348683,epoch=2614,topics=[{topic=test_topic,partitions=[{partition=0,fetch_offset=39157,log_start_offset=-1,max_bytes=1048576}]}],forgetten_topics_data=[]} with correlation id 39332 to node 2 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,795] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OffsetCommit request with {test_topic-0=OffsetAndMetadata{offset=39157, metadata=''}} to coordinator worker6:9092 (id: 2147483645 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,795] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OFFSET_COMMIT {group_id=test_group_id,generation_id=1,member_id=consumer-1-6703d8d9-9b72-44aa-b967-1be3ebc17eec,retention_time=-1,topics=[{topic=test_topic,partitions=[{partition=0,offset=39157,metadata=}]}]} with correlation id 39333 to node 2147483645 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,797] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2 for FETCH with correlation id 39332, received {throttle_time_ms=0,error_code=0,session_id=864348683,responses=[{topic=test_topic,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=39158,last_stable_offset=-1,log_start_offset=0,aborted_transactions=null},record_set=[(record=DefaultRecord(offset=39157, timestamp=1518680180773, key=0 bytes, value=5 bytes))]}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,797] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Node 2 sent an incremental fetch response for session 864348683 with response=(test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,797] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Fetch READ_UNCOMMITTED at offset 39157 for partition test_topic-0 returned fetch data (error=NONE, highWaterMark=39158, lastStableOffset = -1, logStartOffset = 0, abortedTransactions = null, recordsSizeInBytes=73) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,799] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2147483645 for OFFSET_COMMIT with correlation id 39333, received {throttle_time_ms=0,responses=[{topic=test_topic,partition_responses=[{partition=0,error_code=0}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,799] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Committed offset 39157 for partition test_topic-0 (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,799] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Preparing to read 73 bytes of data for partition test_topic-0 with offset 39157 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,799] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Updating high watermark for partition test_topic-0 to 39158 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,799] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Returning fetched records at offset 39157 for assigned partition test_topic-0 and update position to 39158 (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,799] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Added READ_UNCOMMITTED fetch request for partition test_topic-0 at offset 39158 to node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,799] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Built incremental fetch (sessionId=864348683, epoch=2615) for node 2. Added (), altered (test_topic-0), removed () out of (test_topic-0) (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,799] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending READ_UNCOMMITTED IncrementalFetchRequest(toSend=(test_topic-0), toForget=(), implied=()) to broker worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.consumer.internals.Fetcher) [2018-02-15 07:36:20,799] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending FETCH {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=864348683,epoch=2615,topics=[{topic=test_topic,partitions=[{partition=0,fetch_offset=39158,log_start_offset=-1,max_bytes=1048576}]}],forgetten_topics_data=[]} with correlation id 39334 to node 2 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,800] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OffsetCommit request with {test_topic-0=OffsetAndMetadata{offset=39158, metadata=''}} to coordinator worker6:9092 (id: 2147483645 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:20,800] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OFFSET_COMMIT {group_id=test_group_id,generation_id=1,member_id=consumer-1-6703d8d9-9b72-44aa-b967-1be3ebc17eec,retention_time=-1,topics=[{topic=test_topic,partitions=[{partition=0,offset=39158,metadata=}]}]} with correlation id 39335 to node 2147483645 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,881] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Connection with worker6/172.31.9.121 disconnected (org.apache.kafka.common.network.Selector) java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:124) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:93) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:235) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:196) at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:557) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:495) at org.apache.kafka.common.network.Selector.poll(Selector.java:424) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:460) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:241) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:217) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:193) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:597) at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1257) at org.apache.kafka.tools.VerifiableConsumer.commitSync(VerifiableConsumer.java:206) at org.apache.kafka.tools.VerifiableConsumer.run(VerifiableConsumer.java:230) at org.apache.kafka.tools.VerifiableConsumer.main(VerifiableConsumer.java:629) [2018-02-15 07:36:20,882] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Node 2 disconnected. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,882] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Cancelled request FETCH {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=864348683,epoch=2615,topics=[{topic=test_topic,partitions=[{partition=0,fetch_offset=39158,log_start_offset=-1,max_bytes=1048576}]}],forgetten_topics_data=[]} with correlation id 39334 due to node 2 being disconnected (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,882] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Cancelled FETCH request RequestHeader(apiKey=FETCH, apiVersion=7, clientId=consumer-1, correlationId=39334) with correlation id 39334 due to node 2 being disconnected (org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient) [2018-02-15 07:36:20,882] INFO [Consumer clientId=consumer-1, groupId=test_group_id] Error sending fetch request (sessionId=864348683, epoch=2615) to node 2: org.apache.kafka.common.errors.DisconnectException. (org.apache.kafka.clients.FetchSessionHandler) [2018-02-15 07:36:20,882] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker6:9092 (id: 2 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,882] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,882] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Initialize connection to node worker5:9092 (id: 1 rack: null) for sending metadata request (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,882] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Initiating connection to node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,882] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Connection with worker6/172.31.9.121 disconnected (org.apache.kafka.common.network.Selector) java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:124) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:93) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:235) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:196) at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:557) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:495) at org.apache.kafka.common.network.Selector.poll(Selector.java:424) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:460) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:241) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.pollNoWakeup(ConsumerNetworkClient.java:278) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator$HeartbeatThread.run(AbstractCoordinator.java:940) [2018-02-15 07:36:20,883] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Node 2147483645 disconnected. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,883] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Cancelled request OFFSET_COMMIT {group_id=test_group_id,generation_id=1,member_id=consumer-1-6703d8d9-9b72-44aa-b967-1be3ebc17eec,retention_time=-1,topics=[{topic=test_topic,partitions=[{partition=0,offset=39158,metadata=}]}]} with correlation id 39335 due to node 2147483645 being disconnected (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,883] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Cancelled OFFSET_COMMIT request RequestHeader(apiKey=OFFSET_COMMIT, apiVersion=3, clientId=consumer-1, correlationId=39335) with correlation id 39335 due to node 2147483645 being disconnected (org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient) [2018-02-15 07:36:20,883] INFO [Consumer clientId=consumer-1, groupId=test_group_id] Marking the coordinator worker6:9092 (id: 2147483645 rack: null) dead (org.apache.kafka.clients.consumer.internals.AbstractCoordinator) [2018-02-15 07:36:20,883] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker6:9092 (id: 2 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,883] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,883] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 1 (org.apache.kafka.common.network.Selector) [2018-02-15 07:36:20,883] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Completed connection to node 1. Fetching API versions. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,883] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Initiating API versions fetch from node 1. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,883] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] No version information found when sending API_VERSIONS with correlation id 39336 to node 1. Assuming version 1. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,883] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending API_VERSIONS {} with correlation id 39336 to node 1 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,883] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker6:9092 (id: 2 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,883] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,883] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker6:9092 (id: 2 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,883] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,885] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 1 for API_VERSIONS with correlation id 39336, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=5},{api_key=1,min_version=0,max_version=7},{api_key=2,min_version=0,max_version=2},{api_key=3,min_version=0,max_version=5},{api_key=4,min_version=0,max_version=1},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=4},{api_key=7,min_version=0,max_version=1},{api_key=8,min_version=0,max_version=3},{api_key=9,min_version=0,max_version=3},{api_key=10,min_version=0,max_version=1},{api_key=11,min_version=0,max_version=2},{api_key=12,min_version=0,max_version=1},{api_key=13,min_version=0,max_version=1},{api_key=14,min_version=0,max_version=1},{api_key=15,min_version=0,max_version=1},{api_key=17,min_version=0,max_version=1},{api_key=16,min_version=0,max_version=1},{api_key=19,min_version=0,max_version=2},{api_key=18,min_version=0,max_version=1},{api_key=21,min_version=0,max_version=0},{api_key=20,min_version=0,max_version=1},{api_key=23,min_version=0,max_version=0},{api_key=22,min_version=0,max_version=0},{api_key=25,min_version=0,max_version=0},{api_key=24,min_version=0,max_version=0},{api_key=27,min_version=0,max_version=0},{api_key=26,min_version=0,max_version=0},{api_key=29,min_version=0,max_version=0},{api_key=28,min_version=0,max_version=0},{api_key=31,min_version=0,max_version=0},{api_key=30,min_version=0,max_version=0},{api_key=34,min_version=0,max_version=0},{api_key=35,min_version=0,max_version=0},{api_key=32,min_version=0,max_version=1},{api_key=33,min_version=0,max_version=0},{api_key=38,min_version=0,max_version=0},{api_key=39,min_version=0,max_version=0},{api_key=36,min_version=0,max_version=0},{api_key=37,min_version=0,max_version=0},{api_key=42,min_version=0,max_version=0},{api_key=40,min_version=0,max_version=0},{api_key=41,min_version=0,max_version=0}],throttle_time_ms=0} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,885] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Recorded API versions for node 1: (Produce(0): 0 to 5 [usable: 5], Fetch(1): 0 to 7 [usable: 7], ListOffsets(2): 0 to 2 [usable: 2], Metadata(3): 0 to 5 [usable: 5], LeaderAndIsr(4): 0 to 1 [usable: 1], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 4 [usable: 4], ControlledShutdown(7): 0 to 1 [usable: 1], OffsetCommit(8): 0 to 3 [usable: 3], OffsetFetch(9): 0 to 3 [usable: 3], FindCoordinator(10): 0 to 1 [usable: 1], JoinGroup(11): 0 to 2 [usable: 2], Heartbeat(12): 0 to 1 [usable: 1], LeaveGroup(13): 0 to 1 [usable: 1], SyncGroup(14): 0 to 1 [usable: 1], DescribeGroups(15): 0 to 1 [usable: 1], ListGroups(16): 0 to 1 [usable: 1], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 1 [usable: 1], CreateTopics(19): 0 to 2 [usable: 2], DeleteTopics(20): 0 to 1 [usable: 1], DeleteRecords(21): 0 [usable: 0], InitProducerId(22): 0 [usable: 0], OffsetForLeaderEpoch(23): 0 [usable: 0], AddPartitionsToTxn(24): 0 [usable: 0], AddOffsetsToTxn(25): 0 [usable: 0], EndTxn(26): 0 [usable: 0], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 [usable: 0], DescribeAcls(29): 0 [usable: 0], CreateAcls(30): 0 [usable: 0], DeleteAcls(31): 0 [usable: 0], DescribeConfigs(32): 0 to 1 [usable: 1], AlterConfigs(33): 0 [usable: 0], AlterReplicaLogDirs(34): 0 [usable: 0], DescribeLogDirs(35): 0 [usable: 0], SaslAuthenticate(36): 0 [usable: 0], CreatePartitions(37): 0 [usable: 0], CreateDelegationToken(38): 0 [usable: 0], RenewDelegationToken(39): 0 [usable: 0], ExpireDelegationToken(40): 0 [usable: 0], DescribeDelegationToken(41): 0 [usable: 0], DeleteGroups(42): 0 [usable: 0]) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,885] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker6:9092 (id: 2 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,885] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,885] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending metadata request (type=MetadataRequest, topics=test_topic) to node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,885] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending METADATA {topics=[test_topic],allow_auto_topic_creation=true} with correlation id 39337 to node 1 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,901] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 1 for METADATA with correlation id 39337, received {throttle_time_ms=0,brokers=[{node_id=2,host=worker6,port=9092,rack=null},{node_id=1,host=worker5,port=9092,rack=null}],cluster_id=CTkloGopRuCUxoicTrG1WA,controller_id=2,topic_metadata=[{error_code=0,topic=test_topic,is_internal=false,partition_metadata=[{error_code=0,partition=0,leader=1,replicas=[2,1],isr=[1],offline_replicas=[2]}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:20,902] DEBUG Updated cluster metadata version 18 to Cluster(id = CTkloGopRuCUxoicTrG1WA, nodes = [worker6:9092 (id: 2 rack: null), worker5:9092 (id: 1 rack: null)], partitions = [Partition(topic = test_topic, partition = 0, leader = 1, replicas = [2,1], isr = [1], offlineReplicas = [2])]) (org.apache.kafka.clients.Metadata) [2018-02-15 07:36:33,881] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Connection with worker5/172.31.44.80 disconnected (org.apache.kafka.common.network.Selector) java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:124) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:93) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:235) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:196) at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:557) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:495) at org.apache.kafka.common.network.Selector.poll(Selector.java:424) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:460) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:241) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:217) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:193) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:597) at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1257) at org.apache.kafka.tools.VerifiableConsumer.commitSync(VerifiableConsumer.java:206) at org.apache.kafka.tools.VerifiableConsumer.run(VerifiableConsumer.java:230) at org.apache.kafka.tools.VerifiableConsumer.main(VerifiableConsumer.java:629) [2018-02-15 07:36:33,881] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Node 1 disconnected. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,881] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker5:9092 (id: 1 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,882] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,882] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Initialize connection to node worker6:9092 (id: 2 rack: null) for sending metadata request (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,882] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Initiating connection to node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,882] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2 (org.apache.kafka.common.network.Selector) [2018-02-15 07:36:33,882] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Completed connection to node 2. Fetching API versions. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,882] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Initiating API versions fetch from node 2. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,882] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] No version information found when sending API_VERSIONS with correlation id 39338 to node 2. Assuming version 1. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,882] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending API_VERSIONS {} with correlation id 39338 to node 2 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,882] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker5:9092 (id: 1 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,882] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,882] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker5:9092 (id: 1 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,882] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,895] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2 for API_VERSIONS with correlation id 39338, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=5},{api_key=1,min_version=0,max_version=7},{api_key=2,min_version=0,max_version=2},{api_key=3,min_version=0,max_version=5},{api_key=4,min_version=0,max_version=1},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=4},{api_key=7,min_version=0,max_version=1},{api_key=8,min_version=0,max_version=3},{api_key=9,min_version=0,max_version=3},{api_key=10,min_version=0,max_version=1},{api_key=11,min_version=0,max_version=2},{api_key=12,min_version=0,max_version=1},{api_key=13,min_version=0,max_version=1},{api_key=14,min_version=0,max_version=1},{api_key=15,min_version=0,max_version=1},{api_key=17,min_version=0,max_version=1},{api_key=16,min_version=0,max_version=1},{api_key=19,min_version=0,max_version=2},{api_key=18,min_version=0,max_version=1},{api_key=21,min_version=0,max_version=0},{api_key=20,min_version=0,max_version=1},{api_key=23,min_version=0,max_version=0},{api_key=22,min_version=0,max_version=0},{api_key=25,min_version=0,max_version=0},{api_key=24,min_version=0,max_version=0},{api_key=27,min_version=0,max_version=0},{api_key=26,min_version=0,max_version=0},{api_key=29,min_version=0,max_version=0},{api_key=28,min_version=0,max_version=0},{api_key=31,min_version=0,max_version=0},{api_key=30,min_version=0,max_version=0},{api_key=34,min_version=0,max_version=0},{api_key=35,min_version=0,max_version=0},{api_key=32,min_version=0,max_version=1},{api_key=33,min_version=0,max_version=0},{api_key=38,min_version=0,max_version=0},{api_key=39,min_version=0,max_version=0},{api_key=36,min_version=0,max_version=0},{api_key=37,min_version=0,max_version=0},{api_key=42,min_version=0,max_version=0},{api_key=40,min_version=0,max_version=0},{api_key=41,min_version=0,max_version=0}],throttle_time_ms=0} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,896] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Recorded API versions for node 2: (Produce(0): 0 to 5 [usable: 5], Fetch(1): 0 to 7 [usable: 7], ListOffsets(2): 0 to 2 [usable: 2], Metadata(3): 0 to 5 [usable: 5], LeaderAndIsr(4): 0 to 1 [usable: 1], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 4 [usable: 4], ControlledShutdown(7): 0 to 1 [usable: 1], OffsetCommit(8): 0 to 3 [usable: 3], OffsetFetch(9): 0 to 3 [usable: 3], FindCoordinator(10): 0 to 1 [usable: 1], JoinGroup(11): 0 to 2 [usable: 2], Heartbeat(12): 0 to 1 [usable: 1], LeaveGroup(13): 0 to 1 [usable: 1], SyncGroup(14): 0 to 1 [usable: 1], DescribeGroups(15): 0 to 1 [usable: 1], ListGroups(16): 0 to 1 [usable: 1], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 1 [usable: 1], CreateTopics(19): 0 to 2 [usable: 2], DeleteTopics(20): 0 to 1 [usable: 1], DeleteRecords(21): 0 [usable: 0], InitProducerId(22): 0 [usable: 0], OffsetForLeaderEpoch(23): 0 [usable: 0], AddPartitionsToTxn(24): 0 [usable: 0], AddOffsetsToTxn(25): 0 [usable: 0], EndTxn(26): 0 [usable: 0], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 [usable: 0], DescribeAcls(29): 0 [usable: 0], CreateAcls(30): 0 [usable: 0], DeleteAcls(31): 0 [usable: 0], DescribeConfigs(32): 0 to 1 [usable: 1], AlterConfigs(33): 0 [usable: 0], AlterReplicaLogDirs(34): 0 [usable: 0], DescribeLogDirs(35): 0 [usable: 0], SaslAuthenticate(36): 0 [usable: 0], CreatePartitions(37): 0 [usable: 0], CreateDelegationToken(38): 0 [usable: 0], RenewDelegationToken(39): 0 [usable: 0], ExpireDelegationToken(40): 0 [usable: 0], DescribeDelegationToken(41): 0 [usable: 0], DeleteGroups(42): 0 [usable: 0]) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,896] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker5:9092 (id: 1 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,896] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,896] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending metadata request (type=MetadataRequest, topics=test_topic) to node worker6:9092 (id: 2 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,896] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending METADATA {topics=[test_topic],allow_auto_topic_creation=true} with correlation id 39339 to node 2 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,931] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2 for METADATA with correlation id 39339, received {throttle_time_ms=0,brokers=[{node_id=2,host=worker6,port=9092,rack=null},{node_id=1,host=worker5,port=9092,rack=null}],cluster_id=CTkloGopRuCUxoicTrG1WA,controller_id=1,topic_metadata=[{error_code=0,topic=test_topic,is_internal=false,partition_metadata=[{error_code=0,partition=0,leader=1,replicas=[2,1],isr=[1],offline_replicas=[]}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:33,931] DEBUG Updated cluster metadata version 19 to Cluster(id = CTkloGopRuCUxoicTrG1WA, nodes = [worker6:9092 (id: 2 rack: null), worker5:9092 (id: 1 rack: null)], partitions = [Partition(topic = test_topic, partition = 0, leader = 1, replicas = [2,1], isr = [1], offlineReplicas = [])]) (org.apache.kafka.clients.Metadata) [2018-02-15 07:36:44,753] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Connection with worker6/172.31.9.121 disconnected (org.apache.kafka.common.network.Selector) java.io.EOFException at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:124) at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:93) at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:235) at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:196) at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:557) at org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:495) at org.apache.kafka.common.network.Selector.poll(Selector.java:424) at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:460) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:241) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:217) at org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:193) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.commitOffsetsSync(ConsumerCoordinator.java:597) at org.apache.kafka.clients.consumer.KafkaConsumer.commitSync(KafkaConsumer.java:1257) at org.apache.kafka.tools.VerifiableConsumer.commitSync(VerifiableConsumer.java:206) at org.apache.kafka.tools.VerifiableConsumer.run(VerifiableConsumer.java:230) at org.apache.kafka.tools.VerifiableConsumer.main(VerifiableConsumer.java:629) [2018-02-15 07:36:44,753] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Node 2 disconnected. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,753] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker6:9092 (id: 2 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,753] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,753] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Initialize connection to node worker5:9092 (id: 1 rack: null) for sending metadata request (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,753] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Initiating connection to node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,754] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 1 (org.apache.kafka.common.network.Selector) [2018-02-15 07:36:44,754] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Completed connection to node 1. Fetching API versions. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,754] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Initiating API versions fetch from node 1. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] No version information found when sending API_VERSIONS with correlation id 39340 to node 1. Assuming version 1. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending API_VERSIONS {} with correlation id 39340 to node 1 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker6:9092 (id: 2 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker6:9092 (id: 2 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,754] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,763] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 1 for API_VERSIONS with correlation id 39340, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=5},{api_key=1,min_version=0,max_version=7},{api_key=2,min_version=0,max_version=2},{api_key=3,min_version=0,max_version=5},{api_key=4,min_version=0,max_version=1},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=4},{api_key=7,min_version=0,max_version=1},{api_key=8,min_version=0,max_version=3},{api_key=9,min_version=0,max_version=3},{api_key=10,min_version=0,max_version=1},{api_key=11,min_version=0,max_version=2},{api_key=12,min_version=0,max_version=1},{api_key=13,min_version=0,max_version=1},{api_key=14,min_version=0,max_version=1},{api_key=15,min_version=0,max_version=1},{api_key=17,min_version=0,max_version=1},{api_key=16,min_version=0,max_version=1},{api_key=19,min_version=0,max_version=2},{api_key=18,min_version=0,max_version=1},{api_key=21,min_version=0,max_version=0},{api_key=20,min_version=0,max_version=1},{api_key=23,min_version=0,max_version=0},{api_key=22,min_version=0,max_version=0},{api_key=25,min_version=0,max_version=0},{api_key=24,min_version=0,max_version=0},{api_key=27,min_version=0,max_version=0},{api_key=26,min_version=0,max_version=0},{api_key=29,min_version=0,max_version=0},{api_key=28,min_version=0,max_version=0},{api_key=31,min_version=0,max_version=0},{api_key=30,min_version=0,max_version=0},{api_key=34,min_version=0,max_version=0},{api_key=35,min_version=0,max_version=0},{api_key=32,min_version=0,max_version=1},{api_key=33,min_version=0,max_version=0},{api_key=38,min_version=0,max_version=0},{api_key=39,min_version=0,max_version=0},{api_key=36,min_version=0,max_version=0},{api_key=37,min_version=0,max_version=0},{api_key=42,min_version=0,max_version=0},{api_key=40,min_version=0,max_version=0},{api_key=41,min_version=0,max_version=0}],throttle_time_ms=0} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,763] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Recorded API versions for node 1: (Produce(0): 0 to 5 [usable: 5], Fetch(1): 0 to 7 [usable: 7], ListOffsets(2): 0 to 2 [usable: 2], Metadata(3): 0 to 5 [usable: 5], LeaderAndIsr(4): 0 to 1 [usable: 1], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 4 [usable: 4], ControlledShutdown(7): 0 to 1 [usable: 1], OffsetCommit(8): 0 to 3 [usable: 3], OffsetFetch(9): 0 to 3 [usable: 3], FindCoordinator(10): 0 to 1 [usable: 1], JoinGroup(11): 0 to 2 [usable: 2], Heartbeat(12): 0 to 1 [usable: 1], LeaveGroup(13): 0 to 1 [usable: 1], SyncGroup(14): 0 to 1 [usable: 1], DescribeGroups(15): 0 to 1 [usable: 1], ListGroups(16): 0 to 1 [usable: 1], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 1 [usable: 1], CreateTopics(19): 0 to 2 [usable: 2], DeleteTopics(20): 0 to 1 [usable: 1], DeleteRecords(21): 0 [usable: 0], InitProducerId(22): 0 [usable: 0], OffsetForLeaderEpoch(23): 0 [usable: 0], AddPartitionsToTxn(24): 0 [usable: 0], AddOffsetsToTxn(25): 0 [usable: 0], EndTxn(26): 0 [usable: 0], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 [usable: 0], DescribeAcls(29): 0 [usable: 0], CreateAcls(30): 0 [usable: 0], DeleteAcls(31): 0 [usable: 0], DescribeConfigs(32): 0 to 1 [usable: 1], AlterConfigs(33): 0 [usable: 0], AlterReplicaLogDirs(34): 0 [usable: 0], DescribeLogDirs(35): 0 [usable: 0], SaslAuthenticate(36): 0 [usable: 0], CreatePartitions(37): 0 [usable: 0], CreateDelegationToken(38): 0 [usable: 0], RenewDelegationToken(39): 0 [usable: 0], ExpireDelegationToken(40): 0 [usable: 0], DescribeDelegationToken(41): 0 [usable: 0], DeleteGroups(42): 0 [usable: 0]) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,763] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Removing node worker6:9092 (id: 2 rack: null) from least loaded node selection: is-blacked-out: true, in-flight-requests: 0 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,763] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,763] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending metadata request (type=MetadataRequest, topics=test_topic) to node worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,763] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending METADATA {topics=[test_topic],allow_auto_topic_creation=true} with correlation id 39341 to node 1 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,777] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 1 for METADATA with correlation id 39341, received {throttle_time_ms=0,brokers=[{node_id=2,host=worker6,port=9092,rack=null},{node_id=1,host=worker5,port=9092,rack=null}],cluster_id=CTkloGopRuCUxoicTrG1WA,controller_id=2,topic_metadata=[{error_code=0,topic=test_topic,is_internal=false,partition_metadata=[{error_code=0,partition=0,leader=2,replicas=[2,1],isr=[2],offline_replicas=[]}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:44,777] DEBUG Updated cluster metadata version 20 to Cluster(id = CTkloGopRuCUxoicTrG1WA, nodes = [worker6:9092 (id: 2 rack: null), worker5:9092 (id: 1 rack: null)], partitions = [Partition(topic = test_topic, partition = 0, leader = 2, replicas = [2,1], isr = [2], offlineReplicas = [])]) (org.apache.kafka.clients.Metadata) [2018-02-15 07:36:51,502] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Received user wakeup (org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient) [2018-02-15 07:36:51,502] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Raising WakeupException in response to user wakeup (org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient) [2018-02-15 07:36:51,502] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Found least loaded node worker5:9092 (id: 1 rack: null) connected with no in-flight requests (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,502] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Sending FindCoordinator request to broker worker5:9092 (id: 1 rack: null) (org.apache.kafka.clients.consumer.internals.AbstractCoordinator) [2018-02-15 07:36:51,502] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending FIND_COORDINATOR {coordinator_key=test_group_id,coordinator_type=0} with correlation id 39342 to node 1 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,504] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 1 for FIND_COORDINATOR with correlation id 39342, received {throttle_time_ms=0,error_code=0,error_message=null,coordinator={node_id=1,host=worker5,port=9092}} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,504] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Received FindCoordinator response ClientResponse(receivedTimeMs=1518680211504, latencyMs=2, disconnected=false, requestHeader=RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=1, clientId=consumer-1, correlationId=39342), responseBody=FindCoordinatorResponse(throttleTimeMs=0, errorMessage='null', error=NONE, node=worker5:9092 (id: 1 rack: null))) (org.apache.kafka.clients.consumer.internals.AbstractCoordinator) [2018-02-15 07:36:51,504] INFO [Consumer clientId=consumer-1, groupId=test_group_id] Discovered group coordinator worker5:9092 (id: 2147483646 rack: null) (org.apache.kafka.clients.consumer.internals.AbstractCoordinator) [2018-02-15 07:36:51,504] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Initiating connection to node worker5:9092 (id: 2147483646 rack: null) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,505] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OffsetCommit request with {test_topic-0=OffsetAndMetadata{offset=39158, metadata=''}} to coordinator worker5:9092 (id: 2147483646 rack: null) (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:51,505] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 2147483646 (org.apache.kafka.common.network.Selector) [2018-02-15 07:36:51,505] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Completed connection to node 2147483646. Fetching API versions. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,505] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Initiating API versions fetch from node 2147483646. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,505] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] No version information found when sending API_VERSIONS with correlation id 39344 to node 2147483646. Assuming version 1. (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,505] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending API_VERSIONS {} with correlation id 39344 to node 2147483646 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,507] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2147483646 for API_VERSIONS with correlation id 39344, received {error_code=0,api_versions=[{api_key=0,min_version=0,max_version=5},{api_key=1,min_version=0,max_version=7},{api_key=2,min_version=0,max_version=2},{api_key=3,min_version=0,max_version=5},{api_key=4,min_version=0,max_version=1},{api_key=5,min_version=0,max_version=0},{api_key=6,min_version=0,max_version=4},{api_key=7,min_version=0,max_version=1},{api_key=8,min_version=0,max_version=3},{api_key=9,min_version=0,max_version=3},{api_key=10,min_version=0,max_version=1},{api_key=11,min_version=0,max_version=2},{api_key=12,min_version=0,max_version=1},{api_key=13,min_version=0,max_version=1},{api_key=14,min_version=0,max_version=1},{api_key=15,min_version=0,max_version=1},{api_key=17,min_version=0,max_version=1},{api_key=16,min_version=0,max_version=1},{api_key=19,min_version=0,max_version=2},{api_key=18,min_version=0,max_version=1},{api_key=21,min_version=0,max_version=0},{api_key=20,min_version=0,max_version=1},{api_key=23,min_version=0,max_version=0},{api_key=22,min_version=0,max_version=0},{api_key=25,min_version=0,max_version=0},{api_key=24,min_version=0,max_version=0},{api_key=27,min_version=0,max_version=0},{api_key=26,min_version=0,max_version=0},{api_key=29,min_version=0,max_version=0},{api_key=28,min_version=0,max_version=0},{api_key=31,min_version=0,max_version=0},{api_key=30,min_version=0,max_version=0},{api_key=34,min_version=0,max_version=0},{api_key=35,min_version=0,max_version=0},{api_key=32,min_version=0,max_version=1},{api_key=33,min_version=0,max_version=0},{api_key=38,min_version=0,max_version=0},{api_key=39,min_version=0,max_version=0},{api_key=36,min_version=0,max_version=0},{api_key=37,min_version=0,max_version=0},{api_key=42,min_version=0,max_version=0},{api_key=40,min_version=0,max_version=0},{api_key=41,min_version=0,max_version=0}],throttle_time_ms=0} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,508] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Recorded API versions for node 2147483646: (Produce(0): 0 to 5 [usable: 5], Fetch(1): 0 to 7 [usable: 7], ListOffsets(2): 0 to 2 [usable: 2], Metadata(3): 0 to 5 [usable: 5], LeaderAndIsr(4): 0 to 1 [usable: 1], StopReplica(5): 0 [usable: 0], UpdateMetadata(6): 0 to 4 [usable: 4], ControlledShutdown(7): 0 to 1 [usable: 1], OffsetCommit(8): 0 to 3 [usable: 3], OffsetFetch(9): 0 to 3 [usable: 3], FindCoordinator(10): 0 to 1 [usable: 1], JoinGroup(11): 0 to 2 [usable: 2], Heartbeat(12): 0 to 1 [usable: 1], LeaveGroup(13): 0 to 1 [usable: 1], SyncGroup(14): 0 to 1 [usable: 1], DescribeGroups(15): 0 to 1 [usable: 1], ListGroups(16): 0 to 1 [usable: 1], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 1 [usable: 1], CreateTopics(19): 0 to 2 [usable: 2], DeleteTopics(20): 0 to 1 [usable: 1], DeleteRecords(21): 0 [usable: 0], InitProducerId(22): 0 [usable: 0], OffsetForLeaderEpoch(23): 0 [usable: 0], AddPartitionsToTxn(24): 0 [usable: 0], AddOffsetsToTxn(25): 0 [usable: 0], EndTxn(26): 0 [usable: 0], WriteTxnMarkers(27): 0 [usable: 0], TxnOffsetCommit(28): 0 [usable: 0], DescribeAcls(29): 0 [usable: 0], CreateAcls(30): 0 [usable: 0], DeleteAcls(31): 0 [usable: 0], DescribeConfigs(32): 0 to 1 [usable: 1], AlterConfigs(33): 0 [usable: 0], AlterReplicaLogDirs(34): 0 [usable: 0], DescribeLogDirs(35): 0 [usable: 0], SaslAuthenticate(36): 0 [usable: 0], CreatePartitions(37): 0 [usable: 0], CreateDelegationToken(38): 0 [usable: 0], RenewDelegationToken(39): 0 [usable: 0], ExpireDelegationToken(40): 0 [usable: 0], DescribeDelegationToken(41): 0 [usable: 0], DeleteGroups(42): 0 [usable: 0]) (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,508] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Sending OFFSET_COMMIT {group_id=test_group_id,generation_id=1,member_id=consumer-1-6703d8d9-9b72-44aa-b967-1be3ebc17eec,retention_time=-1,topics=[{topic=test_topic,partitions=[{partition=0,offset=39158,metadata=}]}]} with correlation id 39343 to node 2147483646 (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,510] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Completed receive from node 2147483646 for OFFSET_COMMIT with correlation id 39343, received {throttle_time_ms=0,responses=[{topic=test_topic,partition_responses=[{partition=0,error_code=25}]}]} (org.apache.kafka.clients.NetworkClient) [2018-02-15 07:36:51,510] ERROR [Consumer clientId=consumer-1, groupId=test_group_id] Offset commit failed on partition test_topic-0 at offset 39158: The coordinator is not aware of this member. (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator) [2018-02-15 07:36:51,510] TRACE [Consumer clientId=consumer-1, groupId=test_group_id] Closing the Kafka consumer (org.apache.kafka.clients.consumer.KafkaConsumer) [2018-02-15 07:36:51,510] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Heartbeat thread has closed (org.apache.kafka.clients.consumer.internals.AbstractCoordinator) [2018-02-15 07:36:51,511] DEBUG Removed sensor with name connections-closed: (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,511] DEBUG Removed sensor with name connections-created: (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,512] DEBUG Removed sensor with name successful-authentication: (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,512] DEBUG Removed sensor with name failed-authentication: (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,512] DEBUG Removed sensor with name bytes-sent-received: (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,512] DEBUG Removed sensor with name bytes-sent: (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,513] DEBUG Removed sensor with name bytes-received: (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,513] DEBUG Removed sensor with name select-time: (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,513] DEBUG Removed sensor with name io-time: (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,514] DEBUG Removed sensor with name node--2.bytes-sent (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,514] DEBUG Removed sensor with name node--2.bytes-received (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,514] DEBUG Removed sensor with name node--2.latency (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,514] DEBUG Removed sensor with name node--1.bytes-sent (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,515] DEBUG Removed sensor with name node--1.bytes-received (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,515] DEBUG Removed sensor with name node--1.latency (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,515] DEBUG Removed sensor with name node-1.bytes-sent (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,515] DEBUG Removed sensor with name node-1.bytes-received (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,515] DEBUG Removed sensor with name node-1.latency (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,516] DEBUG Removed sensor with name node-2.bytes-sent (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,516] DEBUG Removed sensor with name node-2.bytes-received (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,516] DEBUG Removed sensor with name node-2.latency (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,517] DEBUG Removed sensor with name node-2147483645.bytes-sent (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,517] DEBUG Removed sensor with name node-2147483645.bytes-received (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,517] DEBUG Removed sensor with name node-2147483645.latency (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,517] DEBUG Removed sensor with name node-2147483646.bytes-sent (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,518] DEBUG Removed sensor with name node-2147483646.bytes-received (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,518] DEBUG Removed sensor with name node-2147483646.latency (org.apache.kafka.common.metrics.Metrics) [2018-02-15 07:36:51,518] DEBUG [Consumer clientId=consumer-1, groupId=test_group_id] Kafka consumer has been closed (org.apache.kafka.clients.consumer.KafkaConsumer)