org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@27e78bce to topic alt17 partition 0 2017-04-30 12:34:16 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:16 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:16 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 23, CreateTime = 1493535855497, checksum = 3449695594, serialized key size = 15, serialized value size = 427, key = CU0000000000331, value = "0001","CU0000000000331","KK","AC000000364","BN000000000","EUR","20170428","20170501","TX0000000000113","3","33791487","GBP",459938.65,915277.0,"AF00000843","US","US000112345678AC000004636","BANK123","Richard Vermette","N","Ausschreibung (Beschaffungv","on Hardware und Software)v."," 27.01.14","",""," ","","20170428025248000","CU0000000004242","","N","","J","","KD","AC000004636","BN000000000","EUR",""), timestamp = 1493535855497] 2017-04-30 12:34:16 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 24, CreateTime = 1493535855497, checksum = 1850496307, serialized key size = 15, serialized value size = 359, key = CU0000000006941, value = "0001","CU0000000006941","KD","AC000007555","BN000000000","EUR","20170428","20170430","TX0000000000115","5","01238731","USD",1955.8,3891.0,"AF00000373","","","","","J","Luftbild (Topografische Kar","ten und Luftbilder 02.09.20","13 Nachzahlung für Rechnung"," 20/221/0)",""," ","","20170428032136000","","","N","","N","","","","","",""), timestamp = 1493535855497] 2017-04-30 12:34:16 INFO DebugTransformer:37 - entering dt.transform with key CU0000000006941 with current thread [StreamThread-2:12] 2017-04-30 12:34:16 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:16 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:16 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:16 INFO DebugTransformer:42 - entering dt.transform with key CU0000000006941 with current thread [StreamThread-2:12] 2017-04-30 12:34:16 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=476]} to node 0. 2017-04-30 12:34:16 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3449695594, CreateTime = 1493535855497, key = 15 bytes, value = 427 bytes))]})) 2017-04-30 12:34:16 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@30b24644, value=[B@7175fe7d, timestamp=1493535855497) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@6a57a266 to topic alt17 partition 0 2017-04-30 12:34:16 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:16 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=110,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:16 TRACE Sender:262 - Received produce response from node 0 with correlation id 55 2017-04-30 12:34:16 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 110 and error: null. 2017-04-30 12:34:16 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:16 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 24, CreateTime = 1493535855497, checksum = 1850496307, serialized key size = 15, serialized value size = 359, key = CU0000000006941, value = "0001","CU0000000006941","KD","AC000007555","BN000000000","EUR","20170428","20170430","TX0000000000115","5","01238731","USD",1955.8,3891.0,"AF00000373","","","","","J","Luftbild (Topografische Kar","ten und Luftbilder 02.09.20","13 Nachzahlung für Rechnung"," 20/221/0)",""," ","","20170428032136000","","","N","","N","","","","","",""), timestamp = 1493535855497] 2017-04-30 12:34:16 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 25, CreateTime = 1493535855499, checksum = 3177276240, serialized key size = 15, serialized value size = 329, key = CU0000000005527, value = "0001","CU0000000005527","KK","AC000006018","BN000000000","GBP","20170428","20170430","TX0000000000120","4","33693984","GBP",192.39,192.39,"AF00000050","","","","","J","Gestaltungsgebiete -Nr. 698","3.22 vom 12.04.2014","","",""," ","","20170428043336000","","","N","","N","EMP0000000002616","","","","",""), timestamp = 1493535855499] 2017-04-30 12:34:16 INFO DebugTransformer:37 - entering dt.transform with key CU0000000005527 with current thread [StreamThread-2:12] 2017-04-30 12:34:16 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:16 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:16 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:16 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=408]} to node 0. 2017-04-30 12:34:16 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1850496307, CreateTime = 1493535855497, key = 15 bytes, value = 359 bytes))]})) 2017-04-30 12:34:16 INFO DebugTransformer:42 - entering dt.transform with key CU0000000005527 with current thread [StreamThread-2:12] 2017-04-30 12:34:16 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@21c21e75, value=[B@7f1a9a26, timestamp=1493535855499) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@28895331 to topic alt17 partition 0 2017-04-30 12:34:16 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:16 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:16 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 25, CreateTime = 1493535855499, checksum = 3177276240, serialized key size = 15, serialized value size = 329, key = CU0000000005527, value = "0001","CU0000000005527","KK","AC000006018","BN000000000","GBP","20170428","20170430","TX0000000000120","4","33693984","GBP",192.39,192.39,"AF00000050","","","","","J","Gestaltungsgebiete -Nr. 698","3.22 vom 12.04.2014","","",""," ","","20170428043336000","","","N","","N","EMP0000000002616","","","","",""), timestamp = 1493535855499] 2017-04-30 12:34:16 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 26, CreateTime = 1493535855501, checksum = 2841420497, serialized key size = 15, serialized value size = 324, key = CU0000000007492, value = "0001","CU0000000007492","DL","AC000008154","BN000000000","EUR","20170428","20170430","TX0000000000127","4","04475550","EUR",1418.53,1418.53,"AF00000414","","","","","J","Hundekot (Ordnungswidrigkei","t Nr. 239496 vom 09.10.2013",")","",""," ","","20170428061424000","","","N","","N","","","","","",""), timestamp = 1493535855501] 2017-04-30 12:34:16 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=111,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:16 TRACE Sender:262 - Received produce response from node 0 with correlation id 56 2017-04-30 12:34:16 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 111 and error: null. 2017-04-30 12:34:16 INFO DebugTransformer:37 - entering dt.transform with key CU0000000007492 with current thread [StreamThread-2:12] 2017-04-30 12:34:16 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:16 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:16 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:16 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=378]} to node 0. 2017-04-30 12:34:16 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3177276240, CreateTime = 1493535855499, key = 15 bytes, value = 329 bytes))]})) 2017-04-30 12:34:16 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=112,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:16 TRACE Sender:262 - Received produce response from node 0 with correlation id 57 2017-04-30 12:34:16 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 112 and error: null. 2017-04-30 12:34:16 INFO DebugTransformer:42 - entering dt.transform with key CU0000000007492 with current thread [StreamThread-2:12] 2017-04-30 12:34:16 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@1d2c55fd, value=[B@36cc27d4, timestamp=1493535855501) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@54befae7 to topic alt17 partition 0 2017-04-30 12:34:16 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:16 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:16 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 26, CreateTime = 1493535855501, checksum = 2841420497, serialized key size = 15, serialized value size = 324, key = CU0000000007492, value = "0001","CU0000000007492","DL","AC000008154","BN000000000","EUR","20170428","20170430","TX0000000000127","4","04475550","EUR",1418.53,1418.53,"AF00000414","","","","","J","Hundekot (Ordnungswidrigkei","t Nr. 239496 vom 09.10.2013",")","",""," ","","20170428061424000","","","N","","N","","","","","",""), timestamp = 1493535855501] 2017-04-30 12:34:16 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 27, CreateTime = 1493535855503, checksum = 1716978636, serialized key size = 15, serialized value size = 371, key = CU0000000005704, value = "0001","CU0000000005704","DL","AC000006212","BN000000000","GBP","20170428","20170501","TX0000000000129","3","56807750","USD",431.33,858.0,"AF00000074","US","US000112345678AC000005011","BANK123","Susanne Coia","N","Werkzeug 51234018","","","",""," ","","20170428064312000","CU0000000004586","","N","","J","","DD","AC000005011","BN000000000","EUR",""), timestamp = 1493535855503] 2017-04-30 12:34:16 INFO DebugTransformer:37 - entering dt.transform with key CU0000000005704 with current thread [StreamThread-2:12] 2017-04-30 12:34:16 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:16 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:16 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 TRACE NetworkClient:534 - Completed receive from node 0, for key 1, received {throttle_time_ms=0,responses=[{topic=transactions,partition_responses=[{partition_header={partition=3,error_code=0,high_watermark=0},record_set=[]}]}]} 2017-04-30 12:34:16 TRACE Fetcher:796 - Adding fetched record for partition transactions-3 with offset 0 to buffered record list 2017-04-30 12:34:16 TRACE Fetcher:818 - Received 0 records in fetch response for partition transactions-3 with offset 0 2017-04-30 12:34:16 DEBUG Metrics:335 - Added sensor with name topic.transactions.bytes-fetched 2017-04-30 12:34:16 DEBUG Metrics:335 - Added sensor with name topic.transactions.records-fetched 2017-04-30 12:34:16 DEBUG Metrics:335 - Added sensor with name transactions-3.records-lag 2017-04-30 12:34:16 TRACE Fetcher:739 - Added fetch request for partition transactions-3 at offset 0 to node localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 DEBUG Fetcher:181 - Sending fetch for partitions [transactions-3] to broker localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=transactions,partitions=[{partition=3,fetch_offset=0,max_bytes=1048576}]}]} to node 0. 2017-04-30 12:34:16 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:16 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=373]} to node 0. 2017-04-30 12:34:16 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2841420497, CreateTime = 1493535855501, key = 15 bytes, value = 324 bytes))]})) 2017-04-30 12:34:16 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=115,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:16 TRACE Sender:262 - Received produce response from node 0 with correlation id 58 2017-04-30 12:34:16 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 115 and error: null. 2017-04-30 12:34:16 INFO DebugTransformer:42 - entering dt.transform with key CU0000000005704 with current thread [StreamThread-2:12] 2017-04-30 12:34:16 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@20544c6e, value=[B@bf85cbf, timestamp=1493535855503) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@5c46ce02 to topic alt17 partition 0 2017-04-30 12:34:16 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:16 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:16 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 27, CreateTime = 1493535855503, checksum = 1716978636, serialized key size = 15, serialized value size = 371, key = CU0000000005704, value = "0001","CU0000000005704","DL","AC000006212","BN000000000","GBP","20170428","20170501","TX0000000000129","3","56807750","USD",431.33,858.0,"AF00000074","US","US000112345678AC000005011","BANK123","Susanne Coia","N","Werkzeug 51234018","","","",""," ","","20170428064312000","CU0000000004586","","N","","J","","DD","AC000005011","BN000000000","EUR",""), timestamp = 1493535855503] 2017-04-30 12:34:16 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:16 TRACE NetworkClient:534 - Completed receive from node 0, for key 1, received {throttle_time_ms=0,responses=[{topic=tx17,partition_responses=[{partition_header={partition=3,error_code=0,high_watermark=46},record_set=[]}]}]} 2017-04-30 12:34:16 TRACE Fetcher:796 - Adding fetched record for partition tx17-3 with offset 46 to buffered record list 2017-04-30 12:34:16 TRACE Fetcher:818 - Received 0 records in fetch response for partition tx17-3 with offset 46 2017-04-30 12:34:16 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 28, CreateTime = 1493535855503, checksum = 2383383470, serialized key size = 15, serialized value size = 363, key = CU0000000001666, value = "0001","CU0000000001666","KD","AC000001822","BN000000000","EUR","20170428","20170501","TX0000000000130","3","85674308","EUR",2957.22,2957.22,"AF00000364","","","","","J","freiwillige Beiträge (Freiw","illige Beitragszahlung (Ren","tenversicherung)) Kennz. 34",".89 20.06.14",""," ","","20170428065736000","","","N","","N","","","","","",""), timestamp = 1493535855503] 2017-04-30 12:34:16 INFO DebugTransformer:37 - entering dt.transform with key CU0000000001666 with current thread [StreamThread-2:12] 2017-04-30 12:34:16 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:16 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:16 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=420]} to node 0. 2017-04-30 12:34:17 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1716978636, CreateTime = 1493535855503, key = 15 bytes, value = 371 bytes))]})) 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=118,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:17 TRACE Sender:262 - Received produce response from node 0 with correlation id 59 2017-04-30 12:34:17 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 118 and error: null. 2017-04-30 12:34:17 INFO DebugTransformer:42 - entering dt.transform with key CU0000000001666 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@7f9eca60, value=[B@36ca7c88, timestamp=1493535855503) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@5c16928d to topic alt17 partition 0 2017-04-30 12:34:17 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:17 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:17 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 28, CreateTime = 1493535855503, checksum = 2383383470, serialized key size = 15, serialized value size = 363, key = CU0000000001666, value = "0001","CU0000000001666","KD","AC000001822","BN000000000","EUR","20170428","20170501","TX0000000000130","3","85674308","EUR",2957.22,2957.22,"AF00000364","","","","","J","freiwillige Beiträge (Freiw","illige Beitragszahlung (Ren","tenversicherung)) Kennz. 34",".89 20.06.14",""," ","","20170428065736000","","","N","","N","","","","","",""), timestamp = 1493535855503] 2017-04-30 12:34:17 TRACE Fetcher:739 - Added fetch request for partition tx17-3 at offset 46 to node localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 DEBUG Fetcher:181 - Sending fetch for partitions [tx17-3] to broker localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=tx17,partitions=[{partition=3,fetch_offset=46,max_bytes=1048576}]}]} to node 0. 2017-04-30 12:34:17 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 29, CreateTime = 1493535855503, checksum = 2343641680, serialized key size = 15, serialized value size = 367, key = CU0000000005364, value = "0001","CU0000000005364","DD","AC000005850","BN000000000","USD","20170428","20170430","TX0000000000131","2","83126706","USD",521.02,521.02,"AF00000415","","","","","J","Ehrenamt (Ausstellung der J","uLeiCa (Jugendleiterinnen-u","nd Jugendleiter-Card Kennz."," 30.89 20.10.2013))",""," ","","20170428071200000","","","N","","N","","","","","",""), timestamp = 1493535855503] 2017-04-30 12:34:17 INFO DebugTransformer:37 - entering dt.transform with key CU0000000005364 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:17 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=412]} to node 0. 2017-04-30 12:34:17 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2383383470, CreateTime = 1493535855503, key = 15 bytes, value = 363 bytes))]})) 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=121,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:17 TRACE Sender:262 - Received produce response from node 0 with correlation id 60 2017-04-30 12:34:17 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 121 and error: null. 2017-04-30 12:34:17 INFO DebugTransformer:42 - entering dt.transform with key CU0000000005364 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@762e38b9, value=[B@136534c8, timestamp=1493535855503) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@7b8f5ed3 to topic alt17 partition 0 2017-04-30 12:34:17 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:17 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:17 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 29, CreateTime = 1493535855503, checksum = 2343641680, serialized key size = 15, serialized value size = 367, key = CU0000000005364, value = "0001","CU0000000005364","DD","AC000005850","BN000000000","USD","20170428","20170430","TX0000000000131","2","83126706","USD",521.02,521.02,"AF00000415","","","","","J","Ehrenamt (Ausstellung der J","uLeiCa (Jugendleiterinnen-u","nd Jugendleiter-Card Kennz."," 30.89 20.10.2013))",""," ","","20170428071200000","","","N","","N","","","","","",""), timestamp = 1493535855503] 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 30, CreateTime = 1493535855504, checksum = 3047291496, serialized key size = 15, serialized value size = 299, key = CU0000000000371, value = "0001","CU0000000000371","DL","AC000000410","BN000000000","USD","20170428","20170502","TX0000000000132","6","60195747","GBP",2460.56,4895.0,"AF00000981","","","","","J","Reisegewerbe 20140315 Nr 05","5640","","",""," ","","20170428072624000","","","N","","N","","","","","",""), timestamp = 1493535855504] 2017-04-30 12:34:17 INFO DebugTransformer:37 - entering dt.transform with key CU0000000000371 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:17 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=416]} to node 0. 2017-04-30 12:34:17 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2343641680, CreateTime = 1493535855503, key = 15 bytes, value = 367 bytes))]})) 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=124,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:17 TRACE Sender:262 - Received produce response from node 0 with correlation id 61 2017-04-30 12:34:17 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 124 and error: null. 2017-04-30 12:34:17 INFO DebugTransformer:42 - entering dt.transform with key CU0000000000371 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@52206d7c, value=[B@6859d084, timestamp=1493535855504) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@69a1729a to topic alt17 partition 0 2017-04-30 12:34:17 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:17 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:17 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 30, CreateTime = 1493535855504, checksum = 3047291496, serialized key size = 15, serialized value size = 299, key = CU0000000000371, value = "0001","CU0000000000371","DL","AC000000410","BN000000000","USD","20170428","20170502","TX0000000000132","6","60195747","GBP",2460.56,4895.0,"AF00000981","","","","","J","Reisegewerbe 20140315 Nr 05","5640","","",""," ","","20170428072624000","","","N","","N","","","","","",""), timestamp = 1493535855504] 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 31, CreateTime = 1493535855504, checksum = 1867208962, serialized key size = 15, serialized value size = 406, key = CU0000000001903, value = "0001","CU0000000001903","KK","AC000002073","BN000000000","EUR","20170428","20170502","TX0000000000134","7","39714545","GBP",1560.17,3104.0,"AF00000462","DE","DE000112345678AC000006688","BANK123","Elmar Zomberg","N","Sperrmüll (Abfallentsorgung",") 30.11.13 Kunde 36/1","","",""," ","","20170428075512000","CU0000000006139","","N","","J","","KD","AC000006688","BN000000000","EUR",""), timestamp = 1493535855504] 2017-04-30 12:34:17 INFO DebugTransformer:37 - entering dt.transform with key CU0000000001903 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:17 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 WARN StreamThread:1214 - Could not create task 0_1. Will retry. org.apache.kafka.streams.errors.LockException: task [0_1] Failed to lock the state directory for task 0_1 at org.apache.kafka.streams.processor.internals.ProcessorStateManager.(ProcessorStateManager.java:100) at org.apache.kafka.streams.processor.internals.AbstractTask.(AbstractTask.java:73) at org.apache.kafka.streams.processor.internals.StreamTask.(StreamTask.java:108) at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) 2017-04-30 12:34:17 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=348]} to node 0. 2017-04-30 12:34:17 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3047291496, CreateTime = 1493535855504, key = 15 bytes, value = 299 bytes))]})) 2017-04-30 12:34:17 INFO DebugTransformer:42 - entering dt.transform with key CU0000000001903 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@e2506a8, value=[B@28de3a18, timestamp=1493535855504) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@4a89b83b to topic alt17 partition 0 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=127,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:17 TRACE Sender:262 - Received produce response from node 0 with correlation id 62 2017-04-30 12:34:17 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 127 and error: null. 2017-04-30 12:34:17 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:17 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:17 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 31, CreateTime = 1493535855504, checksum = 1867208962, serialized key size = 15, serialized value size = 406, key = CU0000000001903, value = "0001","CU0000000001903","KK","AC000002073","BN000000000","EUR","20170428","20170502","TX0000000000134","7","39714545","GBP",1560.17,3104.0,"AF00000462","DE","DE000112345678AC000006688","BANK123","Elmar Zomberg","N","Sperrmüll (Abfallentsorgung",") 30.11.13 Kunde 36/1","","",""," ","","20170428075512000","CU0000000006139","","N","","J","","KD","AC000006688","BN000000000","EUR",""), timestamp = 1493535855504] 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 32, CreateTime = 1493535855504, checksum = 1926559428, serialized key size = 15, serialized value size = 312, key = CU0000000001129, value = "0001","CU0000000001129","KD","AC000001245","BN000000000","EUR","20170428","20170501","TX0000000000142","5","90033188","EUR",2320.54,2320.54,"AF00000060","","","","","J","Wohnberechtigungsschein 292","392 vom 20140304","","",""," ","","20170428095024000","","","N","","N","","","","","",""), timestamp = 1493535855504] 2017-04-30 12:34:17 INFO DebugTransformer:37 - entering dt.transform with key CU0000000001129 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:17 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 DEBUG StreamThread:1236 - stream-thread [StreamThread-1] creating new task 0_1 2017-04-30 12:34:17 INFO StreamThread:858 - stream-thread [StreamThread-1] Creating active task 0_1 with assigned partitions [tx17-1] 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 1, received {throttle_time_ms=0,responses=[{topic=transactions,partition_responses=[{partition_header={partition=3,error_code=0,high_watermark=0},record_set=[]}]}]} 2017-04-30 12:34:17 TRACE Fetcher:796 - Adding fetched record for partition transactions-3 with offset 0 to buffered record list 2017-04-30 12:34:17 TRACE Fetcher:818 - Received 0 records in fetch response for partition transactions-3 with offset 0 2017-04-30 12:34:17 TRACE Fetcher:739 - Added fetch request for partition transactions-3 at offset 0 to node localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 DEBUG Fetcher:181 - Sending fetch for partitions [transactions-3] to broker localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=transactions,partitions=[{partition=3,fetch_offset=0,max_bytes=1048576}]}]} to node 0. 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=455]} to node 0. 2017-04-30 12:34:17 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1867208962, CreateTime = 1493535855504, key = 15 bytes, value = 406 bytes))]})) 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=130,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:17 TRACE Sender:262 - Received produce response from node 0 with correlation id 63 2017-04-30 12:34:17 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 130 and error: null. 2017-04-30 12:34:17 INFO DebugTransformer:42 - entering dt.transform with key CU0000000001129 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@4dfc2378, value=[B@14abde25, timestamp=1493535855504) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@1364f4eb to topic alt17 partition 0 2017-04-30 12:34:17 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:17 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:17 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 32, CreateTime = 1493535855504, checksum = 1926559428, serialized key size = 15, serialized value size = 312, key = CU0000000001129, value = "0001","CU0000000001129","KD","AC000001245","BN000000000","EUR","20170428","20170501","TX0000000000142","5","90033188","EUR",2320.54,2320.54,"AF00000060","","","","","J","Wohnberechtigungsschein 292","392 vom 20140304","","",""," ","","20170428095024000","","","N","","N","","","","","",""), timestamp = 1493535855504] 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 33, CreateTime = 1493535855506, checksum = 431936310, serialized key size = 15, serialized value size = 325, key = CU0000000007208, value = "0001","CU0000000007208","DD","AC000007852","BN000000000","EUR","20170428","20170501","TX0000000000149","5","29989798","GBP",2128.51,4235.0,"AF00000323","","","","","J","Statistische Informationena","us Bund und Land Aktz. 9978",".04","",""," ","","20170428113112000","","","N","","N","","","","","",""), timestamp = 1493535855506] 2017-04-30 12:34:17 INFO DebugTransformer:37 - entering dt.transform with key CU0000000007208 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:17 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=361]} to node 0. 2017-04-30 12:34:17 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1926559428, CreateTime = 1493535855504, key = 15 bytes, value = 312 bytes))]})) 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=133,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:17 TRACE Sender:262 - Received produce response from node 0 with correlation id 64 2017-04-30 12:34:17 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 133 and error: null. 2017-04-30 12:34:17 INFO DebugTransformer:42 - entering dt.transform with key CU0000000007208 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@79a7a09, value=[B@4d8ac629, timestamp=1493535855506) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@79fdb0df to topic alt17 partition 0 2017-04-30 12:34:17 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:17 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:17 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 33, CreateTime = 1493535855506, checksum = 431936310, serialized key size = 15, serialized value size = 325, key = CU0000000007208, value = "0001","CU0000000007208","DD","AC000007852","BN000000000","EUR","20170428","20170501","TX0000000000149","5","29989798","GBP",2128.51,4235.0,"AF00000323","","","","","J","Statistische Informationena","us Bund und Land Aktz. 9978",".04","",""," ","","20170428113112000","","","N","","N","","","","","",""), timestamp = 1493535855506] 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 1, received {throttle_time_ms=0,responses=[{topic=tx17,partition_responses=[{partition_header={partition=3,error_code=0,high_watermark=46},record_set=[]}]}]} 2017-04-30 12:34:17 TRACE Fetcher:796 - Adding fetched record for partition tx17-3 with offset 46 to buffered record list 2017-04-30 12:34:17 TRACE Fetcher:818 - Received 0 records in fetch response for partition tx17-3 with offset 46 2017-04-30 12:34:17 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 34, CreateTime = 1493535855506, checksum = 1780961766, serialized key size = 15, serialized value size = 309, key = CU0000000005745, value = "0001","CU0000000005745","DL","AC000006257","BN000000000","EUR","20170428","20170501","TX0000000000158","2","23069272","GBP",1493.39,2971.0,"AF00000961","","","","","J","Schlaganfall (Notfall) /520","92754 20140106","","",""," ","","20170428134048000","","","N","","N","","","","","",""), timestamp = 1493535855506] 2017-04-30 12:34:17 INFO DebugTransformer:37 - entering dt.transform with key CU0000000005745 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:17 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=374]} to node 0. 2017-04-30 12:34:17 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 431936310, CreateTime = 1493535855506, key = 15 bytes, value = 325 bytes))]})) 2017-04-30 12:34:17 INFO DebugTransformer:42 - entering dt.transform with key CU0000000005745 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=136,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:17 TRACE Sender:262 - Received produce response from node 0 with correlation id 65 2017-04-30 12:34:17 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 136 and error: null. 2017-04-30 12:34:17 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@d4de922, value=[B@166dcd2c, timestamp=1493535855506) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@282fc76 to topic alt17 partition 0 2017-04-30 12:34:17 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:17 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:17 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 34, CreateTime = 1493535855506, checksum = 1780961766, serialized key size = 15, serialized value size = 309, key = CU0000000005745, value = "0001","CU0000000005745","DL","AC000006257","BN000000000","EUR","20170428","20170501","TX0000000000158","2","23069272","GBP",1493.39,2971.0,"AF00000961","","","","","J","Schlaganfall (Notfall) /520","92754 20140106","","",""," ","","20170428134048000","","","N","","N","","","","","",""), timestamp = 1493535855506] 2017-04-30 12:34:17 TRACE Fetcher:739 - Added fetch request for partition tx17-3 at offset 46 to node localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 DEBUG Fetcher:181 - Sending fetch for partitions [tx17-3] to broker localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=tx17,partitions=[{partition=3,fetch_offset=46,max_bytes=1048576}]}]} to node 0. 2017-04-30 12:34:17 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 35, CreateTime = 1493535855506, checksum = 3674747007, serialized key size = 15, serialized value size = 302, key = CU0000000008466, value = "0001","CU0000000008466","DL","AC000009221","BN000000000","EUR","20170428","20170502","TX0000000000159","4","11690107","EUR",2618.56,2618.56,"AF00000869","","","","","J","Altenheime 20140326 Kunde22","288339","","",""," ","","20170428135512000","","","N","","N","","","","","",""), timestamp = 1493535855506] 2017-04-30 12:34:17 INFO DebugTransformer:37 - entering dt.transform with key CU0000000008466 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:17 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=358]} to node 0. 2017-04-30 12:34:17 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1780961766, CreateTime = 1493535855506, key = 15 bytes, value = 309 bytes))]})) 2017-04-30 12:34:17 INFO DebugTransformer:42 - entering dt.transform with key CU0000000008466 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=139,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:17 TRACE Sender:262 - Received produce response from node 0 with correlation id 66 2017-04-30 12:34:17 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 139 and error: null. 2017-04-30 12:34:17 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@25231924, value=[B@5d5fb401, timestamp=1493535855506) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@48ab9290 to topic alt17 partition 0 2017-04-30 12:34:17 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:17 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:17 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 35, CreateTime = 1493535855506, checksum = 3674747007, serialized key size = 15, serialized value size = 302, key = CU0000000008466, value = "0001","CU0000000008466","DL","AC000009221","BN000000000","EUR","20170428","20170502","TX0000000000159","4","11690107","EUR",2618.56,2618.56,"AF00000869","","","","","J","Altenheime 20140326 Kunde22","288339","","",""," ","","20170428135512000","","","N","","N","","","","","",""), timestamp = 1493535855506] 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 36, CreateTime = 1493535855506, checksum = 2044393675, serialized key size = 15, serialized value size = 307, key = CU0000000006511, value = "0001","CU0000000006511","DD","AC000007085","BN000000000","EUR","20170428","20170501","TX0000000000160","7","91986376","CHF",2273.21,4523.0,"AF00000932","","","","","J","Werkzeugmaschinen 43/637923","173 20140520","","",""," ","","20170428140936000","","","N","","N","","","","","",""), timestamp = 1493535855506] 2017-04-30 12:34:17 INFO DebugTransformer:37 - entering dt.transform with key CU0000000006511 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:17 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 INFO DebugTransformer:42 - entering dt.transform with key CU0000000006511 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:17 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@1db1bd57, value=[B@3deefd5c, timestamp=1493535855506) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@2945c763 to topic alt17 partition 0 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=351]} to node 0. 2017-04-30 12:34:17 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:17 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3674747007, CreateTime = 1493535855506, key = 15 bytes, value = 302 bytes))]})) 2017-04-30 12:34:17 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:17 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 36, CreateTime = 1493535855506, checksum = 2044393675, serialized key size = 15, serialized value size = 307, key = CU0000000006511, value = "0001","CU0000000006511","DD","AC000007085","BN000000000","EUR","20170428","20170501","TX0000000000160","7","91986376","CHF",2273.21,4523.0,"AF00000932","","","","","J","Werkzeugmaschinen 43/637923","173 20140520","","",""," ","","20170428140936000","","","N","","N","","","","","",""), timestamp = 1493535855506] 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=142,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:17 TRACE Sender:262 - Received produce response from node 0 with correlation id 67 2017-04-30 12:34:17 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 142 and error: null. 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 37, CreateTime = 1493535855509, checksum = 342336151, serialized key size = 15, serialized value size = 397, key = CU0000000005900, value = "0001","CU0000000005900","DL","AC000006428","BN000000000","EUR","20170428","20170502","TX0000000000176","4","76807456","CHF",518.56,1031.0,"AF00000082","US","US000112345678AC000002150","BANK123","Abbo Lathrop","N","Gewalt (Erziehungsberatung1","2.06.14/039213)","","",""," ","","20170428180000000","CU0000000001972","","N","","J","","DD","AC000002150","BN000000000","EUR",""), timestamp = 1493535855509] 2017-04-30 12:34:17 INFO DebugTransformer:37 - entering dt.transform with key CU0000000005900 with current thread [StreamThread-2:12] 2017-04-30 12:34:17 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:17 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE NetworkClient:534 - Completed receive from node 0, for key 1, received {throttle_time_ms=0,responses=[{topic=transactions,partition_responses=[{partition_header={partition=3,error_code=0,high_watermark=0},record_set=[]}]}]} 2017-04-30 12:34:17 TRACE Fetcher:796 - Adding fetched record for partition transactions-3 with offset 0 to buffered record list 2017-04-30 12:34:17 TRACE Fetcher:818 - Received 0 records in fetch response for partition transactions-3 with offset 0 2017-04-30 12:34:17 TRACE Fetcher:739 - Added fetch request for partition transactions-3 at offset 0 to node localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 DEBUG Fetcher:181 - Sending fetch for partitions [transactions-3] to broker localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:17 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=transactions,partitions=[{partition=3,fetch_offset=0,max_bytes=1048576}]}]} to node 0. 2017-04-30 12:34:17 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=356]} to node 0. 2017-04-30 12:34:18 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 2044393675, CreateTime = 1493535855506, key = 15 bytes, value = 307 bytes))]})) 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=145,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:18 TRACE Sender:262 - Received produce response from node 0 with correlation id 68 2017-04-30 12:34:18 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 145 and error: null. 2017-04-30 12:34:18 INFO DebugTransformer:42 - entering dt.transform with key CU0000000005900 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@2aa9f549, value=[B@6067f95d, timestamp=1493535855509) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@671e54ed to topic alt17 partition 0 2017-04-30 12:34:18 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:18 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:18 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 37, CreateTime = 1493535855509, checksum = 342336151, serialized key size = 15, serialized value size = 397, key = CU0000000005900, value = "0001","CU0000000005900","DL","AC000006428","BN000000000","EUR","20170428","20170502","TX0000000000176","4","76807456","CHF",518.56,1031.0,"AF00000082","US","US000112345678AC000002150","BANK123","Abbo Lathrop","N","Gewalt (Erziehungsberatung1","2.06.14/039213)","","",""," ","","20170428180000000","CU0000000001972","","N","","J","","DD","AC000002150","BN000000000","EUR",""), timestamp = 1493535855509] 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 38, CreateTime = 1493535855509, checksum = 1455842406, serialized key size = 15, serialized value size = 312, key = CU0000000002456, value = "0001","CU0000000002456","KK","AC000002675","BN000000000","EUR","20170428","20170501","TX0000000000152","8","93619896","EUR",1638.61,1638.61,"AF00000473","","","","","J","Kindergarten v. 01.06.14 Au","ftr.Nr. 59660929","","",""," ","","20170428121424000","","","N","","N","","","","","",""), timestamp = 1493535855509] 2017-04-30 12:34:18 INFO DebugTransformer:37 - entering dt.transform with key CU0000000002456 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:18 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=446]} to node 0. 2017-04-30 12:34:18 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 342336151, CreateTime = 1493535855509, key = 15 bytes, value = 397 bytes))]})) 2017-04-30 12:34:18 INFO DebugTransformer:42 - entering dt.transform with key CU0000000002456 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@2dd7fbbf, value=[B@72255249, timestamp=1493535855509) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@6709c9dc to topic alt17 partition 0 2017-04-30 12:34:18 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=148,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:18 TRACE Sender:262 - Received produce response from node 0 with correlation id 69 2017-04-30 12:34:18 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 148 and error: null. 2017-04-30 12:34:18 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:18 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 38, CreateTime = 1493535855509, checksum = 1455842406, serialized key size = 15, serialized value size = 312, key = CU0000000002456, value = "0001","CU0000000002456","KK","AC000002675","BN000000000","EUR","20170428","20170501","TX0000000000152","8","93619896","EUR",1638.61,1638.61,"AF00000473","","","","","J","Kindergarten v. 01.06.14 Au","ftr.Nr. 59660929","","",""," ","","20170428121424000","","","N","","N","","","","","",""), timestamp = 1493535855509] 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 39, CreateTime = 1493535855509, checksum = 3368970577, serialized key size = 15, serialized value size = 434, key = CU0000000003933, value = "0001","CU0000000003933","KD","AC000004288","BN000000000","GBP","20170428","20170501","TX0000000000177","5","98886034","CHF",569.01,1132.0,"AF00000680","US","US000112345678AC000002846","BANK123","Rainer Theuenin","N","Baugrundstück (002420 vom 2","0131026Nachweis der städtis","chen Liegenschaften)","",""," ","","20170428181424000","CU0000000002614","","N","","J","","KK","AC000002846","BN000000000","EUR",""), timestamp = 1493535855509] 2017-04-30 12:34:18 INFO DebugTransformer:37 - entering dt.transform with key CU0000000003933 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:18 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 1, received {throttle_time_ms=0,responses=[{topic=tx17,partition_responses=[{partition_header={partition=3,error_code=0,high_watermark=46},record_set=[]}]}]} 2017-04-30 12:34:18 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=361]} to node 0. 2017-04-30 12:34:18 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 1455842406, CreateTime = 1493535855509, key = 15 bytes, value = 312 bytes))]})) 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=151,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:18 TRACE Sender:262 - Received produce response from node 0 with correlation id 70 2017-04-30 12:34:18 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 151 and error: null. 2017-04-30 12:34:18 INFO DebugTransformer:42 - entering dt.transform with key CU0000000003933 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@3780af5b, value=[B@6fef14f8, timestamp=1493535855509) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@468177f0 to topic alt17 partition 0 2017-04-30 12:34:18 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:18 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:18 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 39, CreateTime = 1493535855509, checksum = 3368970577, serialized key size = 15, serialized value size = 434, key = CU0000000003933, value = "0001","CU0000000003933","KD","AC000004288","BN000000000","GBP","20170428","20170501","TX0000000000177","5","98886034","CHF",569.01,1132.0,"AF00000680","US","US000112345678AC000002846","BANK123","Rainer Theuenin","N","Baugrundstück (002420 vom 2","0131026Nachweis der städtis","chen Liegenschaften)","",""," ","","20170428181424000","CU0000000002614","","N","","J","","KK","AC000002846","BN000000000","EUR",""), timestamp = 1493535855509] 2017-04-30 12:34:18 TRACE Fetcher:796 - Adding fetched record for partition tx17-3 with offset 46 to buffered record list 2017-04-30 12:34:18 TRACE Fetcher:818 - Received 0 records in fetch response for partition tx17-3 with offset 46 2017-04-30 12:34:18 TRACE Fetcher:739 - Added fetch request for partition tx17-3 at offset 46 to node localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 DEBUG Fetcher:181 - Sending fetch for partitions [tx17-3] to broker localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=tx17,partitions=[{partition=3,fetch_offset=46,max_bytes=1048576}]}]} to node 0. 2017-04-30 12:34:18 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 40, CreateTime = 1493535855509, checksum = 604489535, serialized key size = 15, serialized value size = 327, key = CU0000000008906, value = "0001","CU0000000008906","KD","AC000009702","BN000000000","EUR","20170428","20170430","TX0000000000180","5","63856071","EUR",2866.8,2866.8,"AF00000036","","","","","J","Eigentümerwechsel (- 698417","17Vorkaufsrechtsbescheinigu","ngen)","",""," ","","20170428185736000","","","N","","N","","","","","",""), timestamp = 1493535855509] 2017-04-30 12:34:18 INFO DebugTransformer:37 - entering dt.transform with key CU0000000008906 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:18 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=483]} to node 0. 2017-04-30 12:34:18 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3368970577, CreateTime = 1493535855509, key = 15 bytes, value = 434 bytes))]})) 2017-04-30 12:34:18 INFO DebugTransformer:42 - entering dt.transform with key CU0000000008906 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=154,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:18 TRACE Sender:262 - Received produce response from node 0 with correlation id 71 2017-04-30 12:34:18 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 154 and error: null. 2017-04-30 12:34:18 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@14a3ee97, value=[B@3fc602f, timestamp=1493535855509) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@4e8fb957 to topic alt17 partition 0 2017-04-30 12:34:18 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:18 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:18 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 40, CreateTime = 1493535855509, checksum = 604489535, serialized key size = 15, serialized value size = 327, key = CU0000000008906, value = "0001","CU0000000008906","KD","AC000009702","BN000000000","EUR","20170428","20170430","TX0000000000180","5","63856071","EUR",2866.8,2866.8,"AF00000036","","","","","J","Eigentümerwechsel (- 698417","17Vorkaufsrechtsbescheinigu","ngen)","",""," ","","20170428185736000","","","N","","N","","","","","",""), timestamp = 1493535855509] 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 41, CreateTime = 1493535855510, checksum = 3286195876, serialized key size = 15, serialized value size = 322, key = CU0000000003490, value = "0001","CU0000000003490","KK","AC000003801","BN000000000","USD","20170428","20170430","TX0000000000184","8","01535996","CHF",1281.83,2550.0,"AF00000553","","","","","J","Abmeldung Hundesteuer (Hund","esteuer) /31/658/1 27.06.13","","",""," ","","20170428195512000","","","N","","N","","","","","",""), timestamp = 1493535855510] 2017-04-30 12:34:18 INFO DebugTransformer:37 - entering dt.transform with key CU0000000003490 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:18 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 WARN StreamThread:1214 - Could not create task 0_1. Will retry. org.apache.kafka.streams.errors.LockException: task [0_1] Failed to lock the state directory for task 0_1 at org.apache.kafka.streams.processor.internals.ProcessorStateManager.(ProcessorStateManager.java:100) at org.apache.kafka.streams.processor.internals.AbstractTask.(AbstractTask.java:73) at org.apache.kafka.streams.processor.internals.StreamTask.(StreamTask.java:108) at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 1, received {throttle_time_ms=0,responses=[{topic=transactions,partition_responses=[{partition_header={partition=3,error_code=0,high_watermark=0},record_set=[]}]}]} 2017-04-30 12:34:18 TRACE Fetcher:796 - Adding fetched record for partition transactions-3 with offset 0 to buffered record list 2017-04-30 12:34:18 TRACE Fetcher:818 - Received 0 records in fetch response for partition transactions-3 with offset 0 2017-04-30 12:34:18 TRACE Fetcher:739 - Added fetch request for partition transactions-3 at offset 0 to node localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 DEBUG Fetcher:181 - Sending fetch for partitions [transactions-3] to broker localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=transactions,partitions=[{partition=3,fetch_offset=0,max_bytes=1048576}]}]} to node 0. 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=376]} to node 0. 2017-04-30 12:34:18 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 604489535, CreateTime = 1493535855509, key = 15 bytes, value = 327 bytes))]})) 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=157,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:18 TRACE Sender:262 - Received produce response from node 0 with correlation id 72 2017-04-30 12:34:18 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 157 and error: null. 2017-04-30 12:34:18 INFO DebugTransformer:42 - entering dt.transform with key CU0000000003490 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@387eb012, value=[B@58e3522a, timestamp=1493535855510) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@6b151d60 to topic alt17 partition 0 2017-04-30 12:34:18 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:18 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:18 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 41, CreateTime = 1493535855510, checksum = 3286195876, serialized key size = 15, serialized value size = 322, key = CU0000000003490, value = "0001","CU0000000003490","KK","AC000003801","BN000000000","USD","20170428","20170430","TX0000000000184","8","01535996","CHF",1281.83,2550.0,"AF00000553","","","","","J","Abmeldung Hundesteuer (Hund","esteuer) /31/658/1 27.06.13","","",""," ","","20170428195512000","","","N","","N","","","","","",""), timestamp = 1493535855510] 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 42, CreateTime = 1493535855510, checksum = 3531071017, serialized key size = 15, serialized value size = 443, key = CU0000000000422, value = "0001","CU0000000000422","DD","AC000000467","BN000000000","USD","20170428","20170502","TX0000000000185","7","84339120","EUR",342852.11,682275.0,"AF00000054","DE","DE000112345678AC000002433","BANK123","Lenore Machin","N","Freizeiten (Ferienangebotef","ür Kinder und JugendlicheRü","ckerstattung vom 20130723)","",""," ","","20170428200936000","CU0000000002232","","N","","J","","DL","AC000002433","BN000000000","EUR",""), timestamp = 1493535855510] 2017-04-30 12:34:18 INFO DebugTransformer:37 - entering dt.transform with key CU0000000000422 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:18 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 DEBUG StreamThread:1236 - stream-thread [StreamThread-1] creating new task 0_1 2017-04-30 12:34:18 INFO StreamThread:858 - stream-thread [StreamThread-1] Creating active task 0_1 with assigned partitions [tx17-1] 2017-04-30 12:34:18 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=371]} to node 0. 2017-04-30 12:34:18 INFO DebugTransformer:42 - entering dt.transform with key CU0000000000422 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3286195876, CreateTime = 1493535855510, key = 15 bytes, value = 322 bytes))]})) 2017-04-30 12:34:18 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@49b572d, value=[B@46ab3796, timestamp=1493535855510) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@516cc3e to topic alt17 partition 0 2017-04-30 12:34:18 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=160,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:18 TRACE Sender:262 - Received produce response from node 0 with correlation id 73 2017-04-30 12:34:18 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 160 and error: null. 2017-04-30 12:34:18 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:18 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 42, CreateTime = 1493535855510, checksum = 3531071017, serialized key size = 15, serialized value size = 443, key = CU0000000000422, value = "0001","CU0000000000422","DD","AC000000467","BN000000000","USD","20170428","20170502","TX0000000000185","7","84339120","EUR",342852.11,682275.0,"AF00000054","DE","DE000112345678AC000002433","BANK123","Lenore Machin","N","Freizeiten (Ferienangebotef","ür Kinder und JugendlicheRü","ckerstattung vom 20130723)","",""," ","","20170428200936000","CU0000000002232","","N","","J","","DL","AC000002433","BN000000000","EUR",""), timestamp = 1493535855510] 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 43, CreateTime = 1493535855510, checksum = 284869334, serialized key size = 15, serialized value size = 342, key = CU0000000004473, value = "0001","CU0000000004473","DL","AC000004888","BN000000000","GBP","20170428","20170501","TX0000000000189","3","89890291","EUR",2401.02,4778.0,"AF00000100","","","","","J","Schadensangelegenheiten der","Stadt Lüdenscheid Rückersta","ttung vom 28.07.13","",""," ","","20170428210712000","","","N","","N","","","","","",""), timestamp = 1493535855510] 2017-04-30 12:34:18 INFO DebugTransformer:37 - entering dt.transform with key CU0000000004473 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:18 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=492]} to node 0. 2017-04-30 12:34:18 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 3531071017, CreateTime = 1493535855510, key = 15 bytes, value = 443 bytes))]})) 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=163,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:18 TRACE Sender:262 - Received produce response from node 0 with correlation id 74 2017-04-30 12:34:18 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 163 and error: null. 2017-04-30 12:34:18 INFO DebugTransformer:42 - entering dt.transform with key CU0000000004473 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@56cea962, value=[B@494623aa, timestamp=1493535855510) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@7a026180 to topic alt17 partition 0 2017-04-30 12:34:18 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:18 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:18 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 43, CreateTime = 1493535855510, checksum = 284869334, serialized key size = 15, serialized value size = 342, key = CU0000000004473, value = "0001","CU0000000004473","DL","AC000004888","BN000000000","GBP","20170428","20170501","TX0000000000189","3","89890291","EUR",2401.02,4778.0,"AF00000100","","","","","J","Schadensangelegenheiten der","Stadt Lüdenscheid Rückersta","ttung vom 28.07.13","",""," ","","20170428210712000","","","N","","N","","","","","",""), timestamp = 1493535855510] 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 44, CreateTime = 1493535855511, checksum = 306079674, serialized key size = 15, serialized value size = 308, key = CU0000000000410, value = "0001","CU0000000000410","DD","AC000000453","BN000000000","EUR","20170428","20170502","TX0000000000195","7","24804616","GBP",27.89,54.0,"AF00000630","","","","","J","Auskünfte zum Schöffenamt /","021283 26.08.13","","",""," ","","20170428223336000","","","N","","N","","","","","",""), timestamp = 1493535855511] 2017-04-30 12:34:18 INFO DebugTransformer:37 - entering dt.transform with key CU0000000000410 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:18 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=391]} to node 0. 2017-04-30 12:34:18 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 284869334, CreateTime = 1493535855510, key = 15 bytes, value = 342 bytes))]})) 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=166,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:18 TRACE Sender:262 - Received produce response from node 0 with correlation id 75 2017-04-30 12:34:18 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 166 and error: null. 2017-04-30 12:34:18 INFO DebugTransformer:42 - entering dt.transform with key CU0000000000410 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@44a05218, value=[B@3c836255, timestamp=1493535855511) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@55e41a24 to topic alt17 partition 0 2017-04-30 12:34:18 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:18 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:18 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 44, CreateTime = 1493535855511, checksum = 306079674, serialized key size = 15, serialized value size = 308, key = CU0000000000410, value = "0001","CU0000000000410","DD","AC000000453","BN000000000","EUR","20170428","20170502","TX0000000000195","7","24804616","GBP",27.89,54.0,"AF00000630","","","","","J","Auskünfte zum Schöffenamt /","021283 26.08.13","","",""," ","","20170428223336000","","","N","","N","","","","","",""), timestamp = 1493535855511] 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 1, received {throttle_time_ms=0,responses=[{topic=tx17,partition_responses=[{partition_header={partition=3,error_code=0,high_watermark=46},record_set=[]}]}]} 2017-04-30 12:34:18 TRACE Fetcher:796 - Adding fetched record for partition tx17-3 with offset 46 to buffered record list 2017-04-30 12:34:18 TRACE Fetcher:818 - Received 0 records in fetch response for partition tx17-3 with offset 46 2017-04-30 12:34:18 TRACE StreamTask:194 - task [0_3] Start processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 45, CreateTime = 1493535855511, checksum = 401418611, serialized key size = 15, serialized value size = 434, key = CU0000000001171, value = "0001","CU0000000001171","KD","AC000001289","BN000000000","EUR","20170428","20170501","TX0000000000200","1","56126179","USD",1373.38,2732.0,"AF00000098","US","US000112345678AC000005574","BANK123","Lena Mundo","N","Individualverkehr (Planungv","on Straßenbaumaßnahmen v.20","140421 Auftr.Nr. 790715)","",""," ","","20170428234536000","CU0000000005109","","N","","J","","KD","AC000005574","BN000000000","EUR",""), timestamp = 1493535855511] 2017-04-30 12:34:18 INFO DebugTransformer:37 - entering dt.transform with key CU0000000001171 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 DEBUG KafkaConsumer:944 - Subscribed to partition(s): transactions-3 2017-04-30 12:34:18 DEBUG KafkaConsumer:1199 - Seeking to offset 0 for partition transactions-3 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition transactions-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=357]} to node 0. 2017-04-30 12:34:18 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 306079674, CreateTime = 1493535855511, key = 15 bytes, value = 308 bytes))]})) 2017-04-30 12:34:18 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=168,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:18 TRACE Sender:262 - Received produce response from node 0 with correlation id 76 2017-04-30 12:34:18 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 168 and error: null. 2017-04-30 12:34:18 INFO DebugTransformer:42 - entering dt.transform with key CU0000000001171 with current thread [StreamThread-2:12] 2017-04-30 12:34:18 TRACE KafkaProducer:475 - Sending record ProducerRecord(topic=alt17, partition=null, key=[B@47d1dfff, value=[B@60e78c9a, timestamp=1493535855511) with callback org.apache.kafka.streams.processor.internals.RecordCollectorImpl$1@15279f98 to topic alt17 partition 0 2017-04-30 12:34:18 TRACE RecordAccumulator:182 - Allocating a new 16384 byte message buffer for topic alt17 partition 0 2017-04-30 12:34:18 TRACE KafkaProducer:480 - Waking up the sender since topic alt17 partition 0 is either full or getting a new batch 2017-04-30 12:34:18 TRACE StreamTask:199 - task [0_3] Completed processing one record [ConsumerRecord(topic = tx17, partition = 3, offset = 45, CreateTime = 1493535855511, checksum = 401418611, serialized key size = 15, serialized value size = 434, key = CU0000000001171, value = "0001","CU0000000001171","KD","AC000001289","BN000000000","EUR","20170428","20170501","TX0000000000200","1","56126179","USD",1373.38,2732.0,"AF00000098","US","US000112345678AC000005574","BANK123","Lena Mundo","N","Individualverkehr (Planungv","on Straßenbaumaßnahmen v.20","140421 Auftr.Nr. 790715)","",""," ","","20170428234536000","CU0000000005109","","N","","J","","KD","AC000005574","BN000000000","EUR",""), timestamp = 1493535855511] 2017-04-30 12:34:18 TRACE Fetcher:739 - Added fetch request for partition tx17-3 at offset 46 to node localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 DEBUG Fetcher:181 - Sending fetch for partitions [tx17-3] to broker localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:18 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=tx17,partitions=[{partition=3,fetch_offset=46,max_bytes=1048576}]}]} to node 0. 2017-04-30 12:34:18 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Sender:216 - Nodes with data ready to send: [localhost:9092 (id: 0 rack: null)] 2017-04-30 12:34:19 TRACE NetworkClient:316 - Sending {acks=1,timeout=30000,partitionSizes=[alt17-0=483]} to node 0. 2017-04-30 12:34:19 TRACE Sender:365 - Sent produce request to 0: (type=ProduceRequest, acks=1, timeout=30000, partitionRecords=({alt17-0=[(offset=0,record=Record(magic = 1, attributes = 0, compression = NONE, crc = 401418611, CreateTime = 1493535855511, key = 15 bytes, value = 434 bytes))]})) 2017-04-30 12:34:19 TRACE NetworkClient:534 - Completed receive from node 0, for key 0, received {responses=[{topic=alt17,partition_responses=[{partition=0,error_code=0,base_offset=170,log_append_time=-1}]}],throttle_time_ms=0} 2017-04-30 12:34:19 TRACE Sender:262 - Received produce response from node 0 with correlation id 77 2017-04-30 12:34:19 TRACE RecordBatch:97 - Produced messages to topic-partition alt17-0 with base offset offset 170 and error: null. 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group app17 to coordinator localhost:9092 (id: 2147483647 rack: null) 2017-04-30 12:34:19 TRACE NetworkClient:316 - Sending {group_id=app17,group_generation_id=3,member_id=app17-6675ea0e-c554-4b24-814b-3d64bbaf7983-StreamThread-2-consumer-8b4ac1b8-db21-4dd2-8178-b8a0879b17c4} to node 2147483647. 2017-04-30 12:34:19 TRACE NetworkClient:534 - Completed receive from node 2147483647, for key 12, received {error_code=0} 2017-04-30 12:34:19 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group app17 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 DEBUG AbstractCoordinator:724 - Sending Heartbeat request for group app17 to coordinator localhost:9092 (id: 2147483647 rack: null) 2017-04-30 12:34:19 TRACE NetworkClient:316 - Sending {group_id=app17,group_generation_id=3,member_id=app17-6675ea0e-c554-4b24-814b-3d64bbaf7983-StreamThread-1-consumer-3754563d-cf90-42ad-bbac-d72ee6c80454} to node 2147483647. 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE NetworkClient:534 - Completed receive from node 2147483647, for key 12, received {error_code=0} 2017-04-30 12:34:19 DEBUG AbstractCoordinator:737 - Received successful Heartbeat response for group app17 2017-04-30 12:34:19 TRACE NetworkClient:534 - Completed receive from node 0, for key 1, received {throttle_time_ms=0,responses=[{topic=tx17,partition_responses=[{partition_header={partition=3,error_code=0,high_watermark=46},record_set=[]}]}]} 2017-04-30 12:34:19 TRACE Fetcher:796 - Adding fetched record for partition tx17-3 with offset 46 to buffered record list 2017-04-30 12:34:19 TRACE Fetcher:818 - Received 0 records in fetch response for partition tx17-3 with offset 46 2017-04-30 12:34:19 TRACE Fetcher:739 - Added fetch request for partition tx17-3 at offset 46 to node localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 DEBUG Fetcher:181 - Sending fetch for partitions [tx17-3] to broker localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=tx17,partitions=[{partition=3,fetch_offset=46,max_bytes=1048576}]}]} to node 0. 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 WARN StreamThread:1214 - Could not create task 0_1. Will retry. org.apache.kafka.streams.errors.LockException: task [0_1] Failed to lock the state directory for task 0_1 at org.apache.kafka.streams.processor.internals.ProcessorStateManager.(ProcessorStateManager.java:100) at org.apache.kafka.streams.processor.internals.AbstractTask.(AbstractTask.java:73) at org.apache.kafka.streams.processor.internals.StreamTask.(StreamTask.java:108) at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 DEBUG StreamThread:1236 - stream-thread [StreamThread-1] creating new task 0_1 2017-04-30 12:34:19 INFO StreamThread:858 - stream-thread [StreamThread-1] Creating active task 0_1 with assigned partitions [tx17-1] 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE NetworkClient:534 - Completed receive from node 0, for key 1, received {throttle_time_ms=0,responses=[{topic=tx17,partition_responses=[{partition_header={partition=3,error_code=0,high_watermark=46},record_set=[]}]}]} 2017-04-30 12:34:19 TRACE Fetcher:796 - Adding fetched record for partition tx17-3 with offset 46 to buffered record list 2017-04-30 12:34:19 TRACE Fetcher:818 - Received 0 records in fetch response for partition tx17-3 with offset 46 2017-04-30 12:34:19 TRACE Fetcher:739 - Added fetch request for partition tx17-3 at offset 46 to node localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 DEBUG Fetcher:181 - Sending fetch for partitions [tx17-3] to broker localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=tx17,partitions=[{partition=3,fetch_offset=46,max_bytes=1048576}]}]} to node 0. 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:19 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 TRACE NetworkClient:534 - Completed receive from node 0, for key 1, received {throttle_time_ms=0,responses=[{topic=tx17,partition_responses=[{partition_header={partition=3,error_code=0,high_watermark=46},record_set=[]}]}]} 2017-04-30 12:34:20 TRACE Fetcher:796 - Adding fetched record for partition tx17-3 with offset 46 to buffered record list 2017-04-30 12:34:20 TRACE Fetcher:818 - Received 0 records in fetch response for partition tx17-3 with offset 46 2017-04-30 12:34:20 TRACE Fetcher:739 - Added fetch request for partition tx17-3 at offset 46 to node localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 DEBUG Fetcher:181 - Sending fetch for partitions [tx17-3] to broker localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 TRACE NetworkClient:316 - Sending {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,topics=[{topic=tx17,partitions=[{partition=3,fetch_offset=46,max_bytes=1048576}]}]} to node 0. 2017-04-30 12:34:20 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 WARN StreamThread:1214 - Could not create task 0_1. Will retry. org.apache.kafka.streams.errors.LockException: task [0_1] Failed to lock the state directory for task 0_1 at org.apache.kafka.streams.processor.internals.ProcessorStateManager.(ProcessorStateManager.java:100) at org.apache.kafka.streams.processor.internals.AbstractTask.(AbstractTask.java:73) at org.apache.kafka.streams.processor.internals.StreamTask.(StreamTask.java:108) at org.apache.kafka.streams.processor.internals.StreamThread.createStreamTask(StreamThread.java:864) at org.apache.kafka.streams.processor.internals.StreamThread$TaskCreator.createTask(StreamThread.java:1237) at org.apache.kafka.streams.processor.internals.StreamThread$AbstractTaskCreator.retryWithBackoff(StreamThread.java:1210) at org.apache.kafka.streams.processor.internals.StreamThread.addStreamTasks(StreamThread.java:967) at org.apache.kafka.streams.processor.internals.StreamThread.access$600(StreamThread.java:69) at org.apache.kafka.streams.processor.internals.StreamThread$1.onPartitionsAssigned(StreamThread.java:234) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:259) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:352) at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:303) at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:290) at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1029) at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:995) at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:592) at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:361) 2017-04-30 12:34:20 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null) 2017-04-30 12:34:20 TRACE Fetcher:741 - Skipping fetch for partition tx17-3 because there is an in-flight request to localhost:9092 (id: 0 rack: null)