Nov 27 00:59:53.692 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.692  INFO 26 --- [-StreamThread-1] o.a.k.c.c.internals.AbstractCoordinator  : [Consumer instanceId=streaming-pipeline-3-main04-fra-production-1, clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-consumer, groupId=cluster1-streaming-pipeline-app] Discovered group coordinator localhost:9104 (id: 2147482634 rack: null)
 
Nov 27 00:59:53.692 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | [Consumer instanceId=streaming-pipeline-3-main04-fra-production-1, clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-consumer, groupId=cluster1-streaming-pipeline-app] Cluster ID: 3-mIu27TRtuWTD9DWDy45Q 
Nov 27 00:59:53.692 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.692  INFO 26 --- [-StreamThread-1] org.apache.kafka.clients.Metadata        : [Consumer instanceId=streaming-pipeline-3-main04-fra-production-1, clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-consumer, groupId=cluster1-streaming-pipeline-app] Cluster ID: 3-mIu27TRtuWTD9DWDy45Q
 
 
Nov 27 00:59:53.693 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.693  INFO 26 --- [-StreamThread-1] o.a.k.c.c.internals.AbstractCoordinator  : [Consumer instanceId=streaming-pipeline-3-main04-fra-production-1, clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-consumer, groupId=cluster1-streaming-pipeline-app] (Re-)joining group
 
Nov 27 00:59:53.693 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | [Consumer instanceId=streaming-pipeline-3-main04-fra-production-1, clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-consumer, groupId=cluster1-streaming-pipeline-app] (Re-)joining group 
Nov 27 00:59:53.693 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | [Consumer instanceId=streaming-pipeline-3-main04-fra-production-1, clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-consumer, groupId=cluster1-streaming-pipeline-app] Discovered group coordinator localhost:9104 (id: 2147482634 rack: null) 
Nov 27 00:59:53.708 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.708  INFO 26 --- [-StreamThread-1] o.a.k.c.c.internals.AbstractCoordinator  : [Consumer instanceId=streaming-pipeline-3-main04-fra-production-1, clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-consumer, groupId=cluster1-streaming-pipeline-app] Successfully joined group with generation 15022
 
Nov 27 00:59:53.708 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | [Consumer instanceId=streaming-pipeline-3-main04-fra-production-1, clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-consumer, groupId=cluster1-streaming-pipeline-app] Successfully joined group with generation 15022 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:510)
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:367)
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] Encountered the following exception during processing and the thread is going to shut down:  java.lang.IllegalStateException: There are insufficient bytes available to read assignment from the sync-group response (actual byte size 0) , this is not expected; it is possible that the leader's assign function is buggy and did not return any assignment for this member, or because static member is configured and the protocol is buggy hence did not get the assignment for this member
	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:367)
	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:440)
	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:359)
	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:513)
	at org.apache.kafka.clients.consumer.KafkaConsumer.updateAssignmentMetadataIfNeeded(KafkaConsumer.java:1268)
	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1230)
	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1210)
	at org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:766)
	at org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:624)
	at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:551)
	at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:510)
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1230)
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:359)
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.KafkaConsumer.updateAssignmentMetadataIfNeeded(KafkaConsumer.java:1268)
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:513)
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1210)
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:440)
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:624)
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:766)
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | java.lang.IllegalStateException: There are insufficient bytes available to read assignment from the sync-group response (actual byte size 0) , this is not expected; it is possible that the leader's assign function is buggy and did not return any assignment for this member, or because static member is configured and the protocol is buggy hence did not get the assignment for this member
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.709 ERROR 26 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread         : stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] Encountered the following exception during processing and the thread is going to shut down: 
 
Nov 27 00:59:53.709 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:551)
 
Nov 27 00:59:53.711 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.709  INFO 26 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread         : stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] State transition from STARTING to PENDING_SHUTDOWN
 
Nov 27 00:59:53.711 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.709  INFO 26 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread         : stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] Shutting down
 
Nov 27 00:59:53.711 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] State transition from STARTING to PENDING_SHUTDOWN 
Nov 27 00:59:53.711 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | [Producer clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-producer] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. 
Nov 27 00:59:53.711 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.710  INFO 26 --- [-StreamThread-1] o.a.k.clients.producer.KafkaProducer     : [Producer clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-producer] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms.
 
Nov 27 00:59:53.711 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | [Consumer clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-restore-consumer, groupId=null] Unsubscribed all topics or patterns and assigned partitions 
Nov 27 00:59:53.711 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.711  INFO 26 --- [-StreamThread-1] o.a.k.clients.consumer.KafkaConsumer     : [Consumer clientId=cluster1-streaming-pipeline-app-client-id-StreamThread-1-restore-consumer, groupId=null] Unsubscribed all topics or patterns and assigned partitions
 
Nov 27 00:59:53.711 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] Shutting down 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | [streaming-pipeline-app] state change from: REBALANCING to: ERROR 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] Shutdown complete 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | java.lang.IllegalStateException: There are insufficient bytes available to read assignment from the sync-group response (actual byte size 0) , this is not expected; it is possible that the leader's assign function is buggy and did not return any assignment for this member, or because static member is configured and the protocol is buggy hence did not get the assignment for this member
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.714 ERROR 26 --- [-StreamThread-1] org.apache.kafka.streams.KafkaStreams    : stream-client [cluster1-streaming-pipeline-app-client-id] All stream threads have died. The instance will be in error state and should be closed.
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] State transition from PENDING_SHUTDOWN to DEAD 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:440)
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | Sending out pipeline state change event from REBALANCING to ERROR for pipeline: streaming-pipeline-app with host id: streaming-pipeline-3-main04-fra-production 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:766)
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | stream-client [cluster1-streaming-pipeline-app-client-id] State transition from REBALANCING to ERROR 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.713  INFO 26 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread         : stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] State transition from PENDING_SHUTDOWN to DEAD
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.714  INFO 26 --- [-StreamThread-1] org.apache.kafka.streams.KafkaStreams    : stream-client [cluster1-streaming-pipeline-app-client-id] State transition from REBALANCING to ERROR
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.714  INFO 26 --- [pool-6-thread-1] e.p.EventPublishingPipelineStateListener : Sending out pipeline state change event from REBALANCING to ERROR for pipeline: streaming-pipeline-app with host id: streaming-pipeline-3-main04-fra-production
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:551)
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:359)
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.714  INFO 26 --- [-StreamThread-1] c.t.s.e.k.KafkaStreamsStateListener      : [streaming-pipeline-app] state change from: REBALANCING to: ERROR
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.714 ERROR 26 --- [-StreamThread-1] .KafkaStreamsBasedStreamProcessingEngine : Stream processing pipeline: [streaming-pipeline-app] encountered unrecoverable exception. Thread: [cluster1-streaming-pipeline-app-client-id-StreamThread-1] is completely dead. If all worker threads die, Kafka Streams will be moved to permanent ERROR state.
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:367)
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.714  INFO 26 --- [-StreamThread-1] o.a.k.s.p.internals.StreamThread         : stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] Shutdown complete
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1210)
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.KafkaConsumer.updateAssignmentMetadataIfNeeded(KafkaConsumer.java:1268)
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | stream-client [cluster1-streaming-pipeline-app-client-id] All stream threads have died. The instance will be in error state and should be closed. 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:513)
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:510)
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1230)
 
Nov 27 00:59:53.714 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 	at org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:624)
 
Nov 27 00:59:53.715 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | Stream processing pipeline: [streaming-pipeline-app] encountered unrecoverable exception. Thread: [cluster1-streaming-pipeline-app-client-id-StreamThread-1] is completely dead. If all worker threads die, Kafka Streams will be moved to permanent ERROR state. java.lang.IllegalStateException: There are insufficient bytes available to read assignment from the sync-group response (actual byte size 0) , this is not expected; it is possible that the leader's assign function is buggy and did not return any assignment for this member, or because static member is configured and the protocol is buggy hence did not get the assignment for this member
	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.onJoinComplete(ConsumerCoordinator.java:367)
	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:440)
	at org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:359)
	at org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:513)
	at org.apache.kafka.clients.consumer.KafkaConsumer.updateAssignmentMetadataIfNeeded(KafkaConsumer.java:1268)
	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1230)
	at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1210)
	at org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:766)
	at org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:624)
	at org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:551)
	at org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:510)
Nov 27 00:59:53.721 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 00:59:53.721  INFO 26 --- [internal-client] e.p.EventPublishingPipelineStateListener : successfully sent pipeline state change event with key: cluster1-streaming-pipeline-app-streaming-pipeline-3-main04-fra-production
 
Nov 27 00:59:53.721 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | successfully sent pipeline state change event with key: cluster1-streaming-pipeline-app-streaming-pipeline-3-main04-fra-production 
 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | [TW-STREAMS-MANAGER][streaming-pipeline-app] trying to stop pipeline 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.567  INFO 27 --- [   scheduling-1] .KafkaStreamsBasedStreamProcessingEngine : [KAFKA-STREAMS-ENGINE][streaming-pipeline-app] calling close method with timeout PT3M and cleanup CleanupParameters{cleanupPipelineState=false, cleanupStateDirectory=false}
 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.567  INFO 27 --- [   scheduling-1] c.t.s.e.k.KafkaStreamsStateListener      : [streaming-pipeline-app] state change from: ERROR to: PENDING_SHUTDOWN
 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.567  INFO 27 --- [pool-6-thread-1] e.p.EventPublishingPipelineStateListener : Sending out pipeline state change event from ERROR to PENDING_SHUTDOWN for pipeline: streaming-pipeline-app with host id: streaming-pipeline-3-main03-fra-production
 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.566  INFO 27 --- [   scheduling-1] c.t.s.StreamingPipelinesAdministrator    : [TW-STREAMS-MANAGER][streaming-pipeline-app] trying to stop pipeline
 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | [streaming-pipeline-app] state change from: ERROR to: PENDING_SHUTDOWN 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | Sending out pipeline state change event from ERROR to PENDING_SHUTDOWN for pipeline: streaming-pipeline-app with host id: streaming-pipeline-3-main03-fra-production 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.567  INFO 27 --- [   scheduling-1] org.apache.kafka.streams.KafkaStreams    : stream-client [cluster1-streaming-pipeline-app-client-id] State transition from ERROR to PENDING_SHUTDOWN
 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] Informed to shut down 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | [KAFKA-STREAMS-ENGINE][streaming-pipeline-app] calling close method with timeout PT3M and cleanup CleanupParameters{cleanupPipelineState=false, cleanupStateDirectory=false} 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | stream-client [cluster1-streaming-pipeline-app-client-id] State transition from ERROR to PENDING_SHUTDOWN 
Nov 27 01:00:11.567 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.567  INFO 27 --- [ms-close-thread] o.a.k.s.p.internals.StreamThread         : stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] Informed to shut down
 
Nov 27 01:00:11.568 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | global-stream-thread [cluster1-streaming-pipeline-app-client-id-GlobalStreamThread] State transition from RUNNING to PENDING_SHUTDOWN 
Nov 27 01:00:11.568 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.567  INFO 27 --- [ms-close-thread] o.a.k.s.p.internals.GlobalStreamThread   : global-stream-thread [cluster1-streaming-pipeline-app-client-id-GlobalStreamThread] State transition from RUNNING to PENDING_SHUTDOWN
 
Nov 27 01:00:11.574 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.574  INFO 27 --- [internal-client] e.p.EventPublishingPipelineStateListener : successfully sent pipeline state change event with key: cluster1-streaming-pipeline-app-streaming-pipeline-3-main03-fra-production
 
Nov 27 01:00:11.574 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | successfully sent pipeline state change event with key: cluster1-streaming-pipeline-app-streaming-pipeline-3-main03-fra-production 
Nov 27 01:00:11.609 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | [TW-STREAMS-MANAGER][streaming-pipeline-app] trying to stop pipeline 
Nov 27 01:00:11.609 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.609  INFO 26 --- [   scheduling-1] c.t.s.StreamingPipelinesAdministrator    : [TW-STREAMS-MANAGER][streaming-pipeline-app] trying to stop pipeline
 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | [streaming-pipeline-app] state change from: ERROR to: PENDING_SHUTDOWN 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | [KAFKA-STREAMS-ENGINE][streaming-pipeline-app] calling close method with timeout PT3M and cleanup CleanupParameters{cleanupPipelineState=false, cleanupStateDirectory=false} 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.609  INFO 26 --- [   scheduling-1] .KafkaStreamsBasedStreamProcessingEngine : [KAFKA-STREAMS-ENGINE][streaming-pipeline-app] calling close method with timeout PT3M and cleanup CleanupParameters{cleanupPipelineState=false, cleanupStateDirectory=false}
 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.610  INFO 26 --- [   scheduling-1] c.t.s.e.k.KafkaStreamsStateListener      : [streaming-pipeline-app] state change from: ERROR to: PENDING_SHUTDOWN
 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | stream-client [cluster1-streaming-pipeline-app-client-id] State transition from ERROR to PENDING_SHUTDOWN 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] Informed to shut down 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.610  INFO 26 --- [pool-6-thread-1] e.p.EventPublishingPipelineStateListener : Sending out pipeline state change event from ERROR to PENDING_SHUTDOWN for pipeline: streaming-pipeline-app with host id: streaming-pipeline-3-main04-fra-production
 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.610  INFO 26 --- [   scheduling-1] org.apache.kafka.streams.KafkaStreams    : stream-client [cluster1-streaming-pipeline-app-client-id] State transition from ERROR to PENDING_SHUTDOWN
 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.610  INFO 26 --- [ms-close-thread] o.a.k.s.p.internals.StreamThread         : stream-thread [cluster1-streaming-pipeline-app-client-id-StreamThread-1] Informed to shut down
 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | global-stream-thread [cluster1-streaming-pipeline-app-client-id-GlobalStreamThread] State transition from RUNNING to PENDING_SHUTDOWN 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | Sending out pipeline state change event from ERROR to PENDING_SHUTDOWN for pipeline: streaming-pipeline-app with host id: streaming-pipeline-3-main04-fra-production 
Nov 27 01:00:11.610 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.610  INFO 26 --- [ms-close-thread] o.a.k.s.p.internals.GlobalStreamThread   : global-stream-thread [cluster1-streaming-pipeline-app-client-id-GlobalStreamThread] State transition from RUNNING to PENDING_SHUTDOWN
 
Nov 27 01:00:11.616 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | successfully sent pipeline state change event with key: cluster1-streaming-pipeline-app-streaming-pipeline-3-main04-fra-production 
Nov 27 01:00:11.616 streaming-pipeline service: main04-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.616  INFO 26 --- [internal-client] e.p.EventPublishingPipelineStateListener : successfully sent pipeline state change event with key: cluster1-streaming-pipeline-app-streaming-pipeline-3-main04-fra-production
 
Nov 27 01:00:11.621 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | global-stream-thread [cluster1-streaming-pipeline-app-client-id-GlobalStreamThread] Shutting down 
Nov 27 01:00:11.621 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.621  INFO 27 --- [balStreamThread] o.a.k.s.p.internals.GlobalStreamThread   : global-stream-thread [cluster1-streaming-pipeline-app-client-id-GlobalStreamThread] Shutting down
 
Nov 27 01:00:11.624 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.623  INFO 27 --- [balStreamThread] o.a.k.s.p.internals.GlobalStreamThread   : global-stream-thread [cluster1-streaming-pipeline-app-client-id-GlobalStreamThread] State transition from PENDING_SHUTDOWN to DEAD
 
Nov 27 01:00:11.624 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | global-stream-thread [cluster1-streaming-pipeline-app-client-id-GlobalStreamThread] State transition from PENDING_SHUTDOWN to DEAD 
Nov 27 01:00:11.624 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.624  INFO 27 --- [balStreamThread] o.a.k.s.p.internals.GlobalStreamThread   : global-stream-thread [cluster1-streaming-pipeline-app-client-id-GlobalStreamThread] Shutdown complete
 
Nov 27 01:00:11.624 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | global-stream-thread [cluster1-streaming-pipeline-app-client-id-GlobalStreamThread] Shutdown complete 
Nov 27 01:00:11.625 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | Sending out pipeline state change event from PENDING_SHUTDOWN to NOT_RUNNING for pipeline: streaming-pipeline-app with host id: streaming-pipeline-3-main03-fra-production 
Nov 27 01:00:11.625 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.625  INFO 27 --- [   scheduling-1] c.t.s.s.health.FaultyPipelinesCleaner    : Finished faulty pipelines cleaner job, closed 1 faulty pipelines
 
Nov 27 01:00:11.625 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.625  INFO 27 --- [   scheduling-1] .KafkaStreamsBasedStreamProcessingEngine : [KAFKA-STREAMS-ENGINE][streaming-pipeline-app] finished cleanup
 
Nov 27 01:00:11.625 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | [TW-STREAMS-MANAGER][streaming-pipeline-app] result of the close operation true 
Nov 27 01:00:11.625 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | Finished faulty pipelines cleaner job, closed 1 faulty pipelines 
Nov 27 01:00:11.625 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | 2020-11-27 01:00:11.625  INFO 27 --- [pool-6-thread-1] e.p.EventPublishingPipelineStateListener : Sending out pipeline state change event from PENDING_SHUTDOWN to NOT_RUNNING for pipeline: streaming-pipeline-app with host id: streaming-pipeline-3-main03-fra-production
 
Nov 27 01:00:11.625 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | [streaming-pipeline-app] state change from: PENDING_SHUTDOWN to: NOT_RUNNING 
Nov 27 01:00:11.625 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | stream-client [cluster1-streaming-pipeline-app-client-id] State transition from PENDING_SHUTDOWN to NOT_RUNNING 
Nov 27 01:00:11.625 streaming-pipeline service: main03-fra-production | streaming-pipeline-3 | stream-client [cluster1-streaming-pipeline-app-client-id] Streams client stopped completely