[HOP-3695] Kafka transform stuck in a loop when self-referencing

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.0.0, 1.1.0
• Fix Version/s: Migrated to GHI
• Component/s: Transforms
• Labels: kafka low-hanging-fruit
• Assignee: Gabriel Dutra
• Reporter: Hans Van Akelyen
• Created: 20/Jan/22 12:25
• Updated: 16/Mar/23 10:46
• Resolved: 16/Mar/23 10:46

Description

When using the kafka consumer transform and setting the current pipeline as the "kafka pipeline" in the transform, hop gets stuck in an initialization loop:

2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:33 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:33 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:33 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:33 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:33 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:33 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:33 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:33 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:34 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:34 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:34 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:35 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:37 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:37 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:38 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:38 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:39 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:39 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:39 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:39 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:42 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:42 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:42 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:42 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:42 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:42 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
2022/01/20 13:20:42 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
2022/01/20 13:20:42 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]