Uploaded image for project: 'Apache Hop'
  1. Apache Hop
  2. HOP-3695

Kafka transform stuck in a loop when self-referencing

    XMLWordPrintableJSON

Details

    • Bug
    • Status: In Progress
    • Minor
    • Resolution: Unresolved
    • 1.0.0, 1.1.0
    • None
    • Transforms

    Description

      When using the kafka consumer transform and setting the current pipeline as the "kafka pipeline" in the transform, hop gets stuck in an initialization loop:

      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:32 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:33 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:33 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:33 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:33 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:33 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:33 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:33 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:33 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:34 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:34 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:34 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:35 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:37 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:37 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:38 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:38 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:39 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:39 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:39 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:39 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:42 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:42 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:42 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:42 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:42 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:42 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter]
      2022/01/20 13:20:42 - kafka-consumer-hans-peter - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
      2022/01/20 13:20:42 - kafka-consumer-hans-peter - Execution started for pipeline [kafka-consumer-hans-peter] 

      Attachments

        1. kafka-docker-compose.yml
          0.5 kB
          Hans Van Akelyen
        2. kafka-consumer-hans-peter.hpl
          4 kB
          Hans Van Akelyen

        Activity

          People

            gvdutra Gabriel Dutra
            hansva Hans Van Akelyen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: