Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7970

Missing topic causes service shutdown without exception

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.1.0
    • 2.7.0
    • streams
    • None

    Description

      When launching a KafkaStreams application that depends on a topic that doesn't exist, the streams application correctly logs an error such as:

      "<TOPIC_NAME> is unknown yet during rebalance, please make sure they have been pre-created before starting the Streams application."

      The stream is then shutdown, however, no exception is thrown indicating that an error has occurred.

      In our circumstances, we run our streams app inside a container. The streams service is shutdown, but the process is not exited, meaning that the container does not crash (reducing visibility of the issue).

      As no exception is thrown in the missing topic scenario described above, our application code has no way to determine that something is wrong that would then allow it to terminate the process.

       

      Could the onPartitionsAssigned method in StreamThread.java throw an exception when it decides to shutdown the stream (somewhere around line 264)?

      Attachments

        Issue Links

          Activity

            People

              cadonna Bruno Cadonna
              JonnyHeavey Jonny Heavey
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: