Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-10792

Source tasks can block herder thread by hanging during stop

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.4.0, 2.5.0, 2.4.1, 2.6.0, 2.4.2, 2.5.1, 2.7.0
    • 2.5.2, 2.8.0, 2.7.1, 2.6.2
    • KafkaConnect
    • None

    Description

      If a source task blocks during its stop method, the herder thread will also block, which can cause issues with detecting rebalances, reconfiguring connectors, and other vital functions of a Connect worker.

      This occurs because the call to SourceTask::stop occurs on the herder's thread, instead of on the source task's own dedicated thread. This can be fixed by moving the call to SourceTask::stop onto the source task's dedicated thread and aligning with the current approach for Connector instances and SinkTask instances.

      Attachments

        Issue Links

          Activity

            People

              ChrisEgerton Chris Egerton
              ChrisEgerton Chris Egerton
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: