Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6279

Connect metrics do not get cleaned up for a source connector that doesn't stop properly

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: 1.0.0
    • Fix Version/s: None
    • Component/s: KafkaConnect
    • Labels:
      None

      Description

      Connect will call stop() on a source task to signal that it should "_stop trying to poll for new data
      and interrupt any outstanding poll() requests_" (see the JavaDoc for this method).

      Unfortunately, not all connectors properly adhere to this expectation. Since the metrics for the source task are cleaned up only when the worker source task's thread completes, a task whose poll() method blocks forever will current prevent its thread from completing. So, we need to change how the metrics are cleaned up to ensure this always happens.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                rhauch Randall Hauch
                Reporter:
                rhauch Randall Hauch
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: