Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3819

Provide utilities for polling source connectors

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • connect

    Description

      Source connectors that need to poll for data are currently responsible for managing their own sleeping/backoff if they don't have any new data available. This is becoming a very common pattern. It's also easy to implement it incorrectly, e.g. by using Thread.sleep and not properly interrupting on stop().

      We should probably provide some utilities, maybe just exposed via the Context object to implement this for connector developers.

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. KAFKA-5352 Support automatic restart of failed tasks

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              ewencp Ewen Cheslack-Postava
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: