Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2744

WorkerSourceTask commits offsets too early when stopping

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.9.0.0
    • connect
    • None

    Description

      The call to commit offsets appears ok at first glance because we've invoked the SourceTask's stop method, but it runs before we've stopped the work thread which could still be invoking the SourceTask's poll() method and may have outstanding data. We need to wait until we're sure the work thread has completely finished so we're guaranteed to flush all the data generated by the SourceTask and commit the final offsets.

      Attachments

        Activity

          People

            ewencp Ewen Cheslack-Postava
            ewencp Ewen Cheslack-Postava
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: