Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5696

SourceConnector does not commit offset on rebalance

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • connect

    Description

      I'm running SourceConnector, that reads files from storage and put data in kafka. I want, in case of reconfiguration, offsets to be flushed.

      Say, a file is completely processed, but source records are not yet committed and in case of reconfiguration their offsets might be missing in store.

      Is it possible to force committing offsets on reconfiguration?

      Attachments

        Activity

          People

            Unassigned Unassigned
            olkuznsmith Oleg Kuznetsov
            Votes:
            1 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated: