Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5696

SourceConnector does not commit offset on rebalance

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: KafkaConnect
    • Labels:

      Description

      I'm running SourceConnector, that reads files from storage and put data in kafka. I want, in case of reconfiguration, offsets to be flushed.

      Say, a file is completely processed, but source records are not yet committed and in case of reconfiguration their offsets might be missing in store.

      Is it possible to force committing offsets on reconfiguration?

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              olkuznsmith Oleg Kuznetsov
            • Votes:
              3 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated: