Description
Provide a way for a SourceTask implementation to record a new offset for a given partition without necessarily writing a source record to a topic.
Consider a connector task that uses the same offset when producing an unknown number of SourceRecord objects (e.g., it is taking a snapshot of a database). Once the task completes those records, the connector wants to update the offsets (e.g., the snapshot is complete) but has no more records to be written to a topic. With this change, the task could simply supply an updated offset.
Attachments
Issue Links
- is duplicated by
-
KAFKA-5084 Allow Kafka connect source tasks to commit offsets without messages being sent
- Resolved
- relates to
-
KAFKA-6080 Transactional EoS for source connectors
- Resolved
- links to