Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
This patch is comprised of the following changes:
- Migrates the `StartpointVisitor` abstraction from `SystemConsumer` to `SystemAdmin`. Currently, startpoints are acted upon at the `SystemConsumer` layer. This patch enables resolving startpoint to the offset before starting off the downstream components of SamzaContainer. This provides easier integration path for Startpoint by not mandating that every component of SamzaContainer from OffsetManager, SystemConsumer, SystemConsumers etc to support startpoint semantics and avoids proliferation of Samza public API with startpoints.
- Moves the `KafkaStartpointVisitor` implementation from `KafkaSystemConsumer` to `KafkaSystemAdmin`. Reverts back the refactor done in `KafkaSystemConsumer` for startpoints.
- Moved the startpoint tests from `KafkaSystemConsumer` to `KafkaSystemAdmin`.
- Removes the `StartpointCustom`, which is not required for supporting any type of seek-back for I/O connectors.
Attachments
Issue Links
- links to