[SAMZA-1983] SEP-18 : Startpoints implementation in the core framework

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Daniel Nishimura
• Reporter: Daniel Nishimura
• Created: 07/Nov/18 19:36
• Updated: 05/Sep/19 15:49
• Resolved: 06/Jun/19 23:22

Description

Umbrella Jira ticket for the SEP-18 implementation.

https://cwiki.apache.org/confluence/display/SAMZA/SEP-18%3A+Startpoints+-+Manipulating+Starting+Offsets+for+Input+Streams

Issue Links

• depends upon: SAMZA-2171 Encapsulate creation and loading of metadata streams
• depends upon: SAMZA-2181 Ensure consistency of coordinator store creation and initialization
• is a parent of: SAMZA-1985 Implement Startpoints model and StartpointManager
• is a parent of: SAMZA-2022 Startpoints - SystemConsumers (not to be confused with SystemConsumer) modifications including integration with MessageChooser.
• is a parent of: SAMZA-2023 Startpoints - Implement KafkaSystemConsumer#register(SystemStreamPartition, Startpoint) interface.
• is a parent of: SAMZA-2046 Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName
• is a parent of: SAMZA-2024 Startpoints - Implement EventHubSystemConsumer#register(SystemStreamPartition, Startpoint) interface.
• is a parent of: SAMZA-2038 Add and implement new interface TaskContext#setStartingOffset(SystemStreamPartition, Startpoint)
• is a parent of: SAMZA-2088 Use startpoint to calculate the starting offset of a SSP in OffsetManager.
• is a parent of: SAMZA-2094 Implement the StartpointVisitor for KafkaSystemConsumer.
• is a parent of: SAMZA-2149 Generalize startpoint SSP to task fanout API
• is a parent of: SAMZA-2201 Startpoints - Integrate fan out with job coordinators
• is a parent of: SAMZA-2220 Startpoints - Fully encapsulate resolution of starting offsets in OffsetManager
• is a parent of: SAMZA-2049 Startpoints user documentation
• is related to: SAMZA-2260 Standalone: Share metadata store between StreamProcessor and JobCoordinator
• mentioned in: Page Loading...