[SAMZA-2046] Startpoints - Fanout of SSP-only keyed Startpoints to SSP+TaskName

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1
• Fix Version/s: 1.2
• Assignee: Daniel Nishimura
• Reporter: Daniel Nishimura
• Created: 17/Dec/18 18:02
• Updated: 17/May/19 19:25
• Resolved: 17/May/19 19:25

Description

The job coordinators need to call the StartpointManager#fanOutStartpointsToTasks method that handles the re-mapping. What needs to be implemented is when this method should be called in the job coordinators.

YARN - ClusterBasedJobCoordinator should call the method before starting the processing containers.

Standalone - The job coordinator should call the method when the leader is elected and before the other processors begin processing.

Issue Links

• is a child of: SAMZA-1983 SEP-18 : Startpoints implementation in the core framework
• links to: GitHub Pull Request #1027