[GOBBLIN-1900] Add option for MR job execution to calculate and persist all work units, then proceed no further

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Component/s: gobblin-api
• Assignee: Hung Tran
• Reporter: Kip Kohn
• Created: 06/Sep/23 22:43
• Updated: 08/Sep/23 18:39
• Resolved: 08/Sep/23 18:39

Description

MapReduce is an aging legacy technology, so it's worth exploring additional execution frameworks.  To simplify experimentation and evaluation, add the ability to "borrow" MR's WorkUnit preparation, so such forays may at first jump ahead to investigate WU execution.

The proposed option `mr.persist.workunits.then.cancel` would work as advertised.