[GOBBLIN-904] Provide an option to reuse an existing Helix cluster on Gobblin-Yarn application launch

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.15.0
• Fix Version/s: 0.15.0
• Component/s: gobblin-yarn
• Assignee: Abhishek Tiwari
• Reporter: Sudarshan Vasudevan
• Created: 08/Oct/19 03:07
• Updated: 08/Oct/19 04:09
• Resolved: 08/Oct/19 04:09

Description

Currently, we recreate a Helix cluster structure everytime a Gobblin-on-Yarn application is launched. This is an expensive operation and somewhat flaky, often requiring multiple attempts. We need the ability to overwrite an existing Helix cluster to provide deterministic restarts. 

Issue Links

• links to: GitHub Pull Request #2757