[FLINK-3161] Externalize cluster start-up and tear-down when available

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.0.0
• Fix Version/s: 1.0.0
• Component/s: Deployment / Scripts
• Assignee: Greg Hogan
• Reporter: Greg Hogan
• Created: 11/Dec/15 17:08
• Updated: 03/Feb/16 23:29
• Resolved: 03/Feb/16 23:29

Description

I have been using pdsh, pdcp, and rpdcp to both distribute compiled Flink and to start and stop the TaskManagers. The current shell script initializes TaskManagers one-at-a-time. This is trivial to background but would be unthrottled.

From pdsh's archived homepage: "uses a sliding window of threads to execute remote commands, conserving socket resources while allowing some connections to timeout if needed".

What other tools could be supported when available?