[FLINK-4487] Need tools for managing the yarn-session better

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 1.1.0
• Component/s: Deployment / YARN
• Assignee: Unassigned
• Reporter: Niels Basjes
• Created: 25/Aug/16 13:35
• Updated: 11/Sep/20 09:22
• Resolved: 11/Sep/20 09:22

Description

There is a script yarn-session.sh which starts an empty JobManager on a Yarn cluster.
Desired improvements:

1. If there is already a yarn-session running then yarn-session does not start a new one (or it kills the old one?). Note that the file with ip/port may exist yet the corresponding JobManager may have been killed in an other way.
2. A script that effectively lets me stop a yarn session and cleanup the file that contains the ip/port of this yarn session and the .flink directory on HDFS.