[FLINK-8872] Yarn detached mode via -yd does not detach

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Fix Version/s: 1.5.0
• Component/s: Command Line Client, Deployment / YARN
• Labels: flip-6
• Assignee: Nico Kruber
• Reporter: Nico Kruber
• Created: 05/Mar/18 17:02
• Updated: 13/Apr/18 19:20
• Resolved: 13/Apr/18 19:19

Description

Running yarn per-job cluster in detached mode currently does not work and waits for the job to finish.

Example:

./bin/flink run -m yarn-cluster -yn 10 -yjm 768 -ytm 3072 -ys 2 -yd -p 20 -c org.apache.flink.streaming.examples.wordcount.WordCount ./examples/streaming/WordCount.jar --input

Output in case of an infinite program would then end with something like this:

2018-03-05 13:41:23,311 INFO  org.apache.flink.yarn.AbstractYarnClusterDescriptor           - Waiting for the cluster to be allocated
2018-03-05 13:41:23,313 INFO  org.apache.flink.yarn.AbstractYarnClusterDescriptor           - Deploying cluster, current state ACCEPTED
2018-03-05 13:41:28,342 INFO  org.apache.flink.yarn.AbstractYarnClusterDescriptor           - YARN application has been deployed successfully.
2018-03-05 13:41:28,343 INFO  org.apache.flink.yarn.AbstractYarnClusterDescriptor           - The Flink YARN client has been started in detached mode. In order to stop Flink on YARN, use the following command or a YARN web interface to stop it:
yarn application -kill application_1519984124671_0006
Please also note that the temporary files of the YARN session in the home directoy will not be removed.
Starting execution of program

Issue Links

• links to: GitHub Pull Request #5672