[FLINK-19379] Submitting job to running YARN session fails

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.11.2
• Component/s: Command Line Client, Deployment / YARN, Documentation
• Labels: auto-unassigned usability
• Assignee: Unassigned
• Reporter: Robert Metzger
• Created: 23/Sep/20 12:08
• Updated: 10/Aug/21 18:13
• Resolved: 10/Aug/21 18:13

Description

Steps to reproduce:

1. start a YARN session
2. submit a job using: ./bin/flink run -t yarn-session -yid application_1600852002161_0003, where application_1600852002161_0003 is the id of the session started in 1.

Expected behavior: submit job to running session.
Actual behavior: Fails with this unhelpful exception:

org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: null
        at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:302)
        at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:198)
        at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:149)
        at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:699)
        at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:232)
        at org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:916)
        at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:992)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893)
        at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
        at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:992)
Caused by: java.lang.IllegalStateException
        at org.apache.flink.util.Preconditions.checkState(Preconditions.java:179)
        at org.apache.flink.client.deployment.executors.AbstractSessionClusterExecutor.execute(AbstractSessionClusterExecutor.java:61)
        at org.apache.flink.api.java.ExecutionEnvironment.executeAsync(ExecutionEnvironment.java:973)
        at org.apache.flink.client.program.ContextEnvironment.executeAsync(ContextEnvironment.java:124)
        at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:72)
        at com.ververica.TPCHQuery3.main(TPCHQuery3.java:184)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:288)
        ... 11 more

Issue Links

• is related to: FLINK-22585 Add deprecated message when "-m yarn-cluster" is used