[FLINK-16658] Wire the EmbeddedExecutor to the StandaloneJobClusterEntryPoint.

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.10.0
• Fix Version/s: 1.11.0
• Component/s: Client / Job Submission
• Labels: pull-request-available
• Assignee: Kostas Kloudas
• Reporter: Kostas Kloudas
• Created: 18/Mar/20 13:29
• Updated: 11/Jun/20 07:30
• Resolved: 21/Apr/20 09:20

Description

This will replace the current logic of job execution in the StandaloneJobClusterEntryPoint with one that uses the newly introduced EmbeddedExecutor.

Currently, the ClassPathJobGraphRetriever is the one that "discovers" the user's main in the classpath of the JobMaster, and it extracts the JobGraph from that using the PackagedProgramUtils which highjack the env.execute() method. With this change, we will actually run the main() on the JobMaster, conceptually, the same way we execute user programs from the CLI.

Issue Links

• Dependency: FLINK-16655 Introduce the EmbeddedExecutor for executing the main() on the Dispatcher
• is related to: FLINK-16560 Forward Configuration in PackagedProgramUtils#getPipelineFromProgram
• links to: GitHub Pull Request #11696
• links to: GitHub Pull Request #11811