[FLINK-9280] Extend JobSubmitHandler to accept jar files

• Type: New Feature
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.5.0
• Fix Version/s: 1.5.1, 1.6.0
• Component/s: Runtime / Coordination, Runtime / REST
• Labels: pull-request-available
• Assignee: Chesnay Schepler
• Reporter: Chesnay Schepler
• Created: 01/May/18 08:42
• Updated: 28/Feb/19 13:30
• Resolved: 03/Jul/18 19:16

Description

The job submission through the CLI first uploads all require jars to the blob server, sets the blob keys in the jobgraph, and then uploads this graph to The JobSubmitHandler which submits it to the Dispatcher.

This process has the downside that it requires jars to be uploaded to the blobserver before submitting the job graph, which does not happen via REST.

I propose an extension to the the JobSubmitHandler to also accept an optional list of jar files, that were previously uploaded through the JarUploadHandler. If present, the handler would upload these jars to the blobserver and set the blob keys.

Issue Links

• blocks: FLINK-9478 Use Yarn application proxy to communicate with Flink cluster
• links to: GitHub Pull Request #6147
• links to: GitHub Pull Request #6203