[FLINK-7285] allow submission of big job graphs

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 1.4.0
• Component/s: Runtime / Coordination, Runtime / Network
• Assignee: Nico Kruber
• Reporter: Nico Kruber
• Created: 27/Jul/17 15:34
• Updated: 25/Oct/19 09:48
• Resolved: 25/Oct/19 09:48

Description

In order to support submission of big job graphs, i.e. from user programs with a lot of code that does not fit into akka.framesize, we could try to store the JobGraph in the BlobServer.

Note that in the communication between the job and task managers, we also need the offloading of the TaskDeploymentDescriptor (FLINK-6046) to complete this feature.

Issue Links

• is related to: FLINK-6916 FLIP-19: Improved BLOB storage architecture