[FLINK-10720] Add stress deployment end-to-end test

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.7.0
• Fix Version/s: 1.7.0
• Component/s: Test Infrastructure
• Labels: pull-request-available
• Assignee: Stefan Richter
• Reporter: Till Rohrmann
• Created: 29/Oct/18 21:48
• Updated: 06/Nov/18 16:27
• Resolved: 06/Nov/18 16:27

Description

In order to test Flink's scalability, I suggest to add an end-to-end test which tests the deployment of a job which is very demanding. The job should have large TaskDeploymentDescriptors (e.g. a job using union state or having a high degree of parallelism). That way we can test that the serialization overhead of the TDDs does not affect the health of the cluster (e.g. heartbeats are not affected because the serialization does not happen in the main thread).

Issue Links

• links to: GitHub Pull Request #6994