[FLINK-17973] Test memory configuration of Flink cluster

• Type: Sub-task
• Status: Closed
• Priority: Critical
• Resolution: Done
• Affects Version/s: 1.11.0
• Fix Version/s: 1.11.0
• Component/s: Runtime / Coordination, Tests
• Labels: release-testing
• Assignee: Chesnay Schepler
• Reporter: Till Rohrmann
• Created: 27/May/20 13:16
• Updated: 17/Jun/20 13:22
• Resolved: 17/Jun/20 13:22

Description

Make sure that Flink processes (in particular Master processes) fail with a meaningful exception message if they exceed the configured memory budgets.

Issue Links

• is a parent of: FLINK-18189 Incorrect size check for sum of heap/non-heap memory
• is a parent of: FLINK-18217 config.sh#extractExecutionResults does not fail on wrong input
• is a parent of: FLINK-18152 Master starts despite IllegalConfigurationException
• is a parent of: FLINK-18154 Unhelpful error message if heap.size takes up signficant portion of process.size
• is a parent of: FLINK-18156 Misleading error message if derived JVM overhead is too small
• is a parent of: FLINK-18157 Jobstore size check compares against offHeapMemory
• is a parent of: FLINK-18190 Document implications on derived memory values when configuring meta space
• is a parent of: FLINK-18214 Incorrect warning if jobstore.cache-size exceeds heap size
• is a parent of: FLINK-18215 BashJavaUtils logging message should include log level
• is a parent of: FLINK-18175 Add human readable summary for configured and derived memory sizes.
• is a parent of: FLINK-18188 Document asymmetric allocation of Flink memory
• is related to: FLINK-18153 flink-daemon does not detect errors if JVM crashes immediately
• is related to: FLINK-13980 FLIP-49 Unified Memory Configuration for TaskExecutors
• is related to: FLINK-16614 FLIP-116 Unified Memory Configuration for Job Manager
• is related to: FLINK-18219 Improve exception if jar submission hits OOM
• is related to: FLINK-18220 Improve exception if finalizeOnmaster hits OOM