[FLINK-18156] Misleading error message if derived JVM overhead is too small

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.11.0
• Fix Version/s: 1.11.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Andrey Zagrebin
• Reporter: Chesnay Schepler
• Created: 05/Jun/20 11:36
• Updated: 09/Jun/20 16:34
• Resolved: 09/Jun/20 14:31

Description

The error message says that the derived size is lower then the configured overhead range, but now such property was configured by the user.

[] - Loading configuration property: jobmanager.memory.process.size, 2000m
[] - Loading configuration property: jobmanager.memory.heap.size, 1500m
Exception in thread "main" org.apache.flink.configuration.IllegalConfigurationException: Derived JVM Overhead size (116.000mb (121634816 bytes)) is not in configured JVM Overhead range [192.000mb (201326592 bytes), 1024.000mb (107374182$        at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.sanityCheckJvmOverhead(ProcessMemoryUtils.java:171)
        at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveJvmMetaspaceAndOverheadFromTotalFlinkMemory(ProcessMemoryUtils.java:148)
        at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.deriveProcessSpecWithExplicitInternalMemory(ProcessMemoryUtils.java:86)
        at org.apache.flink.runtime.util.config.memory.ProcessMemoryUtils.memoryProcessSpecFromConfig(ProcessMemoryUtils.java:71)
        at org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfig(JobManagerProcessUtils.java:76)
        at org.apache.flink.runtime.jobmanager.JobManagerProcessUtils.processSpecFromConfigWithNewOptionToInterpretLegacyHeap(JobManagerProcessUtils.java:71)
        at org.apache.flink.runtime.util.bash.BashJavaUtils.getJmResourceParams(BashJavaUtils.java:92)
        at org.apache.flink.runtime.util.bash.BashJavaUtils.runCommand(BashJavaUtils.java:66)
        at org.apache.flink.runtime.util.bash.BashJavaUtils.main(BashJavaUtils.java:54)

Issue Links

• is a child of: FLINK-17973 Test memory configuration of Flink cluster
• links to: GitHub Pull Request #12548