[FLINK-18175] Add human readable summary for configured and derived memory sizes.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.10.1, 1.11.0
• Fix Version/s: 1.11.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Chesnay Schepler
• Reporter: Xintong Song
• Created: 08/Jun/20 07:47
• Updated: 12/Jun/20 12:15
• Resolved: 12/Jun/20 12:15

Description

FLIP-49 & FLIP-116 introduces sophisticated memory configurations for TaskManager and Master processes. Before the JVM processes are started, Flink derives the accurate sizes for all necessary components, based on both explicit user configurations and implicit defaults.

To make the configuration results (especially those implicitly derived) clear to users, it would be helpful to print them in the beginning of the process logs. Currently, we only have printed JVM parameters (TM & Master) dynamic memory configurations (TM only). They are incomplete (jvm overhead for both processes and off-heap memory for the master process are not presented) and unfriendly (in bytes).

Therefore, I propose to add a human readable summary at the beginning of process logs.

See also this PR discussion.

Issue Links

• is a child of: FLINK-17973 Test memory configuration of Flink cluster
• links to: GitHub Pull Request #12533