[FLINK-33221] Add config options for administrator JVM options

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.19.0
• Component/s: Runtime / Configuration
• Labels: pull-request-available
• Release Note: A set of administrator JVM options are available, which prepend the user-set extra JVM options for platform-wide JVM tuning.
• Assignee: Zhanghao Chen
• Reporter: Zhanghao Chen
• Created: 09/Oct/23 11:41
• Updated: 31/Jan/24 06:23
• Resolved: 22/Jan/24 03:31

Description

We encounter similar issues described in SPARK-23472. Users may need to add JVM options to their Flink applications (e.g. to tune GC options). They typically use env.java.opts.x series of options to do so. We also have a set of administrator JVM options to apply by default, e.g. to enable GC log, tune GC options, etc. Both use cases will need to set the same series of options and will clobber one another.

In the past, we generated and pretended to the administrator JVM options in the Java code for generating the starting command for JM/TM. However, this has been proven to be difficult to maintain.

Therefore, I propose to also add a set of default JVM options for administrator use that prepends the user-set extra JVM options. We can mark the existing env.java.opts.x series as user-set extra JVM options and add a set of new env.java.opts.x.default options for administrator use.

Issue Links

• links to: GitHub Pull Request #24098
• mentioned in: Page Loading...