Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-16614 FLIP-116 Unified Memory Configuration for Job Manager
  3. FLINK-16745

Use JobManagerProcessUtils to start JM container and pass JVM memory args

    XMLWordPrintableJSON

    Details

      Description

      JobManagerProcessUtils#processSpecFromConfig should be used to get JobManagerProcessSpec. Then JobManagerProcessSpec can be passed to ProcessMemoryUtils#generateJvmParametersStr to get JVM memory arg list string.

      The configuration should be fixed to fallback to JobManagerOptions.TOTAL_PROCESS_MEMORY if a legacy option is set (JobManagerProcessUtils#getConfigurationWithLegacyHeapSizeMappedToNewConfigOption) before passing it to JobManagerProcessUtils#processSpecFromConfig.

      Then the JVM memory arg list can be used to start the JM container in Yarn/Kubernetes active RMs instead of using the existing legacy heap options: `jobmanager.heap.size` (or `jobmanager.heap.mb`) and container cut-off options: `containerized.heap-cutoff-ratio` and `containerized.heap-cutoff-min`.

      Remove container cut-off options: `containerized.heap-cutoff-ratio` and `containerized.heap-cutoff-min`

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                azagrebin Andrey Zagrebin
                Reporter:
                azagrebin Andrey Zagrebin
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: