Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-16734

Remove ClusterSpecification

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Reopened
    • Not a Priority
    • Resolution: Unresolved
    • None
    • None
    • Command Line Client
    • None

    Description

      Currently, ClusterSpecification has the following three fields.

      • masterMemoryMB
      • taskManagerMemoryMB
      • slotsPerTaskManager

      Among the three fields, taskManagerMemoryMB is only used in YarnClusterDescriptor#validateClusterResources. It can be replaced by "taskmanager.memory.process.size" in the configuration. Moreover, there are consistency risks for keeping the process memory in two places with different precision (MB vs. MemorySize).

      masterMemoryMB should be the same as taskManagerMemoryMB after finishing FLIP-116 Unified Memory Configuration for Job Managers.

      That leaves only slotsPerTaskManager, which can easily get from the configuration.

      Attachments

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-16614 FLIP-116 Unified Memory Configuration for Job Manager

          • Major - Major loss of function.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-16733 Refactor YarnClusterDescriptor

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              Unassigned Unassigned
              xtsong Xintong Song
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: