Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-9013

Document yarn.containers.vcores only being effective when adapting YARN config

    Details

      Description

      Even after specifying yarn.containers.vcores and having Flink request such a container from YARN, it may not take these into account at all and return a container with 1 vcore.

      The YARN configuration needs to be adapted to take the vcores into account, e.g. by setting the FairScheduler in yarn-site.xml:

      <property>
        <name>yarn.resourcemanager.scheduler.class&lt;/name>
        <value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler</value>
      </property>
      

      This fact should be documented at least at the configuration parameter documentation of yarn.containers.vcores.

        Attachments

          Activity

            People

            • Assignee:
              dawidwys Dawid Wysakowicz
              Reporter:
              NicoK Nico Kruber
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: