Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-8930

CGroup-based strict container memory enforcement does not work with CGroupElasticMemoryController

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.2.0
    • Fix Version/s: 3.3.0
    • Component/s: nodemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When yarn.nodemanger.resource.memory.enforced is set to true with memory cgroup turned on, (aka strict memory enforcement), containers monitor relies on the under_oom status read from the container cgroup's memory.oom_control file.

      However, when the root yarn container cgroup is under oom (e.g. when the node is overallocating iteself), the under_oom status is set for all yarn containers regardless of whether each individual container has run over its memory limit.

      What essentially happens is that whenever the root cgroup is under oom, all yarn containers are killed.

        Attachments

        1. YARN-8930.01.patch
          17 kB
          Haibo Chen
        2. YARN-8930.00.patch
          15 kB
          Haibo Chen

          Activity

            People

            • Assignee:
              haibochen Haibo Chen
              Reporter:
              haibochen Haibo Chen
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: