Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6433

Only accessible cgroup mount directories should be selected for a controller

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha4
    • Fix Version/s: 2.9.0, 3.0.0-alpha4
    • Component/s: nodemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I have a Ubuntu16 box that returns the following error with pre-mounted cgroups on the latest trunk:

      2017-04-03 19:42:18,511 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.CGroupsHandlerImpl: Cgroups not accessible /run/lxcfs/controllers/cpu,cpuacct
      

      The version is:

      $ uname -a
      Linux mybox 4.4.0-24-generic #43-Ubuntu SMP Wed Jun 8 19:27:37 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
      

      The following cpu cgroup filesystems are mounted:

      $ grep cpuacct /etc/mtab
      cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct,nsroot=/ 0 0
      cpu,cpuacct /run/lxcfs/controllers/cpu,cpuacct cgroup rw,relatime,cpu,cpuacct,nsroot=/ 0 0
      

      /sys/fs/cgroup is accessible to my yarn user, so it should be selected instead of /run/lxcfs/controllers

        Attachments

        1. YARN-6433.002.patch
          3 kB
          Miklos Szegedi
        2. YARN-6433.001.patch
          3 kB
          Miklos Szegedi
        3. YARN-6433.000.patch
          3 kB
          Miklos Szegedi

          Issue Links

            Activity

              People

              • Assignee:
                miklos.szegedi@cloudera.com Miklos Szegedi
                Reporter:
                miklos.szegedi@cloudera.com Miklos Szegedi
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: