Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6433

Only accessible cgroup mount directories should be selected for a controller

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha4
    • 2.9.0, 3.0.0-alpha4
    • nodemanager
    • None
    • Reviewed

    Description

      I have a Ubuntu16 box that returns the following error with pre-mounted cgroups on the latest trunk:

      2017-04-03 19:42:18,511 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.CGroupsHandlerImpl: Cgroups not accessible /run/lxcfs/controllers/cpu,cpuacct
      

      The version is:

      $ uname -a
      Linux mybox 4.4.0-24-generic #43-Ubuntu SMP Wed Jun 8 19:27:37 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
      

      The following cpu cgroup filesystems are mounted:

      $ grep cpuacct /etc/mtab
      cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct,nsroot=/ 0 0
      cpu,cpuacct /run/lxcfs/controllers/cpu,cpuacct cgroup rw,relatime,cpu,cpuacct,nsroot=/ 0 0
      

      /sys/fs/cgroup is accessible to my yarn user, so it should be selected instead of /run/lxcfs/controllers

      Attachments

        1. YARN-6433.000.patch
          3 kB
          Miklos Szegedi
        2. YARN-6433.001.patch
          3 kB
          Miklos Szegedi
        3. YARN-6433.002.patch
          3 kB
          Miklos Szegedi

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            miklos.szegedi@cloudera.com Miklos Szegedi
            miklos.szegedi@cloudera.com Miklos Szegedi
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment