Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6757

Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.8.1, 3.0.0-alpha4
    • 2.9.0, 3.0.0-beta1
    • nodemanager
    • None

    Description

      We should add the ability to specify a custom cgroup path. This is how the documentation of linux-container-executor.cgroups.mount-path would look like:

          Requested cgroup mount path. Yarn has built in functionality to discover
          the system cgroup mount paths, so use this setting only, if the discovery does not work.
      
          This path must exist before the NodeManager is launched.
          The location can vary depending on the Linux distribution in use.
          Common locations include /sys/fs/cgroup and /cgroup.
      
          If cgroups are not mounted, set yarn.nodemanager.linux-container-executor.cgroups.mount
          to true. In this case it specifies, where the LCE should attempt to mount cgroups if not found.
      
          If cgroups is accessible through lxcfs or some other file system,
          then set this path and yarn.nodemanager.linux-container-executor.cgroups.mount to false.
          Yarn tries to use this path first, before any cgroup mount point discovery.
          If it cannot find this directory, it falls back to searching for cgroup mount points in the system.
          Only used when the LCE resources handler is set to the CgroupsLCEResourcesHandler
      

      Attachments

        1. YARN-6757.005.patch
          39 kB
          Miklos Szegedi
        2. YARN-6757.004.patch
          57 kB
          Miklos Szegedi
        3. YARN-6757.003.patch
          28 kB
          Miklos Szegedi
        4. YARN-6757.002.patch
          28 kB
          Miklos Szegedi
        5. YARN-6757.001.patch
          16 kB
          Yufei Gu
        6. YARN-6757.000.patch
          16 kB
          Miklos Szegedi

        Issue Links

          Activity

            People

              miklos.szegedi@cloudera.com Miklos Szegedi
              miklos.szegedi@cloudera.com Miklos Szegedi
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: