Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3611 Support Docker Containers In LinuxContainerExecutor
  3. YARN-4578

Directories that are mounted in docker containers need to be more restrictive/container-specific

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha1
    • yarn

    Description

      Currently, the "top level" log and local directories are mounted inside docker containers (see below for an example). This is not restrictive enough - we need to ensure that only container specific directories are mounted.

      /dev/sda4 on /grid/0/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sda4 on /grid/0/hadoop/yarn/local/usercache/root/appcache/application_1451931954322_0020/container_e50_1451931954322_0020_01_000002 type ext4 (rw,relatime,data=ordered)
      /dev/sda4 on /grid/0/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      /dev/sdb1 on /grid/1/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sdb1 on /grid/1/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      /dev/sdc1 on /grid/2/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sdc1 on /grid/2/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      /dev/sdd1 on /grid/3/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sdd1 on /grid/3/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      /dev/sde1 on /grid/4/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sde1 on /grid/4/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      /dev/sdf1 on /grid/5/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sdf1 on /grid/5/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      

      Attachments

        1. YARN-4578.001.patch
          12 kB
          Sidharta Seethana
        2. YARN-4578.002.patch
          12 kB
          Sidharta Seethana

        Activity

          People

            sidharta-s Sidharta Seethana
            sidharta-s Sidharta Seethana
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: