Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3611 Support Docker Containers In LinuxContainerExecutor
  3. YARN-4578

Directories that are mounted in docker containers need to be more restrictive/container-specific

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: yarn
    • Labels:

      Description

      Currently, the "top level" log and local directories are mounted inside docker containers (see below for an example). This is not restrictive enough - we need to ensure that only container specific directories are mounted.

      /dev/sda4 on /grid/0/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sda4 on /grid/0/hadoop/yarn/local/usercache/root/appcache/application_1451931954322_0020/container_e50_1451931954322_0020_01_000002 type ext4 (rw,relatime,data=ordered)
      /dev/sda4 on /grid/0/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      /dev/sdb1 on /grid/1/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sdb1 on /grid/1/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      /dev/sdc1 on /grid/2/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sdc1 on /grid/2/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      /dev/sdd1 on /grid/3/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sdd1 on /grid/3/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      /dev/sde1 on /grid/4/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sde1 on /grid/4/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      /dev/sdf1 on /grid/5/hadoop/yarn/local type ext4 (rw,relatime,data=ordered)
      /dev/sdf1 on /grid/5/hadoop/yarn/log type ext4 (rw,relatime,data=ordered)
      

        Attachments

        1. YARN-4578.002.patch
          12 kB
          Sidharta Seethana
        2. YARN-4578.001.patch
          12 kB
          Sidharta Seethana

          Activity

            People

            • Assignee:
              sidharta-s Sidharta Seethana
              Reporter:
              sidharta-s Sidharta Seethana
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: