Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1964

Create Docker analog of the LinuxContainerExecutor in YARN

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.2.0
    • 2.6.0
    • None

    Description

      This alpha feature has been deprecated in branch-2 and removed from trunk Please see https://issues.apache.org/jira/browse/YARN-5388

      Docker (https://www.docker.io/) is, increasingly, a very popular container technology.

      In context of YARN, the support for Docker will provide a very elegant solution to allow applications to package their software into a Docker container (entire Linux file system incl. custom versions of perl, python etc.) and use it as a blueprint to launch all their YARN containers with requisite software environment. This provides both consistency (all YARN containers will have the same software environment) and isolation (no interference with whatever is installed on the physical machine).

      Attachments

        1. yarn-1964-docker.patch
          18 kB
          Abin Shahab
        2. yarn-1964-docker.patch
          18 kB
          Abin Shahab
        3. yarn-1964-docker.patch
          32 kB
          Abin Shahab
        4. yarn-1964-docker.patch
          27 kB
          Abin Shahab
        5. yarn-1964-docker.patch
          27 kB
          Abin Shahab
        6. yarn-1964-branch-2.2.0-docker.patch
          18 kB
          Abin Shahab
        7. yarn-1964-branch-2.2.0-docker.patch
          19 kB
          Abin Shahab
        8. YARN-1964.patch
          60 kB
          Abin Shahab
        9. YARN-1964.patch
          61 kB
          Abin Shahab
        10. YARN-1964.patch
          62 kB
          Abin Shahab
        11. YARN-1964.patch
          59 kB
          Abin Shahab
        12. YARN-1964.patch
          61 kB
          Abin Shahab
        13. YARN-1964.patch
          63 kB
          Abin Shahab
        14. YARN-1964.patch
          63 kB
          Abin Shahab
        15. YARN-1964.patch
          68 kB
          Abin Shahab
        16. YARN-1964.patch
          68 kB
          Abin Shahab
        17. YARN-1964.patch
          68 kB
          Abin Shahab
        18. YARN-1964.patch
          69 kB
          Abin Shahab

        Issue Links

          is part of

          New Feature - A new feature of the product, which has yet to be developed. YARN-2466 Umbrella issue for Yarn launched Docker Containers

          • Major - Major loss of function.
          • Resolved
          is related to

          New Feature - A new feature of the product, which has yet to be developed. YARN-2140 Add support for network IO isolation/scheduling for containers

          • Major - Major loss of function.
          • Open
          is superceded by

          Bug - A problem which impairs or prevents the functions of the product. YARN-5388 Deprecate and remove DockerContainerExecutor

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-3080 The DockerContainerExecutor could not write the right pid to container pidFile

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. YARN-1983 Support heterogeneous container types at runtime on YARN

          • Major - Major loss of function.
          • Open
          links to

          Web Link GitHub Pull Request #6

          Web Link GitHub Pull Request #6

          Web Link GitHub Pull Request #7

          Web Link GitHub Pull Request #7

          Activity

            People

              ashahab Abin Shahab
              acmurthy Arun Murthy
              Votes:
              11 Vote for this issue
              Watchers:
              97 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: