Hadoop YARN
  1. Hadoop YARN
  2. YARN-1964

Create Docker analog of the LinuxContainerExecutor in YARN

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.6.0
    • Component/s: None
    • Labels:
      None

      Description

      Docker (https://www.docker.io/) is, increasingly, a very popular container technology.

      In context of YARN, the support for Docker will provide a very elegant solution to allow applications to package their software into a Docker container (entire Linux file system incl. custom versions of perl, python etc.) and use it as a blueprint to launch all their YARN containers with requisite software environment. This provides both consistency (all YARN containers will have the same software environment) and isolation (no interference with whatever is installed on the physical machine).

      1. YARN-1964.patch
        69 kB
        Abin Shahab
      2. YARN-1964.patch
        68 kB
        Abin Shahab
      3. YARN-1964.patch
        68 kB
        Abin Shahab
      4. YARN-1964.patch
        68 kB
        Abin Shahab
      5. YARN-1964.patch
        63 kB
        Abin Shahab
      6. YARN-1964.patch
        63 kB
        Abin Shahab
      7. YARN-1964.patch
        61 kB
        Abin Shahab
      8. YARN-1964.patch
        59 kB
        Abin Shahab
      9. YARN-1964.patch
        62 kB
        Abin Shahab
      10. YARN-1964.patch
        61 kB
        Abin Shahab
      11. YARN-1964.patch
        60 kB
        Abin Shahab
      12. yarn-1964-branch-2.2.0-docker.patch
        19 kB
        Abin Shahab
      13. yarn-1964-branch-2.2.0-docker.patch
        18 kB
        Abin Shahab
      14. yarn-1964-docker.patch
        27 kB
        Abin Shahab
      15. yarn-1964-docker.patch
        27 kB
        Abin Shahab
      16. yarn-1964-docker.patch
        32 kB
        Abin Shahab
      17. yarn-1964-docker.patch
        18 kB
        Abin Shahab
      18. yarn-1964-docker.patch
        18 kB
        Abin Shahab

        Issue Links

          Activity

          Arun C Murthy created issue -
          Arun C Murthy made changes -
          Field Original Value New Value
          Assignee Arun C Murthy [ acmurthy ]
          Arun C Murthy made changes -
          Assignee Abin Shahab [ ashahab ]
          Abin Shahab made changes -
          Status Open [ 1 ] In Progress [ 3 ]
          Abin Shahab made changes -
          Status In Progress [ 3 ] Patch Available [ 10002 ]
          Affects Version/s 2.2.0 [ 12325051 ]
          Abin Shahab made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Abin Shahab made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Abin Shahab made changes -
          Attachment yarn-1964-branch-2.2.0-docker.patch [ 12641778 ]
          Abin Shahab made changes -
          Attachment yarn-1964-docker.patch [ 12641805 ]
          jay vyas made changes -
          Summary Support Docker containers in YARN Create Docker analog of the LinuxContainerExecutor in YARN
          Abin Shahab made changes -
          Attachment yarn-1964-branch-2.2.0-docker.patch [ 12641977 ]
          Abin Shahab made changes -
          Attachment yarn-1964-docker.patch [ 12641983 ]
          Abin Shahab made changes -
          Attachment yarn-1964-docker.patch [ 12642187 ]
          Abin Shahab made changes -
          Attachment yarn-1964-docker.patch [ 12642188 ]
          Abin Shahab made changes -
          Attachment yarn-1964-docker.patch [ 12642267 ]
          Dinesh Subhraveti made changes -
          Link This issue is related to YARN-2140 [ YARN-2140 ]
          Abin Shahab made changes -
          Link This issue incorporates YARN-2466 [ YARN-2466 ]
          Abin Shahab made changes -
          Link This issue incorporates YARN-2466 [ YARN-2466 ]
          Abin Shahab made changes -
          Link This issue is part of YARN-2466 [ YARN-2466 ]
          Allen Wittenauer made changes -
          Comment [ Pull-request on git: https://github.com/apache/hadoop/pull/2(comments are welcome). ]
          Abin Shahab made changes -
          Attachment YARN-1964.patch [ 12671475 ]
          Abin Shahab made changes -
          Status Patch Available [ 10002 ] In Progress [ 3 ]
          Abin Shahab made changes -
          Status In Progress [ 3 ] Patch Available [ 10002 ]
          Abin Shahab made changes -
          Attachment YARN-1964.patch [ 12671739 ]
          Abin Shahab made changes -
          Attachment YARN-1964.patch [ 12672275 ]
          Abin Shahab made changes -
          Attachment YARN-1964.patch [ 12672747 ]
          Abin Shahab made changes -
          Attachment YARN-1964.patch [ 12675937 ]
          Abin Shahab made changes -
          Attachment YARN-1964.patch [ 12677620 ]
          Abin Shahab made changes -
          Attachment YARN-1964.patch [ 12677719 ]
          Abin Shahab made changes -
          Attachment YARN-1964.patch [ 12680305 ]
          Abin Shahab made changes -
          Attachment YARN-1964.patch [ 12680359 ]
          Abin Shahab made changes -
          Attachment YARN-1964.patch [ 12680823 ]
          Abin Shahab made changes -
          Attachment YARN-1964.patch [ 12680880 ]
          Ravi Prakash made changes -
          Assignee Abin Shahab [ ashahab ] Ravi Prakash [ raviprak ]
          Ravi Prakash made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 2.6.0 [ 12327197 ]
          Resolution Fixed [ 1 ]
          Arun C Murthy made changes -
          Assignee Ravi Prakash [ raviprak ] Abin Shahab [ ashahab ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Beckham007 made changes -
          Link This issue relates to YARN-3080 [ YARN-3080 ]
          Ravi Prakash made changes -
          Assignee Abin Shahab [ ashahab ] Ravi Prakash [ raviprak ]
          Ravi Prakash made changes -
          Assignee Ravi Prakash [ raviprak ] Abin Shahab [ ashahab ]
          Vinod Kumar Vavilapalli made changes -
          Link This issue relates to YARN-1983 [ YARN-1983 ]

            People

            • Assignee:
              Abin Shahab
              Reporter:
              Arun C Murthy
            • Votes:
              11 Vote for this issue
              Watchers:
              98 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development