Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5388

Deprecate and remove DockerContainerExecutor

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha2
    • nodemanager
    • None
    • Incompatible change, Reviewed
    • DockerContainerExecutor is deprecated starting 2.9.0 and removed from 3.0.0. Please use LinuxContainerExecutor with the DockerRuntime to run Docker containers on YARN clusters.

    Description

      Because the DockerContainerExecuter overrides the writeLaunchEnv() method, it must also have the wildcard processing logic from YARN-4958/YARN-5373 added to it. Without it, the use of -libjars will fail unless wildcarding is disabled.

      Attachments

        1. YARN-5388.branch-2.001.patch
          4 kB
          Daniel Templeton
        2. YARN-5388.001.patch
          57 kB
          Daniel Templeton
        3. YARN-5388.002.patch
          58 kB
          Daniel Templeton
        4. YARN-5388.branch-2.002.patch
          5 kB
          Daniel Templeton
        5. YARN-5388.003.patch
          68 kB
          Daniel Templeton
        6. YARN-5388.branch-2.003.patch
          6 kB
          Daniel Templeton

        Issue Links

          depends upon

          Bug - A problem which impairs or prevents the functions of the product. YARN-5373 NPE listing wildcard directory in containerLaunch

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6719 The list of -libjars archives should be replaced with a wildcard in the distributed cache to reduce the application footprint in the state store

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-4958 The file localization process should allow for wildcards to reduce the application footprint in the state store

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          supercedes

          New Feature - A new feature of the product, which has yet to be developed. YARN-1964 Create Docker analog of the LinuxContainerExecutor in YARN

          • Major - Major loss of function.
          • Closed

          Activity

            People

              templedf Daniel Templeton
              templedf Daniel Templeton
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: