Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2877 Extend YARN to support distributed scheduling
  3. YARN-2882

Add an OPPORTUNISTIC ExecutionType

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha1
    • nodemanager
    • None
    • Reviewed

    Description

      This JIRA introduces the notion of container types.
      We propose two initial types of containers: guaranteed-start and queueable containers.
      Guaranteed-start are the existing containers, which are allocated by the central RM and are instantaneously started, once allocated.
      Queueable is a new type of container, which allows containers to be queued in the NM, thus their execution may be arbitrarily delayed.

      Attachments

        1. yarn-2882.patch
          50 kB
          Konstantinos Karanasos
        2. YARN-2882-yarn-2877.001.patch
          44 kB
          Konstantinos Karanasos
        3. YARN-2882-yarn-2877.002.patch
          44 kB
          Arun Suresh
        4. YARN-2882-yarn-2877.003.patch
          44 kB
          Konstantinos Karanasos
        5. YARN-2882-yarn-2877.004.patch
          35 kB
          Konstantinos Karanasos
        6. YARN-2882.005.patch
          19 kB
          Íñigo Goiri

        Issue Links

          blocks

          Sub-task - The sub-task of the issue YARN-2885 Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. YARN-2877 Extend YARN to support distributed scheduling

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-1014 Configure OOM Killer to kill OPPORTUNISTIC containers first

          • Major - Major loss of function.
          • Resolved
          breaks

          Bug - A problem which impairs or prevents the functions of the product. SLIDER-1130 Hadoop 2.8 YARN changes have broken slider

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-5184 Fix up incompatible changes introduced on ContainerStatus and NodeReport

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue YARN-1013 CS should watch resource utilization of containers and allocate speculative containers if appropriate

          • Major - Major loss of function.
          • Open
          is required by

          Sub-task - The sub-task of the issue YARN-4335 Allow ResourceRequests to specify ExecutionType of a request ask

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. YARN-5220 Scheduling of OPPORTUNISTIC containers through YARN RM

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-3116 [Collector wireup] We need an assured way to determine if a container is an AM container on NM

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-5171 Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. YARN-5541 Handling of opportunistic containers in the NM

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. YARN-10768 Preserve Opportunistic Containers when "findLostContainer"

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. YARN-5130 Mark ContainerStatus and NodeReport as evolving

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Patch Available

          Activity

            People

              kkaranasos Konstantinos Karanasos
              kkaranasos Konstantinos Karanasos
              Votes:
              0 Vote for this issue
              Watchers:
              29 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: