Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2877 Extend YARN to support distributed scheduling
  3. YARN-2883

Queuing of container requests in the NM

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      We propose to add a queue in each NM, where queueable container requests can be held.
      Based on the available resources in the node and the containers in the queue, the NM will decide when to allow the execution of a queued container.
      In order to ensure the instantaneous start of a guaranteed-start container, the NM may decide to pre-empt/kill running queueable containers.

      Attachments

        1. YARN-2883.015.patch
          97 kB
          Konstantinos Karanasos
        2. YARN-2883.014.patch
          98 kB
          Konstantinos Karanasos
        3. YARN-2883.013.patch
          99 kB
          Arun Suresh
        4. YARN-2883-trunk.013.patch
          99 kB
          Arun Suresh
        5. YARN-2883-trunk.012.patch
          98 kB
          Konstantinos Karanasos
        6. YARN-2883-trunk.011.patch
          89 kB
          Konstantinos Karanasos
        7. YARN-2883-trunk.010.patch
          88 kB
          Konstantinos Karanasos
        8. YARN-2883-trunk.009.patch
          96 kB
          Konstantinos Karanasos
        9. YARN-2883-trunk.008.patch
          106 kB
          Arun Suresh
        10. YARN-2883-trunk.007.patch
          107 kB
          Konstantinos Karanasos
        11. YARN-2883-trunk.006.patch
          104 kB
          Konstantinos Karanasos
        12. YARN-2883-trunk.005.patch
          104 kB
          Konstantinos Karanasos
        13. YARN-2883-trunk.004.patch
          114 kB
          Konstantinos Karanasos
        14. YARN-2883-yarn-2877.004.patch
          110 kB
          Konstantinos Karanasos
        15. YARN-2883-yarn-2877.003.patch
          108 kB
          Konstantinos Karanasos
        16. YARN-2883-yarn-2877.002.patch
          80 kB
          Konstantinos Karanasos
        17. YARN-2883-yarn-2877.001.patch
          61 kB
          Konstantinos Karanasos

        Issue Links

          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. YARN-4895 Add subtractFrom method to ResourceUtilization class

          • Major - Major loss of function.
          • Resolved
          is required by

          New Feature - A new feature of the product, which has yet to be developed. YARN-5220 Scheduling of OPPORTUNISTIC containers through YARN RM

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-4412 Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-4738 Notify the RM about the status of OPPORTUNISTIC containers

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-5117 QueuingContainerManager does not start GUARANTEED Container even if Resources are available

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-5216 Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-5377 Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. YARN-5541 Handling of opportunistic containers in the NM

          • Major - Major loss of function.
          • Open

          Task - A task that needs to be done. YARN-4861 Define ContainerExitStatus for OPPORTUNISTIC containers that get killed

          • Major - Major loss of function.
          • Open

          Activity

            People

              kkaranasos Konstantinos Karanasos
              kkaranasos Konstantinos Karanasos
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: