Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5542

Scheduling of opportunistic containers

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • None
    • None

    Description

      This JIRA groups all efforts related to the scheduling of opportunistic containers.
      It includes the scheduling of opportunistic container through the central RM (YARN-5220), through distributed scheduling (YARN-2877), as well as the scheduling of containers based on actual node utilization (YARN-1011) and the container promotion/demotion (YARN-5085).

      Attachments

        Issue Links

          1.
          Add support for NodeLocal and RackLocal OPPORTUNISTIC requests Sub-task Resolved Abhishek Modi
          2.
          Limit the number of opportunistic container allocated per AM heartbeat Sub-task Resolved Abhishek Modi
          3.
          Simplify opportunistic container parameters and metrics Sub-task Resolved Konstantinos Karanasos
          4.
          Skip dispatching opportunistic containers to nodes whose queue is already full Sub-task Resolved Weiwei Yang
          5.
          Extend Distributed Shell to support launching job with opportunistic containers Sub-task Resolved Weiwei Yang
          6.
          Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started Sub-task Resolved Weiwei Yang
          7.
          Fix logging for preemption of Opportunistic containers for Guaranteed containers. Sub-task Resolved Abhishek Modi
          8.
          Add metrics for queued opportunistic and guaranteed containers. Sub-task Resolved Abhishek Modi
          9.
          Handle missing scheduler events in Opportunistic Scheduler. Sub-task Resolved Abhishek Modi
          10.
          Opportunistic containers should not be scheduled on Decommissioning nodes. Sub-task Resolved Abhishek Modi
          11.
          Add Opportunistic Scheduler metrics in ResourceManager. Sub-task Resolved Abhishek Modi
          12.
          Fix Opportunistic Scheduling for node local allocations. Sub-task Resolved Abhishek Modi
          13.
          Remove hard coded sleep from Opportunistic Scheduler tests. Sub-task Resolved Abhishek Modi
          14.
          Add container allocation latency for Opportunistic Scheduler Sub-task Resolved Abhishek Modi
          15.
          Efficient allocation of Opportunistic containers. Sub-task Resolved Abhishek Modi
          16.
          Make TestOpportunisticContainerAllocatorAMService more resilient. Sub-task Resolved Abhishek Modi
          17.
          Refactor OpportunisticContainerAllocator Sub-task Resolved Abhishek Modi
          18.
          Remove unused function from OpportunisticContainerAllocatorAMService Sub-task Resolved Abhishek Modi

          Activity

            People

              Unassigned Unassigned
              kkaranasos Konstantinos Karanasos
              Votes:
              0 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: