Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5542

Scheduling of opportunistic containers

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: None
    • Labels:
      None

      Description

      This JIRA groups all efforts related to the scheduling of opportunistic containers.
      It includes the scheduling of opportunistic container through the central RM (YARN-5220), through distributed scheduling (YARN-2877), as well as the scheduling of containers based on actual node utilization (YARN-1011) and the container promotion/demotion (YARN-5085).

        Attachments

          Issue Links

          1.
          Add support for NodeLocal and RackLocal OPPORTUNISTIC requests Sub-task Resolved Abhishek Modi
          2.
          Limit the number of opportunistic container allocated per AM heartbeat Sub-task Resolved Abhishek Modi
          3.
          Simplify opportunistic container parameters and metrics Sub-task Resolved Konstantinos Karanasos
          4.
          Skip dispatching opportunistic containers to nodes whose queue is already full Sub-task Resolved Weiwei Yang
          5.
          Extend Distributed Shell to support launching job with opportunistic containers Sub-task Resolved Weiwei Yang
          6.
          Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started Sub-task Resolved Weiwei Yang
          7.
          Fix logging for preemption of Opportunistic containers for Guaranteed containers. Sub-task Resolved Abhishek Modi
          8.
          Add metrics for queued opportunistic and guaranteed containers. Sub-task Resolved Abhishek Modi
          9.
          Handle missing scheduler events in Opportunistic Scheduler. Sub-task Resolved Abhishek Modi
          10.
          Opportunistic containers should not be scheduled on Decommissioning nodes. Sub-task Resolved Abhishek Modi
          11.
          Add Opportunistic Scheduler metrics in ResourceManager. Sub-task Resolved Abhishek Modi
          12.
          Fix Opportunistic Scheduling for node local allocations. Sub-task Resolved Abhishek Modi
          13.
          Remove hard coded sleep from Opportunistic Scheduler tests. Sub-task Resolved Abhishek Modi
          14.
          Add container allocation latency for Opportunistic Scheduler Sub-task Resolved Abhishek Modi
          15.
          Efficient allocation of Opportunistic containers. Sub-task Resolved Abhishek Modi
          16.
          Make TestOpportunisticContainerAllocatorAMService more resilient. Sub-task Resolved Abhishek Modi
          17.
          Refactor OpportunisticContainerAllocator Sub-task Resolved Abhishek Modi
          18.
          Remove unused function from OpportunisticContainerAllocatorAMService Sub-task Resolved Abhishek Modi

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                kkaranasos Konstantinos Karanasos
              • Votes:
                0 Vote for this issue
                Watchers:
                18 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: