Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5542

Scheduling of opportunistic containers

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      This JIRA groups all efforts related to the scheduling of opportunistic containers.
      It includes the scheduling of opportunistic container through the central RM (YARN-5220), through distributed scheduling (YARN-2877), as well as the scheduling of containers based on actual node utilization (YARN-1011) and the container promotion/demotion (YARN-5085).

        Attachments

          Issue Links

          1.
          Make allocation of opportunistic containers asynchronous Sub-task Open Abhishek Modi
          2.
          Integrate NodeQueueLoadMonitor with ClusterNodeTracker Sub-task Open Abhishek Modi
          3.
          Estimating waiting time in NM container queues Sub-task Open Konstantinos Karanasos
          4.
          Add support for NodeLocal and RackLocal OPPORTUNISTIC requests Sub-task Resolved Abhishek Modi
          5.
          Limit the number of opportunistic container allocated per AM heartbeat Sub-task Resolved Abhishek Modi
          6.
          Simplify opportunistic container parameters and metrics Sub-task Resolved Konstantinos Karanasos
          7.
          Skip dispatching opportunistic containers to nodes whose queue is already full Sub-task Resolved Weiwei Yang
          8.
          Fix some minor typos in the opportunistic container logging Sub-task Patch Available Weiwei Yang
          9.
          Extend Distributed Shell to support launching job with opportunistic containers Sub-task Resolved Weiwei Yang
          10.
          Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started Sub-task Resolved Weiwei Yang
          11.
          Fix logging for preemption of Opportunistic containers for Guaranteed containers. Sub-task Resolved Abhishek Modi
          12.
          Add metrics for queued opportunistic and guaranteed containers. Sub-task Resolved Abhishek Modi
          13.
          Add support for configurable Resource Calculator in Opportunistic Scheduler. Sub-task Patch Available Abhishek Modi
          14.
          Handle missing scheduler events in Opportunistic Scheduler. Sub-task Resolved Abhishek Modi
          15.
          Opportunistic containers should not be scheduled on Decommissioning nodes. Sub-task Resolved Abhishek Modi
          16.
          Add Opportunistic Scheduler metrics in ResourceManager. Sub-task Resolved Abhishek Modi
          17.
          Fix Opportunistic Scheduling for node local allocations. Sub-task Resolved Abhishek Modi
          18.
          Remove hard coded sleep from Opportunistic Scheduler tests. Sub-task Resolved Abhishek Modi
          19.
          Add container allocation latency for Opportunistic Scheduler Sub-task Resolved Abhishek Modi

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                kkaranasos Konstantinos Karanasos
              • Votes:
                0 Vote for this issue
                Watchers:
                14 Start watching this issue

                Dates

                • Created:
                  Updated: