Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-1011 [Umbrella] Schedule containers based on utilization of currently allocated containers
  3. YARN-4512

Provide a knob to turn on over-allocation

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • nodemanager
    • None
    • Reviewed

    Description

      We need two configs for overallocation - one to specify the threshold upto which it is okay to over-allocate, another to specify the threshold after which OPPORTUNISTIC containers should be preempted.

      Attachments

        1. YARN-4512-YARN-1011.001.patch
          40 kB
          Karthik Kambatla
        2. yarn-4512-yarn-1011.002.patch
          33 kB
          Karthik Kambatla
        3. yarn-4512-yarn-1011.003.patch
          33 kB
          Karthik Kambatla
        4. yarn-4512-yarn-1011.004.patch
          34 kB
          Karthik Kambatla
        5. yarn-4512-yarn-1011.005.patch
          34 kB
          Karthik Kambatla

        Issue Links

          Dependent

          Sub-task - The sub-task of the issue YARN-4511 Common scheduler changes to support scheduler-specific oversubscription implementations

          • Major - Major loss of function.
          • Resolved
          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. YARN-4647 Make RegisterNodeManagerRequestPBImpl thread-safe

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Sub-task - The sub-task of the issue YARN-6670 Add separate NM overallocation thresholds for cpu and memory

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. YARN-5202 Dynamic Overcommit of Node Resources - POC

          • Major - Major loss of function.
          • Open

          Activity

            People

              kasha Karthik Kambatla
              kasha Karthik Kambatla
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: