Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5215

Scheduling containers based on external load in the servers

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • api

    Description

      Currently YARN runs containers in the servers assuming that they own all the resources. The proposal is to use the utilization information in the node and the containers to estimate how much is consumed by external processes and schedule based on this estimation.

      Attachments

        1. YARN-5215.002.patch
          32 kB
          Íñigo Goiri
        2. YARN-5215.001.patch
          32 kB
          Íñigo Goiri
        3. YARN-5215.000.patch
          5 kB
          Íñigo Goiri

        Issue Links

          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. YARN-4055 Report node resource utilization in heartbeat

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-4718 Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. YARN-5202 Dynamic Overcommit of Node Resources - POC

          • Major - Major loss of function.
          • Open

          Activity

            People

              elgoiri Íñigo Goiri
              elgoiri Íñigo Goiri
              Votes:
              0 Vote for this issue
              Watchers:
              16 Start watching this issue

              Dates

                Created:
                Updated: