Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-160

nodemanagers should obtain cpu/memory values from underlying OS

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      As mentioned in YARN-2

      NM memory and CPU configs

      Currently these values are coming from the config of the NM, we should be able to obtain those values from the OS (ie, in the case of Linux from /proc/meminfo & /proc/cpuinfo). As this is highly OS dependent we should have an interface that obtains this information. In addition implementations of this interface should be able to specify a mem/cpu offset (amount of mem/cpu not to be avail as YARN resource), this would allow to reserve mem/cpu for the OS and other services outside of YARN containers.

      Attachments

        1. apache-yarn-160.0.patch
          24 kB
          Varun Vasudev
        2. apache-yarn-160.1.patch
          24 kB
          Varun Vasudev
        3. apache-yarn-160.2.patch
          38 kB
          Varun Vasudev
        4. apache-yarn-160.3.patch
          39 kB
          Varun Vasudev
        5. YARN-160.005.patch
          55 kB
          Varun Vasudev
        6. YARN-160.006.patch
          55 kB
          Varun Vasudev
        7. YARN-160.007.patch
          56 kB
          Varun Vasudev
        8. YARN-160.008.patch
          56 kB
          Varun Vasudev

        Issue Links

          Activity

            People

              vvasudev Varun Vasudev
              tucu00 Alejandro Abdelnur
              Votes:
              1 Vote for this issue
              Watchers:
              23 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: