Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-160

nodemanagers should obtain cpu/memory values from underlying OS

    Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      As mentioned in YARN-2

      NM memory and CPU configs

      Currently these values are coming from the config of the NM, we should be able to obtain those values from the OS (ie, in the case of Linux from /proc/meminfo & /proc/cpuinfo). As this is highly OS dependent we should have an interface that obtains this information. In addition implementations of this interface should be able to specify a mem/cpu offset (amount of mem/cpu not to be avail as YARN resource), this would allow to reserve mem/cpu for the OS and other services outside of YARN containers.

        Attachments

        1. apache-yarn-160.0.patch
          24 kB
          Varun Vasudev
        2. apache-yarn-160.1.patch
          24 kB
          Varun Vasudev
        3. apache-yarn-160.2.patch
          38 kB
          Varun Vasudev
        4. apache-yarn-160.3.patch
          39 kB
          Varun Vasudev
        5. YARN-160.005.patch
          55 kB
          Varun Vasudev
        6. YARN-160.006.patch
          55 kB
          Varun Vasudev
        7. YARN-160.007.patch
          56 kB
          Varun Vasudev
        8. YARN-160.008.patch
          56 kB
          Varun Vasudev

          Issue Links

            Activity

              People

              • Assignee:
                vvasudev Varun Vasudev
                Reporter:
                tucu00 Alejandro Abdelnur
              • Votes:
                1 Vote for this issue
                Watchers:
                23 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: