Hadoop YARN
  1. Hadoop YARN
  2. YARN-160

nodemanagers should obtain cpu/memory values from underlying OS

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.3-alpha
    • Fix Version/s: 2.8.0
    • Component/s: nodemanager
    • Labels:
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      As mentioned in YARN-2

      NM memory and CPU configs

      Currently these values are coming from the config of the NM, we should be able to obtain those values from the OS (ie, in the case of Linux from /proc/meminfo & /proc/cpuinfo). As this is highly OS dependent we should have an interface that obtains this information. In addition implementations of this interface should be able to specify a mem/cpu offset (amount of mem/cpu not to be avail as YARN resource), this would allow to reserve mem/cpu for the OS and other services outside of YARN containers.

      1. YARN-160.008.patch
        56 kB
        Varun Vasudev
      2. YARN-160.007.patch
        56 kB
        Varun Vasudev
      3. YARN-160.006.patch
        55 kB
        Varun Vasudev
      4. YARN-160.005.patch
        55 kB
        Varun Vasudev
      5. apache-yarn-160.3.patch
        39 kB
        Varun Vasudev
      6. apache-yarn-160.2.patch
        38 kB
        Varun Vasudev
      7. apache-yarn-160.1.patch
        24 kB
        Varun Vasudev
      8. apache-yarn-160.0.patch
        24 kB
        Varun Vasudev

        Issue Links

          Activity

            People

            • Assignee:
              Varun Vasudev
              Reporter:
              Alejandro Abdelnur
            • Votes:
              1 Vote for this issue
              Watchers:
              24 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development