Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4681

ProcfsBasedProcessTree should not calculate private clean pages

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.6.0, 2.7.0
    • None
    • nodemanager

    Description

      ProcfsBasedProcessTree in Node manager calculates memory used by a process tree by parsing /etc/<pid>/smaps, where it calculates min(Pss, Shared_Dirty) + Private_Dirty + Private_Clean. Because not mlocked private clean pages can be reclaimed by kernel, this should be changed to calculating only Locked pages instead.

      Attachments

        1. YARN-4681.patch
          16 kB
          Jan Lukavsky
        2. YARN-4681.patch
          6 kB
          Jan Lukavsky

        Issue Links

          relates to

          Sub-task - The sub-task of the issue YARN-1775 Create SMAPBasedProcessTree to get PSS information

          • Major - Major loss of function.
          • Closed

          Activity

            People

              je.ik Jan Lukavsky
              je.ik Jan Lukavsky
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: