Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1167

Make ProcfsBasedProcessTree collect rss memory information

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.22.0
    • 0.21.0
    • tasktracker
    • None
    • Reviewed

    Description

      Right now ProcfsBasedProcess collects only virtual memory. We can make it collect rss memory as well.
      Later we can use rss in TaskMemoryManagerThread to obtain better memory management.

      Attachments

        1. MAPREDUCE-1167.patch
          18 kB
          Scott Chen
        2. MAPREDUCE-1167-v2.patch
          20 kB
          Scott Chen
        3. MAPREDUCE-1167-v3.patch
          20 kB
          Scott Chen
        4. MAPREDUCE-1167-v4.patch
          19 kB
          Scott Chen
        5. MAPREDUCE-1167-v5.patch
          19 kB
          Scott Chen

        Issue Links

          blocks

          Sub-task - The sub-task of the issue MAPREDUCE-1201 Make ProcfsBasedProcessTree collect CPU usage information

          • Major - Major loss of function.
          • Closed
          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-1181 Enforce RSS memory limit in TaskMemoryManagerThread

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-1195 Task resource utilization reporting for profiling and scheduling

          • Major - Major loss of function.
          • Resolved
          is part of

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-220 Collecting cpu and memory usage for MapReduce tasks

          • Major - Major loss of function.
          • Closed
          relates to

          New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-961 ResourceAwareLoadManager to dynamically decide new tasks based on current CPU/memory load on TaskTracker(s)

          • Major - Major loss of function.
          • Open

          Activity

            People

              schen Scott Chen
              schen Scott Chen
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: