Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-220

Collecting cpu and memory usage for MapReduce tasks

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.22.0
    • task, tasktracker
    • None
    • Reviewed
    • Collect cpu and memory statistics per task.

    Description

      It would be nice for TaskTracker to collect cpu and memory usage for individual Map or Reduce tasks over time.

      Attachments

        1. ant-test.log
          48 kB
          Scott Chen
        2. ant-test-patch.log
          2 kB
          Scott Chen
        3. MAPREDUCE-220.txt
          15 kB
          Scott Chen
        4. MAPREDUCE-220-20100616.txt
          12 kB
          Scott Chen
        5. MAPREDUCE-220-20100804.txt
          12 kB
          Scott Chen
        6. MAPREDUCE-220-20100806.txt
          12 kB
          Scott Chen
        7. MAPREDUCE-220-20100809.txt
          12 kB
          Scott Chen
        8. MAPREDUCE-220-20100811.txt
          14 kB
          Scott Chen
        9. MAPREDUCE-220-20100812.txt
          14 kB
          Scott Chen
        10. MAPREDUCE-220-20100817.txt
          13 kB
          Scott Chen
        11. MAPREDUCE-220-20100818.txt
          13 kB
          Scott Chen
        12. MAPREDUCE-220-v1.txt
          15 kB
          Scott Chen

        Issue Links

        incorporates

        New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-1167 Make ProcfsBasedProcessTree collect rss memory information

        • Major - Major loss of function.
        • Closed
        is blocked by

        Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-901 Move Framework Counters into a TaskMetric structure

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-1762 Add a setValue() method in Counter

        • Major - Major loss of function.
        • Closed
        is depended upon by

        Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-2104 Rumen TraceBuilder Does Not Emit CPU/Memory Usage Details in Traces

        • Major - Major loss of function.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-1739 Collecting CPU and memory usage for MapReduce jobs

        • Major - Major loss of function.
        • Open

        New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-2037 Capturing interim progress times, CPU usage, and memory usage, when tasks reach certain progress thresholds

        • Major - Major loss of function.
        • Closed
        relates to

        New Feature - A new feature of the product, which has yet to be developed. MAPREDUCE-2777 Backport MAPREDUCE-220 to Hadoop 20 security branch

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            schen Scott Chen
            hong.tang Hong Tang
            Votes:
            0 Vote for this issue
            Watchers:
            28 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment