Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-834

When TaskTracker config use old memory management values its memory monitoring is diabled.

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.20.1
    • None
    • None
    • Reviewed
    • The tasktracker's startup code was modified to use deprecated memory management configuration variables, when specified, and enable memory monitoring of tasks.

    Description

      TaskTracker memory config values -:
      mapred.tasktracker.vmem.reserved=8589934592
      mapred.task.default.maxvmem=2147483648
      mapred.task.limit.maxvmem=4294967296
      mapred.tasktracker.pmem.reserved=2147483648
      TaskTracker start as -:
      2009-08-05 12:39:03,308 WARN org.apache.hadoop.mapred.TaskTracker: The variable mapred.tasktracker.vmem.reserved is no longer used
      2009-08-05 12:39:03,308 WARN org.apache.hadoop.mapred.TaskTracker: The variable mapred.tasktracker.pmem.reserved is no longer used
      2009-08-05 12:39:03,308 WARN org.apache.hadoop.mapred.TaskTracker: The variable mapred.task.default.maxvmem is no longer used
      2009-08-05 12:39:03,308 WARN org.apache.hadoop.mapred.TaskTracker: The variable mapred.task.limit.maxvmem is no longer used
      2009-08-05 12:39:03,308 INFO org.apache.hadoop.mapred.TaskTracker: Starting thread: Map-events fetcher for all reduce tasks on <tracker_name>
      2009-08-05 12:39:03,309 INFO org.apache.hadoop.mapred.TaskTracker: Using MemoryCalculatorPlugin : org.apache.hadoop.util.LinuxMemoryCalculatorPlugin@19be4777
      2009-08-05 12:39:03,311 WARN org.apache.hadoop.mapred.TaskTracker: TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.

      Attachments

        1. mapred-834-20.patch
          4 kB
          Sreekanth Ramakrishnan
        2. mapreduce-834-1.patch
          4 kB
          Sreekanth Ramakrishnan
        3. mapreduce-834-2.patch
          4 kB
          Sreekanth Ramakrishnan
        4. mapreduce-834-3.patch
          4 kB
          Sreekanth Ramakrishnan
        5. mapreduce-834-4.patch
          4 kB
          Sreekanth Ramakrishnan
        6. mapreduce-834-ydist.patch
          0.7 kB
          Sreekanth Ramakrishnan

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sreekanth Sreekanth Ramakrishnan
            karams Karam Singh
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment