Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-834

When TaskTracker config use old memory management values its memory monitoring is diabled.

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      The tasktracker's startup code was modified to use deprecated memory management configuration variables, when specified, and enable memory monitoring of tasks.

      Description

      TaskTracker memory config values -:
      mapred.tasktracker.vmem.reserved=8589934592
      mapred.task.default.maxvmem=2147483648
      mapred.task.limit.maxvmem=4294967296
      mapred.tasktracker.pmem.reserved=2147483648
      TaskTracker start as -:
      2009-08-05 12:39:03,308 WARN org.apache.hadoop.mapred.TaskTracker: The variable mapred.tasktracker.vmem.reserved is no longer used
      2009-08-05 12:39:03,308 WARN org.apache.hadoop.mapred.TaskTracker: The variable mapred.tasktracker.pmem.reserved is no longer used
      2009-08-05 12:39:03,308 WARN org.apache.hadoop.mapred.TaskTracker: The variable mapred.task.default.maxvmem is no longer used
      2009-08-05 12:39:03,308 WARN org.apache.hadoop.mapred.TaskTracker: The variable mapred.task.limit.maxvmem is no longer used
      2009-08-05 12:39:03,308 INFO org.apache.hadoop.mapred.TaskTracker: Starting thread: Map-events fetcher for all reduce tasks on <tracker_name>
      2009-08-05 12:39:03,309 INFO org.apache.hadoop.mapred.TaskTracker: Using MemoryCalculatorPlugin : org.apache.hadoop.util.LinuxMemoryCalculatorPlugin@19be4777
      2009-08-05 12:39:03,311 WARN org.apache.hadoop.mapred.TaskTracker: TaskTracker's totalMemoryAllottedForTasks is -1. TaskMemoryManager is disabled.

      1. mapred-834-20.patch
        4 kB
        Sreekanth Ramakrishnan
      2. mapreduce-834-1.patch
        4 kB
        Sreekanth Ramakrishnan
      3. mapreduce-834-2.patch
        4 kB
        Sreekanth Ramakrishnan
      4. mapreduce-834-3.patch
        4 kB
        Sreekanth Ramakrishnan
      5. mapreduce-834-4.patch
        4 kB
        Sreekanth Ramakrishnan
      6. mapreduce-834-ydist.patch
        0.7 kB
        Sreekanth Ramakrishnan

        Activity

        Karam Singh created issue -
        Sreekanth Ramakrishnan made changes -
        Field Original Value New Value
        Attachment mapreduce-834-1.patch [ 12416532 ]
        Sreekanth Ramakrishnan made changes -
        Attachment mapreduce-834-2.patch [ 12416992 ]
        Sreekanth Ramakrishnan made changes -
        Attachment mapreduce-834-3.patch [ 12417099 ]
        Sreekanth Ramakrishnan made changes -
        Attachment mapreduce-834-4.patch [ 12417108 ]
        Hemanth Yamijala made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Assignee Sreekanth Ramakrishnan [ sreekanth ]
        Sreekanth Ramakrishnan made changes -
        Attachment mapred-834-20.patch [ 12417129 ]
        Hemanth Yamijala made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.20.1 [ 12314047 ]
        Resolution Fixed [ 1 ]
        Sreekanth Ramakrishnan made changes -
        Attachment mapreduce-834-ydist.patch [ 12417453 ]
        Sreekanth Ramakrishnan made changes -
        Release Note The issue fixes the backward compatibility issue which caused memory monitoring not to be started when TaskTracker was started with old configuration.
        Hemanth Yamijala made changes -
        Release Note The issue fixes the backward compatibility issue which caused memory monitoring not to be started when TaskTracker was started with old configuration. The tasktracker's startup code was modified to use deprecated memory management configuration variables, when specified, and enable memory monitoring of tasks.

          People

          • Assignee:
            Sreekanth Ramakrishnan
            Reporter:
            Karam Singh
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development