Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-144

TaskMemoryManager should log process-tree's status while killing tasks.

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: tasktracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Modified TaskMemoryManager so that it logs a map/reduce task's process-tree's status just before it is killed when it grows out of its configured memory limits. The log dump is in the format " |- PID PPID PGRPID SESSID CMD_NAME VMEM_USAGE(BYTES) FULL_CMD_LINE".

      This is useful for debugging the cause for a map/reduce task and it's corresponding process-tree to be killed by the TaskMemoryManager.
      Show
      Modified TaskMemoryManager so that it logs a map/reduce task's process-tree's status just before it is killed when it grows out of its configured memory limits. The log dump is in the format " |- PID PPID PGRPID SESSID CMD_NAME VMEM_USAGE(BYTES) FULL_CMD_LINE". This is useful for debugging the cause for a map/reduce task and it's corresponding process-tree to be killed by the TaskMemoryManager.

      Description

      This helps a lot in debugging why a particular task has gone beyond memory limits.

      1. HADOOP-5570-1.patch
        6 kB
        Sreekanth Ramakrishnan
      2. HADOOP-5570-20090614.txt
        5 kB
        Vinod Kumar Vavilapalli
      3. HADOOP-5570-20090615.txt
        5 kB
        Vinod Kumar Vavilapalli
      4. HADOOP-5570-20090619.txt
        6 kB
        Vinod Kumar Vavilapalli
      5. HADOOP-5570-20090622.txt
        6 kB
        Vinod Kumar Vavilapalli
      6. MAPREDUCE-144-20090902.txt
        7 kB
        Vinod Kumar Vavilapalli
      7. MAPREDUCE-144-20090903.1.txt
        13 kB
        Vinod Kumar Vavilapalli
      8. MAPREDUCE-144-20090903.txt
        72 kB
        Vinod Kumar Vavilapalli
      9. MAPREDUCE-144-20090907.internal.txt
        13 kB
        Hemanth Yamijala
      10. MAPREDUCE-144-20090908.txt
        13 kB
        Vinod Kumar Vavilapalli

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Vinod Kumar Vavilapalli
              Reporter:
              Vinod Kumar Vavilapalli
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development