Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-144

TaskMemoryManager should log process-tree's status while killing tasks.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: tasktracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Modified TaskMemoryManager so that it logs a map/reduce task's process-tree's status just before it is killed when it grows out of its configured memory limits. The log dump is in the format " |- PID PPID PGRPID SESSID CMD_NAME VMEM_USAGE(BYTES) FULL_CMD_LINE".

      This is useful for debugging the cause for a map/reduce task and it's corresponding process-tree to be killed by the TaskMemoryManager.
      Show
      Modified TaskMemoryManager so that it logs a map/reduce task's process-tree's status just before it is killed when it grows out of its configured memory limits. The log dump is in the format " |- PID PPID PGRPID SESSID CMD_NAME VMEM_USAGE(BYTES) FULL_CMD_LINE". This is useful for debugging the cause for a map/reduce task and it's corresponding process-tree to be killed by the TaskMemoryManager.

      Description

      This helps a lot in debugging why a particular task has gone beyond memory limits.

        Attachments

        1. MAPREDUCE-144-20090907.internal.txt
          13 kB
          Hemanth Yamijala
        2. MAPREDUCE-144-20090908.txt
          13 kB
          Vinod Kumar Vavilapalli
        3. MAPREDUCE-144-20090903.1.txt
          13 kB
          Vinod Kumar Vavilapalli
        4. MAPREDUCE-144-20090903.txt
          72 kB
          Vinod Kumar Vavilapalli
        5. MAPREDUCE-144-20090902.txt
          7 kB
          Vinod Kumar Vavilapalli
        6. HADOOP-5570-1.patch
          6 kB
          Sreekanth Ramakrishnan
        7. HADOOP-5570-20090622.txt
          6 kB
          Vinod Kumar Vavilapalli
        8. HADOOP-5570-20090619.txt
          6 kB
          Vinod Kumar Vavilapalli
        9. HADOOP-5570-20090615.txt
          5 kB
          Vinod Kumar Vavilapalli
        10. HADOOP-5570-20090614.txt
          5 kB
          Vinod Kumar Vavilapalli

          Issue Links

            Activity

              People

              • Assignee:
                vinodkv Vinod Kumar Vavilapalli
                Reporter:
                vinodkv Vinod Kumar Vavilapalli
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: