Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-144

TaskMemoryManager should log process-tree's status while killing tasks.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • tasktracker
    • None
    • Reviewed
    • Hide
      Modified TaskMemoryManager so that it logs a map/reduce task's process-tree's status just before it is killed when it grows out of its configured memory limits. The log dump is in the format " |- PID PPID PGRPID SESSID CMD_NAME VMEM_USAGE(BYTES) FULL_CMD_LINE".

      This is useful for debugging the cause for a map/reduce task and it's corresponding process-tree to be killed by the TaskMemoryManager.
      Show
      Modified TaskMemoryManager so that it logs a map/reduce task's process-tree's status just before it is killed when it grows out of its configured memory limits. The log dump is in the format " |- PID PPID PGRPID SESSID CMD_NAME VMEM_USAGE(BYTES) FULL_CMD_LINE". This is useful for debugging the cause for a map/reduce task and it's corresponding process-tree to be killed by the TaskMemoryManager.

    Description

      This helps a lot in debugging why a particular task has gone beyond memory limits.

      Attachments

        1. HADOOP-5570-1.patch
          6 kB
          Sreekanth Ramakrishnan
        2. HADOOP-5570-20090614.txt
          5 kB
          Vinod Kumar Vavilapalli
        3. HADOOP-5570-20090615.txt
          5 kB
          Vinod Kumar Vavilapalli
        4. HADOOP-5570-20090619.txt
          6 kB
          Vinod Kumar Vavilapalli
        5. HADOOP-5570-20090622.txt
          6 kB
          Vinod Kumar Vavilapalli
        6. MAPREDUCE-144-20090902.txt
          7 kB
          Vinod Kumar Vavilapalli
        7. MAPREDUCE-144-20090903.1.txt
          13 kB
          Vinod Kumar Vavilapalli
        8. MAPREDUCE-144-20090903.txt
          72 kB
          Vinod Kumar Vavilapalli
        9. MAPREDUCE-144-20090907.internal.txt
          13 kB
          Hemanth Yamijala
        10. MAPREDUCE-144-20090908.txt
          13 kB
          Vinod Kumar Vavilapalli

        Issue Links

          Activity

            People

              vinodkv Vinod Kumar Vavilapalli
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: