Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-144

TaskMemoryManager should log process-tree's status while killing tasks.

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • tasktracker
    • None
    • Reviewed
    • Hide
      Modified TaskMemoryManager so that it logs a map/reduce task's process-tree's status just before it is killed when it grows out of its configured memory limits. The log dump is in the format " |- PID PPID PGRPID SESSID CMD_NAME VMEM_USAGE(BYTES) FULL_CMD_LINE".

      This is useful for debugging the cause for a map/reduce task and it's corresponding process-tree to be killed by the TaskMemoryManager.
      Show
      Modified TaskMemoryManager so that it logs a map/reduce task's process-tree's status just before it is killed when it grows out of its configured memory limits. The log dump is in the format " |- PID PPID PGRPID SESSID CMD_NAME VMEM_USAGE(BYTES) FULL_CMD_LINE". This is useful for debugging the cause for a map/reduce task and it's corresponding process-tree to be killed by the TaskMemoryManager.

    Description

      This helps a lot in debugging why a particular task has gone beyond memory limits.

      Attachments

        1. MAPREDUCE-144-20090907.internal.txt
          13 kB
          Hemanth Yamijala
        2. MAPREDUCE-144-20090908.txt
          13 kB
          Vinod Kumar Vavilapalli
        3. MAPREDUCE-144-20090903.1.txt
          13 kB
          Vinod Kumar Vavilapalli
        4. MAPREDUCE-144-20090903.txt
          72 kB
          Vinod Kumar Vavilapalli
        5. MAPREDUCE-144-20090902.txt
          7 kB
          Vinod Kumar Vavilapalli
        6. HADOOP-5570-1.patch
          6 kB
          Sreekanth Ramakrishnan
        7. HADOOP-5570-20090622.txt
          6 kB
          Vinod Kumar Vavilapalli
        8. HADOOP-5570-20090619.txt
          6 kB
          Vinod Kumar Vavilapalli
        9. HADOOP-5570-20090615.txt
          5 kB
          Vinod Kumar Vavilapalli
        10. HADOOP-5570-20090614.txt
          5 kB
          Vinod Kumar Vavilapalli

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            vinodkv Vinod Kumar Vavilapalli
            vinodkv Vinod Kumar Vavilapalli
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment