Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4906

TaskTracker running out of memory after running several tasks

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.19.0
    • 0.19.1
    • None
    • None
    • Fix the tasktracker for OOM exception by sharing the jobconf properties across tasks of the same job. Earlier a new instance was held for each task. With this fix, the job level configuration properties are shared across tasks of the same job.

    Description

      Looks like the TaskTracker isn't cleaning up correctly after completed/failed tasks, I suspect that the JobConfs aren't being deallocated. Eventually the TaskTracker runs out of memory after running several tasks.

      Attachments

        1. 4906_v5.patch
          2 kB
          Sharad Agarwal
        2. 4906_v4.patch
          1.0 kB
          Sharad Agarwal
        3. 4906_v3.patch
          4 kB
          Sharad Agarwal
        4. 4906_v2.patch
          4 kB
          Sharad Agarwal
        5. 4906_v1.patch
          1 kB
          Sharad Agarwal

        Activity

          People

            sharadag Sharad Agarwal
            acmurthy Arun Murthy
            Votes:
            1 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: