Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4906

TaskTracker running out of memory after running several tasks

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.19.0
    • Fix Version/s: 0.19.1
    • Component/s: None
    • Labels:
      None
    • Release Note:
      Fix the tasktracker for OOM exception by sharing the jobconf properties across tasks of the same job. Earlier a new instance was held for each task. With this fix, the job level configuration properties are shared across tasks of the same job.

      Description

      Looks like the TaskTracker isn't cleaning up correctly after completed/failed tasks, I suspect that the JobConfs aren't being deallocated. Eventually the TaskTracker runs out of memory after running several tasks.

        Attachments

        1. 4906_v5.patch
          2 kB
          Sharad Agarwal
        2. 4906_v4.patch
          1.0 kB
          Sharad Agarwal
        3. 4906_v3.patch
          4 kB
          Sharad Agarwal
        4. 4906_v2.patch
          4 kB
          Sharad Agarwal
        5. 4906_v1.patch
          1 kB
          Sharad Agarwal

          Activity

            People

            • Assignee:
              sharadag Sharad Agarwal
              Reporter:
              acmurthy Arun C Murthy
            • Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: