[HADOOP-3762] Task tracker died due to OOM - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Blocker
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.18.0
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

When running about 100 moderate jobs on a small cluster (with 19 Task Trackers),
the task trackers all died due to OOM.
I got a chance to dump the jstack strace of a task tracker before it died.
Its image size was close 4GB!
I saw 1200+ threads of DFSClient.LeaseChecker.
Clearly we have a severe resource leakage problem!

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

3762_20080715.patch
15/Jul/08 23:16
1 kB
Tsz-wo Sze
3762_20080715b.patch
15/Jul/08 23:54
2 kB
Tsz-wo Sze
3762_20080715c.patch
16/Jul/08 02:18
2 kB
Tsz-wo Sze
3762_20080717.patch
17/Jul/08 22:47
7 kB
Tsz-wo Sze
HADOOP-3762.patch
18/Jul/08 21:28
6 kB
Doug Cutting
HADOOP-3762.patch
17/Jul/08 23:32
3 kB
Doug Cutting
HADOOP-3762.patch
17/Jul/08 22:35
3 kB
Doug Cutting
HADOOP-3762.patch
16/Jul/08 22:07
2 kB
Doug Cutting
TaskTrackerStackTrace.txt
15/Jul/08 21:28
335 kB
Runping Qi

Activity

People

Assignee:: Doug Cutting

Reporter:: Runping Qi

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 15/Jul/08 19:17

Updated:: 22/Aug/08 19:50

Resolved:: 21/Jul/08 18:56