[HADOOP-5883] TaskMemoryMonitorThread might shoot down tasks even if their processes momentarily exceed the requested memory - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.20.1
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

Currently the TaskMemoryMonitorThread kills tasks as soon as it detects they are consuming more memory than the max value specified. There are valid cases (see ~~HADOOP-5059~~) where if a program is executed from the task, it might momentarily occupy twice the amount of memory for a short time. Ideally the monitoring thread should handle this case.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HADOOP-5883.patch
26/May/09 15:14
29 kB
Hemanth Yamijala
HADOOP-5883.patch
26/May/09 10:40
29 kB
Hemanth Yamijala
HADOOP-5883.patch
25/May/09 04:44
28 kB
Hemanth Yamijala
HADOOP-5883-20.patch
26/May/09 17:17
29 kB
Hemanth Yamijala
HADOOP-5883-20.patch
26/May/09 17:13
29 kB
Hemanth Yamijala

Issue Links

is blocked by

HADOOP-5881 Simplify configuration related to task-memory-monitoring and memory-based scheduling

Resolved

Activity

People

Assignee:: Hemanth Yamijala

Reporter:: Hemanth Yamijala

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 21/May/09 12:53

Updated:: 08/Jul/09 16:53

Resolved:: 28/May/09 06:38