[HADOOP-4654] remove temporary output directory of failed tasks - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: 0.17.2, 0.18.1
Fix Version/s: 0.18.3
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

When dfs is getting full (80+% of reserved space), the rate of write failures increases, such that more map-reduce tasks can fail. By not cleaning up the temporary output directory of tasks the situation worsens over the lifetime of a job, increasing the probability of the whole job failing.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

patch-4654-0.18.txt
25/Nov/08 11:09
3 kB
Amareshwari Sriramadasu
patch-4654-1-0.18.txt
03/Dec/08 06:54
3 kB
Amareshwari Sriramadasu

Issue Links

is related to

HADOOP-4759 HADOOP-4654 to be fixed for branches >= 0.19

Closed

Activity

People

Assignee:: Amareshwari Sriramadasu

Reporter:: Christian Kunz

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 13/Nov/08 20:12

Updated:: 08/Jul/09 16:53

Resolved:: 05/Dec/08 12:29