[MAPREDUCE-2657] TaskTracker should handle disk failures - ASF JIRA

XML

Word

Printable

JSON

Umbrella for TaskTracker disk failure handling jiras.

is part of

HADOOP-7123 Hadoop Disk Fail Inplace

is related to

HADOOP-7551 LocalDirAllocator should incorporate LocalStorage

relates to

MAPREDUCE-2656 Map Reduce Tasks are continously failing, when one among the several harddisks available on the TaskTracker fails.

MAPREDUCE-2651 Race condition in Linux Task Controller for job log directory creation

1.	TaskTracker should handle disk failures at both startup and runtime	Closed	Ravi Gummadi
2.	Distribute TaskTracker userlogs onto multiple disks	Closed	Bharath Mundlapudi
3.	Add test for TaskTracker disk failure handling (MR-2413)	Closed	Ravi Gummadi
4.	Add test for userlogs on multiple disks (MR-2415)	Open	Unassigned
5.	Map Reduce Tasks are continously failing, when one among the several harddisks available on the TaskTracker fails.	Resolved	Devaraj Kavali
6.	If Localizer can't create task log directory, it should fail on the spot	Closed	Todd Lipcon
7.	Local log dir links in the JT web UI are broken	Closed	Unassigned
8.	TaskTracker won't start with failed local directory	Resolved	Eli Collins
9.	TaskTracker number of failed disks to tolerate should be configurable	Closed	Unassigned
10.	MR-2413 improvements	Closed	Eli Collins
11.	The TT should not re-init if it has no good local dirs	Closed	Eli Collins
12.	A single TT disk failure can cause the job to fail	Open	Unassigned
13.	TT should remove bad local dirs from conf to prevent constant disk checking	Closed	Eli Collins
14.	Add local dir failure info to metrics and the web UI	Closed	Eli Collins
15.	Add TT local dir failure info to the JT web UI	Resolved	Eli Collins
16.	Some LinuxTaskController cleanup	Closed	Eli Collins