[MAPREDUCE-3011] TT should remove bad local dirs from conf to prevent constant disk checking

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 0.20.204.0
• Component/s: tasktracker
• Assignee: Eli Collins
• Reporter: Eli Collins
• Created: 15/Sep/11 04:55
• Updated: 29/May/12 06:32
• Resolved: 03/Nov/11 20:11

Description

Per HADOOP-7551 the TT does not remove bad mapred.local.dirs from the conf so after a single disk failure every call to get a local path for reading or writing results in a disk check of all configured local dirs. After detecting that a local dir is bad we should remove it from the conf so that we don't repeatedly perform this expensive operation.

Issue Links

• relates to: MAPREDUCE-3077 re-enable faulty TaskTracker storage without restarting TT, when appropriate