[HADOOP-5146] LocalDirAllocator misses files on the local filesystem

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.20.0
• Fix Version/s: 0.19.2, 0.20.0
• Hadoop Flags: Reviewed
• Assignee: Devaraj Das
• Reporter: Arun Murthy
• Created: 30/Jan/09 02:37
• Updated: 08/Jul/09 16:53
• Resolved: 28/Feb/09 07:28

Description

For some reason the LocalDirAllocator.getLocaPathToRead doesn't find files which are present, extra logging shows:

2009-01-30 06:43:32,312 INFO org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext: in ifExists, /grid/2/arunc/mapred-local/taskTracker/archive/xxx.yyy.com/tera/in/_partition.lst exists
2009-01-30 06:43:32,389 WARN org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext: in getLocalPathToRead, taskTracker/archive/xxx.yyy.com/tera/in/_partition.lst doesn't exist
2009-01-30 06:43:32,390 WARN org.apache.hadoop.mapred.TaskRunner: attempt_200901300512_0007_m_000055_0 Child Error
 org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find taskTracker/archive/xx.yyy.com/tera/in/_partition.lst in any of the configured local directories
         at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:388)
         at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:138)
         at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:172)