[HADOOP-758] FileNotFound on DFS block file

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.11.0
• Assignee: Raghu Angadi
• Reporter: Owen O'Malley
• Created: 29/Nov/06 05:41
• Updated: 08/Jul/09 16:42
• Resolved: 25/Jan/07 21:31

Description

While run the sort benchmark a reduce failed with:

java.io.FileNotFoundException: /tmp/hadoop-oom/dfs/tmp/tmp/client-4362164194084664090 (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.(FileInputStream.java:106)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.endBlock(DFSClient.java:1156)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1244)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:98)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)

Issue Links

• duplicates: HADOOP-757 "Bad File Descriptor" in closing DFS file
• relates to: MAPREDUCE-8 "Bad File Descriptor" in closing local file