[HADOOP-757] "Bad File Descriptor" in closing DFS file

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0
• Fix Version/s: 0.11.0
• Assignee: Raghu Angadi
• Reporter: Owen O'Malley
• Created: 29/Nov/06 05:35
• Updated: 08/Jul/09 16:42
• Resolved: 16/Jan/07 20:02

Description

Running the sort benchmark, I had a reduce fail with a DFS error:

java.io.IOException: Bad file descriptor
at java.io.FileOutputStream.writeBytes(Native Method)
at java.io.FileOutputStream.write(FileOutputStream.java:260)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)

Issue Links

• is duplicated by: HADOOP-758 FileNotFound on DFS block file
• relates to: MAPREDUCE-8 "Bad File Descriptor" in closing local file