[HADOOP-1396] FileNotFound exception on DFS block

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.12.3
• Fix Version/s: 0.14.0
• Assignee: Dhruba Borthakur
• Reporter: Devaraj Das
• Created: 21/May/07 11:20
• Updated: 08/Jul/09 16:42
• Resolved: 13/Jun/07 21:08

Description

Got a couple of exceptions of the form illustrated below. This was for a randomwriter run (and every node in the cluster has multiple disks).

java.io.FileNotFoundException: /tmp/dfs/data/tmp/client-8395631522349067878 (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.(FileInputStream.java:106)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.endBlock(DFSClient.java:1323)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1274)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.write(DFSClient.java:1256)
at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:38)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
at java.io.DataOutputStream.write(DataOutputStream.java:90)
at org.apache.hadoop.fs.ChecksumFileSystem$FSOutputSummer.write(ChecksumFileSystem.java:402)
at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.write(FSDataOutputStream.java:38)
at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
at java.io.BufferedOutputStream.write(BufferedOutputStream.java:109)
at java.io.DataOutputStream.write(DataOutputStream.java:90)
at org.apache.hadoop.io.SequenceFile$Writer.append(SequenceFile.java:775)
at org.apache.hadoop.examples.RandomWriter$Map.map(RandomWriter.java:158)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:48)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:187)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1709)

So it seems like the bug reported in HADOOP-758 still exists.

Issue Links

• duplicates: HADOOP-1491 After successful distcp, couple of checksum error files
• relates to: HADOOP-1411 AlreadyBeingCreatedException from task retries