[HADOOP-128] Failure to replicate dfs block kills client

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.1.1
• Fix Version/s: 0.2.0

Environment

~200 node linux cluster (kernel 2.6, redhat, 2 hyper threaded cpus)

• Assignee: Owen O'Malley
• Reporter: Owen O'Malley
• Created: 11/Apr/06 00:19
• Updated: 08/Jul/09 16:41
• Resolved: 14/Apr/06 00:44

Description

When the datanode gets an exception, which is logged as:

060407 155835 13 DataXCeiver
java.io.EOFException
at java.io.DataInputStream.readFully(DataInputStream.java:178)
at java.io.DataInputStream.readLong(DataInputStream.java:380)
at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:462)
at java.lang.Thread.run(Thread.java:595)

It closes the user's connection to the data node, which causes the client to get an IOException from:

at java.io.DataInputStream.readFully(DataInputStream.java:178)
at java.io.DataInputStream.readLong(DataInputStream.java:380)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.internalClose(DFSClient.java:883)