[HDFS-690] TestAppend2#testComplexAppend failed on "Too many open files"

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.21.0
• Fix Version/s: 0.21.0
• Component/s: test
• Hadoop Flags: Reviewed
• Assignee: Hairong Kuang
• Reporter: Hairong Kuang
• Created: 09/Oct/09 21:14
• Updated: 24/Aug/10 20:49
• Resolved: 23/Oct/09 04:09

Description

the append write failed on "Too many open files":
Some bytes were failed to append to a file on the following error:
java.io.IOException: Cannot run program "stat": java.io.IOException: error=24, Too many open files
at java.lang.ProcessBuilder.start(ProcessBuilder.java:459)
at java.lang.Runtime.exec(Runtime.java:593)
at java.lang.Runtime.exec(Runtime.java:466)
at org.apache.hadoop.fs.FileUtil$HardLink.getLinkCount(FileUtil.java:644)
at org.apache.hadoop.hdfs.server.datanode.ReplicaInfo.unlinkBlock(ReplicaInfo.java:205)
at org.apache.hadoop.hdfs.server.datanode.FSDataset.append(FSDataset.java:1075)
at org.apache.hadoop.hdfs.server.datanode.FSDataset.append(FSDataset.java:1058)
at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:110)
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.opWriteBlock(DataXceiver.java:258)
at org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.opWriteBlock(DataTransferProtocol.java:382)
at org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.processOp(DataTransferProtocol.java:323)
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:111)