Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-690

TestAppend2#testComplexAppend failed on "Too many open files"

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.21.0
    • Component/s: test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      the append write failed on "Too many open files":
      Some bytes were failed to append to a file on the following error:
      java.io.IOException: Cannot run program "stat": java.io.IOException: error=24, Too many open files
      at java.lang.ProcessBuilder.start(ProcessBuilder.java:459)
      at java.lang.Runtime.exec(Runtime.java:593)
      at java.lang.Runtime.exec(Runtime.java:466)
      at org.apache.hadoop.fs.FileUtil$HardLink.getLinkCount(FileUtil.java:644)
      at org.apache.hadoop.hdfs.server.datanode.ReplicaInfo.unlinkBlock(ReplicaInfo.java:205)
      at org.apache.hadoop.hdfs.server.datanode.FSDataset.append(FSDataset.java:1075)
      at org.apache.hadoop.hdfs.server.datanode.FSDataset.append(FSDataset.java:1058)
      at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:110)
      at org.apache.hadoop.hdfs.server.datanode.DataXceiver.opWriteBlock(DataXceiver.java:258)
      at org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.opWriteBlock(DataTransferProtocol.java:382)
      at org.apache.hadoop.hdfs.protocol.DataTransferProtocol$Receiver.processOp(DataTransferProtocol.java:323)
      at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:111)

      1. leakingThreads1.patch
        2 kB
        Hairong Kuang
      2. leakingThreads.patch
        2 kB
        Hairong Kuang

        Activity

        Hairong Kuang created issue -
        Hairong Kuang made changes -
        Field Original Value New Value
        Attachment leakingThreads.patch [ 12422824 ]
        Hairong Kuang made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Assignee Hairong Kuang [ hairong ]
        Tsz Wo Nicholas Sze made changes -
        Hadoop Flags [Reviewed]
        Hairong Kuang made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Hairong Kuang made changes -
        Attachment leakingThreads1.patch [ 12422943 ]
        Hairong Kuang made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hairong Kuang made changes -
        Resolution Fixed [ 1 ]
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Hairong Kuang
            Reporter:
            Hairong Kuang
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development