Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1625

"could not move files" exception in DataXceiver

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.14.0
    • 0.14.0
    • None
    • None

    Description

      I am running TestDFSIO with the new crcs.
      The test fails with the following exception repeated several times

      07/07/17 19:15:50 WARN fs.DFSClient: Error while writing.
      java.io.EOFException
      at java.io.DataInputStream.readByte(DataInputStream.java:243)
      at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.endBlock(DFSClient.java:1663)
      at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1735)
      at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:49)
      at org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:64)
      at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:773)
      at org.apache.hadoop.fs.TestDFSIO.createControlFile(TestDFSIO.java:129)
      at org.apache.hadoop.fs.TestDFSIO.main(TestDFSIO.java:353)

      The data-node log also contains an exception.

      07/07/17 19:15:50 ERROR dfs.DataNode: DataXCeiver
      java.io.IOException: could not move files for blk_-2838788366095905360 from tmp to C:\ndfs\data\current\blk_-2838788366095905360
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:93)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:82)
      at org.apache.hadoop.dfs.FSDataset$FSVolume.addBlock(FSDataset.java:327)
      at org.apache.hadoop.dfs.FSDataset.finalizeBlock(FSDataset.java:593)
      at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:962)
      at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:734)
      at java.lang.Thread.run(Thread.java:595)

      In debugger I can see that the meta-data file rename fails.
      The data-node runs on windows (if it is relevant).
      I mark it is as a blocker until the reverse is proven.

      Attachments

        1. HADOOP-1625.patch
          0.8 kB
          Raghu Angadi

        Activity

          People

            rangadi Raghu Angadi
            shv Konstantin Shvachko
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: