Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1625

"could not move files" exception in DataXceiver

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.14.0
    • 0.14.0
    • None
    • None

    Description

      I am running TestDFSIO with the new crcs.
      The test fails with the following exception repeated several times

      07/07/17 19:15:50 WARN fs.DFSClient: Error while writing.
      java.io.EOFException
      at java.io.DataInputStream.readByte(DataInputStream.java:243)
      at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.endBlock(DFSClient.java:1663)
      at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1735)
      at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:49)
      at org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:64)
      at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:773)
      at org.apache.hadoop.fs.TestDFSIO.createControlFile(TestDFSIO.java:129)
      at org.apache.hadoop.fs.TestDFSIO.main(TestDFSIO.java:353)

      The data-node log also contains an exception.

      07/07/17 19:15:50 ERROR dfs.DataNode: DataXCeiver
      java.io.IOException: could not move files for blk_-2838788366095905360 from tmp to C:\ndfs\data\current\blk_-2838788366095905360
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:93)
      at org.apache.hadoop.dfs.FSDataset$FSDir.addBlock(FSDataset.java:82)
      at org.apache.hadoop.dfs.FSDataset$FSVolume.addBlock(FSDataset.java:327)
      at org.apache.hadoop.dfs.FSDataset.finalizeBlock(FSDataset.java:593)
      at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock(DataNode.java:962)
      at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:734)
      at java.lang.Thread.run(Thread.java:595)

      In debugger I can see that the meta-data file rename fails.
      The data-node runs on windows (if it is relevant).
      I mark it is as a blocker until the reverse is proven.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rangadi Raghu Angadi Assign to me
            shv Konstantin Shvachko
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment