Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-758

FileNotFound on DFS block file

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.0
    • 0.11.0
    • None
    • None

    Description

      While run the sort benchmark a reduce failed with:

      java.io.FileNotFoundException: /tmp/hadoop-oom/dfs/tmp/tmp/client-4362164194084664090 (No such file or directory)
      at java.io.FileInputStream.open(Native Method)
      at java.io.FileInputStream.(FileInputStream.java:106)
      at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.endBlock(DFSClient.java:1156)
      at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1244)
      at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
      at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
      at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
      at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:98)
      at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
      at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
      at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
      at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
      at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
      at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
      at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)

      Attachments

        1. HADOOP-758.patch
          0.9 kB
          Raghu Angadi
        2. HADOOP-758_2.patch
          0.8 kB
          Raghu Angadi

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rangadi Raghu Angadi
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment