Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-757

"Bad File Descriptor" in closing DFS file

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.0
    • 0.11.0
    • None
    • None

    Description

      Running the sort benchmark, I had a reduce fail with a DFS error:

      java.io.IOException: Bad file descriptor
      at java.io.FileOutputStream.writeBytes(Native Method)
      at java.io.FileOutputStream.write(FileOutputStream.java:260)
      at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
      at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
      at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
      at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
      at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
      at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
      at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
      at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
      at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
      at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
      at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
      at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)

      Attachments

        1. HADOOP-757.patch
          3 kB
          Raghu Angadi

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rangadi Raghu Angadi
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment