Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1118

DFSOutputStream socket leak when cannot connect to DataNode

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20.1, 0.20.2, 0.20-append, 0.21.0
    • 0.20-append, 0.20.205.0, 0.22.0
    • None
    • None
    • Reviewed

    Description

      The offending code is in DFSOutputStream.nextBlockOutputStream

      This function retries several times to call createBlockOutputStream. Each time when it fails, it leaves a Socket object in DFSOutputStream.s.
      That object is never closed, but overwritten the next time createBlockOutputStream is called.

      Attachments

        1. HDFS-1118.1.patch
          0.5 kB
          Zheng Shao
        2. HDFS-1118.2.patch
          1 kB
          Zheng Shao
        3. hdfs-1118.20s.patch
          3 kB
          Suresh Srinivas
        4. trunkPatch.txt
          1 kB
          Dhruba Borthakur

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            zshao Zheng Shao
            zshao Zheng Shao
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment