Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5075

DistCp leaks input file handles

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 0.23.7, 2.1.0-beta
    • Component/s: distcp
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      DistCp wraps the InputStream for each input file it reads in an instance of ThrottledInputStream. This class does not close the wrapped InputStream. RetriableFileCopyCommand guarantees that the ThrottledInputStream gets closed, but without closing the underlying wrapped stream, it still leaks a file handle.

        Attachments

        1. MAPREDUCE-5075.1.patch
          3 kB
          Chris Nauroth

        Issue Links

          Activity

            People

            • Assignee:
              cnauroth Chris Nauroth
              Reporter:
              cnauroth Chris Nauroth

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment