Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.8.4
    • 3.3.0
    • fs/s3
    • None

    Description

      S3AOutputStream by calling org.apache.hadoop.fs.s3a.S3AFileSystem#createTmpFileForWrite indirectly calls java.io.File#deleteOnExit and java.io.DeleteOnExitHook which are known for memory leaking:
       
      https://bugs.java.com/view_bug.do?bug_id=6664633
      https://bugs.java.com/view_bug.do?bug_id=4872014
       
      Apparently it was even fixed (same bug but in unrelated issue) for different component couple of years ago https://issues.apache.org/jira/browse/HADOOP-8635 . 

      Attachments

        Issue Links

          Activity

            People

              stevel@apache.org Steve Loughran
              pnowojski Piotr Nowojski
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: