Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4655

FileSystem.CACHE should be ref-counted

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.18.1, 0.18.2, 0.19.0, 0.19.1, 0.20.0
    • 0.21.0
    • fs
    • None
    • Incompatible change
    • Every invocation of FileSystem.newInstance() returns a newly allocated FileSystem object. This may be an incompatible change for applications that relied on FileSystem object identity.

    Description

      FileSystem.CACHE is not ref-counted, and could lead to resource leakage.

      Attachments

        1. FileSystemUnique.patch
          4 kB
          Dhruba Borthakur
        2. FileSystemUnique.txt
          15 kB
          Dhruba Borthakur
        3. FileSystemUnique2.txt
          15 kB
          Dhruba Borthakur

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HDFS-422 fuse-dfs leaks FileSystem handles as it never disconnects them because the FileSystem.Cache does not do reference counting

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-1900 MapReduce daemons should close FileSystems that are not needed anymore

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-10792 Add FileSystem#closeIfNotReferred method

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              dhruba Dhruba Borthakur
              hong.tang Hong Tang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: