[HDFS-422] fuse-dfs leaks FileSystem handles as it never disconnects them because the FileSystem.Cache does not do reference counting

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Component/s: fuse-dfs
• Assignee: Unassigned
• Reporter: Pete Wyckoff
• Created: 04/Oct/08 00:42
• Updated: 23/May/11 22:52
• Resolved: 23/May/11 22:52

Description

since users may be doing multiple file operations at the same time, a single task in fuse, can never call close() on a filesystem (ie libhdfs::hdfsDisconnect) because there may be another thread for the same user.

as such, either fuse-dfs needs to do reference counting or FileSystem.Cache needs to or maybe enable a mode where one can turn off the Cache??

I currently am not seeing any problems in production, but I am still running 0.18 version which keeps only one connection as root.

Issue Links

• duplicates: HDFS-420 Fuse-dfs should cache fs handles
• is blocked by: HADOOP-4655 FileSystem.CACHE should be ref-counted