To use our self-defined FileSystem class, the item of configuration "fs.%s.impl.disable.cache" should set to true.
In YARN's source code, the class named "org.apache.hadoop.yarn.util.FSDownload" use getFileSystem but never close, which leading to file descriptor leak because our self-defined FileSystem class close the file descriptor when the close function is invoked.
My Question below:
1. whether invoking "getFileSystem" but never close is YARN's expected behavior
2. what should we do in our self-defined FileSystem resolve it.