Currently, RawLocalFileSystem.DeprecatedRawLocalFileStatus#loadPermissionInfo is implemented as forking an ls command and parsing the output. This was observed to be a bottleneck in YARN-3491. This issue proposes an optional native implementation of a stat syscall through JNI. We would maintain the existing code as a fallback for systems where the native code is not available.
- duplicates
-
HADOOP-14600 LocatedFileStatus constructor forces RawLocalFS to exec a process to get the permissions
-
- Resolved
-
- is depended upon by
-
YARN-3549 use JNI-based FileStatus implementation from io.nativeio.NativeIO.POSIX#getFstat instead of shell-based implementation from RawLocalFileSystem in checkLocalDir.
-
- Resolved
-
- is duplicated by
-
YARN-3549 use JNI-based FileStatus implementation from io.nativeio.NativeIO.POSIX#getFstat instead of shell-based implementation from RawLocalFileSystem in checkLocalDir.
-
- Resolved
-
- is related to
-
HADOOP-12603 TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail
-
- Resolved
-
- links to