[YARN-3549] use JNI-based FileStatus implementation from io.nativeio.NativeIO.POSIX#getFstat instead of shell-based implementation from RawLocalFileSystem in checkLocalDir.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Component/s: nodemanager
• Assignee: Zhihai Xu
• Reporter: Zhihai Xu
• Created: 27/Apr/15 19:05
• Updated: 25/Oct/19 20:25
• Resolved: 15/Jun/15 01:55

Description

Use JNI-based FileStatus implementation from io.nativeio.NativeIO.POSIX#getFstat instead of shell-based implementation from RawLocalFileSystem in checkLocalDir.
As discussed in YARN-3491, shell-based implementation getPermission runs shell command "ls -ld" to get permission, which take 4 or 5 ms(very slow).
We should switch to io.nativeio.NativeIO.POSIX#getFstat as implementation in RawLocalFileSystem to get rid of shell-based implementation for FileStatus.

Issue Links

• depends upon: HADOOP-11935 Provide optional native implementation of stat syscall.
• duplicates: HADOOP-11935 Provide optional native implementation of stat syscall.
• relates to: YARN-3491 PublicLocalizer#addResource is too slow.