[HADOOP-9413] Introduce common utils for File#setReadable/Writable/Executable and File#canRead/Write/Execute that work cross-platform

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.1.0-beta
• Hadoop Flags: Reviewed
• Assignee: Ivan Mitic
• Reporter: Ivan Mitic
• Created: 19/Mar/13 01:50
• Updated: 27/Aug/13 22:06
• Resolved: 29/Apr/13 22:14

Description

So far, we've seen many unittest and product bugs in Hadoop on Windows because Java's APIs that manipulate with permissions do not work as expected. We've addressed many of these problems on one-by-one basis (by either changing code a bit or disabling the test). While debugging the remaining unittest failures we continue to run into the same patterns of problems, and instead of addressing them one-by-one, I propose that we expose a set of equivalent wrapper APIs that will work well for all platforms.

Scanning thru the codebase, this will actually be a simple change as there are very few places that use File#setReadable/Writable/Executable and File#canRead/Write/Execute (5 files in Common, 9 files in HDFS).

HADOOP-8973 contains additional context on the problem.

Issue Links

• is depended upon by: HDFS-4610 Move to using common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute
• is depended upon by: MAPREDUCE-5177 Move to common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute
• is depended upon by: YARN-506 Move to common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute
• is related to: HADOOP-8562 Enhancements to support Hadoop on Windows Server and Windows Azure environments
• relates to: HADOOP-9551 Backport common utils introduced with HADOOP-9413 to branch-1-win
• relates to: HADOOP-8973 DiskChecker cannot reliably detect an inaccessible disk on Windows with NTFS ACLs
• relates to: HADOOP-9590 Move to JDK7 improved APIs for file operations when available