[HADOOP-7172] SecureIO should not check owner on non-secure clusters that have no native support

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.22.0
• Fix Version/s: 0.22.0, 0.23.0
• Component/s: io, security
• Hadoop Flags: Reviewed
• Assignee: Todd Lipcon
• Reporter: Todd Lipcon
• Created: 08/Mar/11 06:56
• Updated: 02/May/13 02:29
• Resolved: 22/Apr/11 16:20

Description

The SecureIOUtils.openForRead function currently uses a racy stat/open combo if security is disabled and the native libraries are not available. This ends up shelling out to "ls -ld" which is very very slow. We've seen this cause significant performance regressions on clusters that match this profile.

Since the racy permissions check doesn't buy us any security anyway, we should just fall back to a normal "open" without any stat() at all, if we can't use the native support to do it efficiently.

Issue Links

• depends upon: HADOOP-7115 Add a cache for getpwuid_r and getpwgid_r calls