[HADOOP-6923] Native Libraries do not load if a different platform signature is returned from org.apache.hadoop.util.PlatformName

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.0, 0.20.1, 0.20.2
• Fix Version/s: 0.20.3
• Component/s: native

Environment

SLES 10, IBM Java 6, Apache Hadoop 0.20.x

• Hadoop Flags: Reviewed
• Assignee: Stephen Watt
• Reporter: Stephen Watt
• Created: 24/Aug/10 19:48
• Updated: 25/Jan/11 08:06
• Resolved: 24/Jan/11 19:36

Description

The bin/hadoop script has an environment variable called JAVA_PLATFORM which is set to to the results returned by org.apache.hadoop.util.PlatformName . These results are sometimes unique to the JRE being used. Although the value returned for 64 Bit Sun/Oracle Java and 64 Bit IBM Java is the same, it is different for the corresponding 32 Bit JREs.
The issue is that the value returned is used in creating the path to the native libraries on disk, i.e ${HADOOP_COMMON_HOME}/lib/native/${JAVA_PLATFORM}

Since the path on disk is fixed with the Sun JRE value /lib/native/Linux-i386-32 it therefore fails when it attempts to load the native libraries with the value returned with 32 Bit IBM Java, /lib/native/Linux-x86-32

Issue Links

• relates to: HADOOP-6895 Native Libraries do not load if a different platform signature is returned from org.apache.hadoop.util.PlatformName