[HADOOP-11064] UnsatisifedLinkError with hadoop 2.4 JARs on hadoop-2.6 due to NativeCRC32 method changes

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 2.6.0
• Fix Version/s: 2.6.0
• Component/s: native

Environment

Hadoop 2.6 cluster, trying to run code containing hadoop 2.4 JARs

• Hadoop Flags: Reviewed
• Assignee: Chris Nauroth
• Reporter: Steve Loughran
• Created: 05/Sep/14 09:32
• Updated: 16/Oct/15 17:30
• Resolved: 24/Sep/14 22:35

Description

The private native method names and signatures in NativeCrc32 were changed in HDFS-6561 ... as a result hadoop-common-2.4 JARs get unsatisifed link errors when they try to perform checksums.

This essentially stops Hadoop 2.4 applications running on Hadoop 2.6 unless rebuilt and repackaged with the hadoop- 2.6 JARs

Issue Links

• is broken by: HADOOP-10975 org.apache.hadoop.util.DataChecksum should support native checksum calculation
• is broken by: HDFS-3528 Use native CRC32 in DFS write path
• is related to: HADOOP-11127 Improve versioning and compatibility support in native library for downstream hadoop-common users.
• is related to: HADOOP-12488 DomainSocket: Solaris does not support timeouts on AF_UNIX sockets