[HADOOP-11127] Improve versioning and compatibility support in native library for downstream hadoop-common users.

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: native
• Assignee: Alan Burlison
• Reporter: Chris Nauroth
• Created: 24/Sep/14 23:09
• Updated: 19/Feb/19 10:37

Description

There is no compatibility policy enforced on the JNI function signatures implemented in the native library. This library typically is deployed to all nodes in a cluster, built from a specific source code version. However, downstream applications that want to run in that cluster might choose to bundle a hadoop-common jar at a different version. Since there is no compatibility policy, this can cause link errors at runtime when the native function signatures expected by hadoop-common.jar do not exist in libhadoop.so/hadoop.dll.

Issue Links

• blocks: HADOOP-12487 Make DomainSocket.close() portable
• blocks: HADOOP-12488 DomainSocket: Solaris does not support timeouts on AF_UNIX sockets
• relates to: HDFS-6974 MiniHDFScluster breaks if there is an out of date hadoop.lib on the lib path
• relates to: HADOOP-11064 UnsatisifedLinkError with hadoop 2.4 JARs on hadoop-2.6 due to NativeCRC32 method changes