[HADOOP-10783] apache-commons-lang.jar 2.6 does not support FreeBSD -upgrade to 3.x needed

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Done
• Fix Version/s: 3.2.0
• Assignee: Unassigned
• Reporter: Dmitry Sivachenko
• Created: 04/Jul/14 08:43
• Updated: 06/Nov/18 05:52
• Resolved: 28/Jun/18 05:42

Description

Hadoop-2.4.1 ships with apache-commons.jar version 2.6.
It does not support FreeBSD (IS_OS_UNIX returns False).

This is fixed in recent versions of apache-commons.jar

Please update apache-commons.jar to recent version so it correctly recognizes FreeBSD as UNIX-like system.

Right now I get in datanode's log:
2014-07-04 11:58:10,459 DEBUG org.apache.hadoop.hdfs.server.datanode.ShortCircui
tRegistry: Disabling ShortCircuitRegistry
java.io.IOException: The OS is not UNIX.
at org.apache.hadoop.io.nativeio.SharedFileDescriptorFactory.create(SharedFileDescriptorFactory.java:77)
at org.apache.hadoop.hdfs.server.datanode.ShortCircuitRegistry.<init>(ShortCircuitRegistry.java:169)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initDataXceiver(DataNode.java:583)
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:771)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:289)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1931)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1818)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1865)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2041)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2065)

Issue Links

• Dependent: HADOOP-15531 Use commons-text instead of commons-lang in some classes to fix deprecation warnings
• incorporates: HADOOP-15594 Exclude commons-lang3 from hadoop-client-minicluster
• incorporates: HADOOP-15495 Upgrade common-lang version to 3.7 in hadoop-common-project and hadoop-tools
• incorporates: HDDS-157 Upgrade common-langs version to 3.7 in HDDS and Ozone
• incorporates: HDFS-13621 Upgrade common-lang version to 3.7 in hadoop-hdfs-project
• incorporates: MAPREDUCE-7098 Upgrade common-langs version to 3.7 in hadoop-mapreduce-project
• incorporates: YARN-8363 Upgrade commons-lang version to 3.7 in hadoop-yarn-project
• is depended upon by: HADOOP-10796 Porting Hadoop to FreeBSD
• relates to: LANG-1397 WordUtils.wrap throws StringIndexOutOfBoundsException when wrapLength is Integer.MAX_VALUE
• relates to: TEXT-123 WordUtils.wrap throws StringIndexOutOfBoundsException when wrapLength is Integer.MAX_VALUE
• relates to: HADOOP-9991 Fix up Hadoop POMs, roll up JARs to latest versions