Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10783

apache-commons-lang.jar 2.6 does not support FreeBSD -upgrade to 3.x needed

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Done
    • None
    • 3.2.0
    • None
    • None

    Description

      Hadoop-2.4.1 ships with apache-commons.jar version 2.6.
      It does not support FreeBSD (IS_OS_UNIX returns False).

      This is fixed in recent versions of apache-commons.jar

      Please update apache-commons.jar to recent version so it correctly recognizes FreeBSD as UNIX-like system.

      Right now I get in datanode's log:
      2014-07-04 11:58:10,459 DEBUG org.apache.hadoop.hdfs.server.datanode.ShortCircui
      tRegistry: Disabling ShortCircuitRegistry
      java.io.IOException: The OS is not UNIX.
      at org.apache.hadoop.io.nativeio.SharedFileDescriptorFactory.create(SharedFileDescriptorFactory.java:77)
      at org.apache.hadoop.hdfs.server.datanode.ShortCircuitRegistry.<init>(ShortCircuitRegistry.java:169)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.initDataXceiver(DataNode.java:583)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:771)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:289)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1931)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1818)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1865)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2041)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2065)

      Attachments

        1. commons-lang3_1.patch
          106 kB
          Dmitry Sivachenko
        2. HADOOP-10783.2.patch
          344 kB
          Takanobu Asanuma
        3. HADOOP-10783.3.patch
          344 kB
          Takanobu Asanuma
        4. HADOOP-10783.4.patch
          345 kB
          Takanobu Asanuma
        5. HADOOP-10783.5.patch
          348 kB
          Takanobu Asanuma
        6. HADOOP-10783.6.patch
          348 kB
          Takanobu Asanuma

        Issue Links

        Dependent

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-15531 Use commons-text instead of commons-lang in some classes to fix deprecation warnings

        • Major - Major loss of function.
        • Resolved
        incorporates

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-15594 Exclude commons-lang3 from hadoop-client-minicluster

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-15495 Upgrade common-lang version to 3.7 in hadoop-common-project and hadoop-tools

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HDDS-157 Upgrade common-langs version to 3.7 in HDDS and Ozone

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-13621 Upgrade common-lang version to 3.7 in hadoop-hdfs-project

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-7098 Upgrade common-langs version to 3.7 in hadoop-mapreduce-project

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. YARN-8363 Upgrade commons-lang version to 3.7 in hadoop-yarn-project

        • Major - Major loss of function.
        • Resolved
        is depended upon by

        Bug - A problem which impairs or prevents the functions of the product. HADOOP-10796 Porting Hadoop to FreeBSD

        • Major - Major loss of function.
        • Open
        relates to

        Bug - A problem which impairs or prevents the functions of the product. LANG-1397 WordUtils.wrap throws StringIndexOutOfBoundsException when wrapLength is Integer.MAX_VALUE

        • Major - Major loss of function.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. TEXT-123 WordUtils.wrap throws StringIndexOutOfBoundsException when wrapLength is Integer.MAX_VALUE

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HADOOP-9991 Fix up Hadoop POMs, roll up JARs to latest versions

        • Major - Major loss of function.
        • Open

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            trtrmitya Dmitry Sivachenko
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment