Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10783

apache-commons-lang.jar 2.6 does not support FreeBSD -upgrade to 3.x needed

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.4.1
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Hadoop-2.4.1 ships with apache-commons.jar version 2.6.
      It does not support FreeBSD (IS_OS_UNIX returns False).

      This is fixed in recent versions of apache-commons.jar

      Please update apache-commons.jar to recent version so it correctly recognizes FreeBSD as UNIX-like system.

      Right now I get in datanode's log:
      2014-07-04 11:58:10,459 DEBUG org.apache.hadoop.hdfs.server.datanode.ShortCircui
      tRegistry: Disabling ShortCircuitRegistry
      java.io.IOException: The OS is not UNIX.
      at org.apache.hadoop.io.nativeio.SharedFileDescriptorFactory.create(SharedFileDescriptorFactory.java:77)
      at org.apache.hadoop.hdfs.server.datanode.ShortCircuitRegistry.<init>(ShortCircuitRegistry.java:169)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.initDataXceiver(DataNode.java:583)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:771)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:289)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1931)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1818)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1865)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2041)
      at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2065)

      1. commons-lang3_1.patch
        106 kB
        Dmitry Sivachenko

        Issue Links

          Activity

          Hide
          aw Allen Wittenauer added a comment -

          Cancelling patch, as it no longer applies.

          Show
          aw Allen Wittenauer added a comment - Cancelling patch, as it no longer applies.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12656057/commons-lang3_1.patch
          against trunk revision b3d8a64.

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4946//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12656057/commons-lang3_1.patch against trunk revision b3d8a64. -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4946//console This message is automatically generated.
          Hide
          raviprak Ravi Prakash added a comment -

          Instead of outright replacing lang2, can we add lang3 too?

          Show
          raviprak Ravi Prakash added a comment - Instead of outright replacing lang2, can we add lang3 too?
          Hide
          trtrmitya Dmitry Sivachenko added a comment -

          BTH, I don't understand what to do now:
          If I run those test which fail at jenkins, they work on my Ubuntu 12.04 box.

          If I run all tests at this machine, I get several other tests failing (should all 100% tests pass or there are some known broken ones? I see bug reports which state some tests do not work for others too).

          So I am stuck with this change.

          Show
          trtrmitya Dmitry Sivachenko added a comment - BTH, I don't understand what to do now: If I run those test which fail at jenkins, they work on my Ubuntu 12.04 box. If I run all tests at this machine, I get several other tests failing (should all 100% tests pass or there are some known broken ones? I see bug reports which state some tests do not work for others too). So I am stuck with this change.
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12656057/commons-lang3_1.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 31 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          -1 findbugs. The patch appears to cause Findbugs (version 2.0.3) to fail.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-auth hadoop-common-project/hadoop-common hadoop-common-project/hadoop-minikdc hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-tools/hadoop-gridmix hadoop-tools/hadoop-rumen hadoop-tools/hadoop-streaming hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:

          org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl
          org.apache.hadoop.fs.TestSymlinkLocalFSFileContext
          org.apache.hadoop.ipc.TestIPC
          org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem
          org.apache.hadoop.streaming.TestMultipleArchiveFiles
          org.apache.hadoop.streaming.TestStreamingBadRecords
          org.apache.hadoop.streaming.TestStreamingOutputKeyValueTypes
          org.apache.hadoop.streaming.TestStreamAggregate
          org.apache.hadoop.streaming.TestStreamReduceNone
          org.apache.hadoop.streaming.TestUnconsumedInput
          org.apache.hadoop.streaming.mapreduce.TestStreamXmlRecordReader
          org.apache.hadoop.streaming.TestGzipInput
          org.apache.hadoop.streaming.TestStreaming
          org.apache.hadoop.streaming.TestStreamingFailure
          org.apache.hadoop.streaming.TestStreamingSeparator
          org.apache.hadoop.streaming.TestStreamingCounters
          org.apache.hadoop.streaming.TestFileArgs
          org.apache.hadoop.streaming.TestStreamDataProtocol
          org.apache.hadoop.streaming.TestStreamingExitStatus
          org.apache.hadoop.streaming.TestSymLink
          org.apache.hadoop.streaming.TestRawBytesStreaming
          org.apache.hadoop.streaming.TestStreamingCombiner
          org.apache.hadoop.streaming.TestStreamingStderr
          org.apache.hadoop.streaming.TestTypedBytesStreaming
          org.apache.hadoop.streaming.TestStreamingBackground
          org.apache.hadoop.streaming.TestStreamXmlRecordReader
          org.apache.hadoop.streaming.TestStreamingKeyValue
          org.apache.hadoop.streaming.TestStreamXmlMultipleRecords
          org.apache.hadoop.streaming.TestMultipleCachefiles
          org.apache.hadoop.streaming.TestStreamingOutputOnlyKeys
          org.apache.hadoop.yarn.util.TestFSDownload
          org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService
          org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps
          org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart
          org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs
          org.apache.hadoop.yarn.server.resourcemanager.TestRM
          org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA
          org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover

          The test build failed in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-tools/hadoop-rumen hadoop-tools/hadoop-gridmix hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/4292//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4292//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12656057/commons-lang3_1.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 31 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. -1 findbugs . The patch appears to cause Findbugs (version 2.0.3) to fail. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-auth hadoop-common-project/hadoop-common hadoop-common-project/hadoop-minikdc hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-tools/hadoop-gridmix hadoop-tools/hadoop-rumen hadoop-tools/hadoop-streaming hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl org.apache.hadoop.fs.TestSymlinkLocalFSFileContext org.apache.hadoop.ipc.TestIPC org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem org.apache.hadoop.streaming.TestMultipleArchiveFiles org.apache.hadoop.streaming.TestStreamingBadRecords org.apache.hadoop.streaming.TestStreamingOutputKeyValueTypes org.apache.hadoop.streaming.TestStreamAggregate org.apache.hadoop.streaming.TestStreamReduceNone org.apache.hadoop.streaming.TestUnconsumedInput org.apache.hadoop.streaming.mapreduce.TestStreamXmlRecordReader org.apache.hadoop.streaming.TestGzipInput org.apache.hadoop.streaming.TestStreaming org.apache.hadoop.streaming.TestStreamingFailure org.apache.hadoop.streaming.TestStreamingSeparator org.apache.hadoop.streaming.TestStreamingCounters org.apache.hadoop.streaming.TestFileArgs org.apache.hadoop.streaming.TestStreamDataProtocol org.apache.hadoop.streaming.TestStreamingExitStatus org.apache.hadoop.streaming.TestSymLink org.apache.hadoop.streaming.TestRawBytesStreaming org.apache.hadoop.streaming.TestStreamingCombiner org.apache.hadoop.streaming.TestStreamingStderr org.apache.hadoop.streaming.TestTypedBytesStreaming org.apache.hadoop.streaming.TestStreamingBackground org.apache.hadoop.streaming.TestStreamXmlRecordReader org.apache.hadoop.streaming.TestStreamingKeyValue org.apache.hadoop.streaming.TestStreamXmlMultipleRecords org.apache.hadoop.streaming.TestMultipleCachefiles org.apache.hadoop.streaming.TestStreamingOutputOnlyKeys org.apache.hadoop.yarn.util.TestFSDownload org.apache.hadoop.yarn.server.resourcemanager.TestClientRMService org.apache.hadoop.yarn.server.resourcemanager.webapp.TestRMWebServicesApps org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart org.apache.hadoop.yarn.server.resourcemanager.TestApplicationACLs org.apache.hadoop.yarn.server.resourcemanager.TestRM org.apache.hadoop.hdfs.tools.TestDFSAdminWithHA org.apache.hadoop.hdfs.server.namenode.ha.TestPipelinesFailover The test build failed in hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-tools/hadoop-rumen hadoop-tools/hadoop-gridmix hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/4292//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4292//console This message is automatically generated.
          Hide
          trtrmitya Dmitry Sivachenko added a comment -

          I am attaching another patch (trying to solve problems found by Jenkins)

          Show
          trtrmitya Dmitry Sivachenko added a comment - I am attaching another patch (trying to solve problems found by Jenkins)
          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12655528/commons-lang3.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 30 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          -1 javadoc. The javadoc tool appears to have generated 3 warning messages.
          See https://builds.apache.org/job/PreCommit-HADOOP-Build/4264//artifact/trunk/patchprocess/diffJavadocWarnings.txt for details.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          -1 findbugs. The patch appears to cause Findbugs (version 2.0.3) to fail.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-auth hadoop-common-project/hadoop-common hadoop-common-project/hadoop-minikdc hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-tools/hadoop-gridmix hadoop-tools/hadoop-rumen hadoop-tools/hadoop-streaming hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:

          org.apache.hadoop.fs.TestSymlinkLocalFSFileContext
          org.apache.hadoop.ipc.TestIPC
          org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem
          org.apache.hadoop.streaming.TestMultipleArchiveFiles
          org.apache.hadoop.streaming.TestStreamingBadRecords
          org.apache.hadoop.streaming.TestStreamingOutputKeyValueTypes
          org.apache.hadoop.streaming.TestStreamAggregate
          org.apache.hadoop.streaming.TestStreamReduceNone
          org.apache.hadoop.streaming.TestUnconsumedInput
          org.apache.hadoop.streaming.mapreduce.TestStreamXmlRecordReader
          org.apache.hadoop.streaming.TestGzipInput
          org.apache.hadoop.streaming.TestStreaming
          org.apache.hadoop.streaming.TestStreamingFailure
          org.apache.hadoop.streaming.TestStreamingSeparator
          org.apache.hadoop.streaming.TestStreamingCounters
          org.apache.hadoop.streaming.TestFileArgs
          org.apache.hadoop.streaming.TestStreamDataProtocol
          org.apache.hadoop.streaming.TestStreamingExitStatus
          org.apache.hadoop.streaming.TestSymLink
          org.apache.hadoop.streaming.TestRawBytesStreaming
          org.apache.hadoop.streaming.TestStreamingCombiner
          org.apache.hadoop.streaming.TestStreamingStderr
          org.apache.hadoop.streaming.TestTypedBytesStreaming
          org.apache.hadoop.streaming.TestStreamingBackground
          org.apache.hadoop.streaming.TestStreamXmlRecordReader
          org.apache.hadoop.streaming.TestStreamingKeyValue
          org.apache.hadoop.streaming.TestStreamXmlMultipleRecords
          org.apache.hadoop.streaming.TestMultipleCachefiles
          org.apache.hadoop.streaming.TestStreamingOutputOnlyKeys
          org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell
          org.apache.hadoop.yarn.util.TestFSDownload
          org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler

          The test build failed in hadoop-tools/hadoop-rumen hadoop-tools/hadoop-gridmix hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/4264//testReport/
          Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4264//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12655528/commons-lang3.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 30 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. -1 javadoc . The javadoc tool appears to have generated 3 warning messages. See https://builds.apache.org/job/PreCommit-HADOOP-Build/4264//artifact/trunk/patchprocess/diffJavadocWarnings.txt for details. +1 eclipse:eclipse . The patch built with eclipse:eclipse. -1 findbugs . The patch appears to cause Findbugs (version 2.0.3) to fail. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-auth hadoop-common-project/hadoop-common hadoop-common-project/hadoop-minikdc hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-tools/hadoop-gridmix hadoop-tools/hadoop-rumen hadoop-tools/hadoop-streaming hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager: org.apache.hadoop.fs.TestSymlinkLocalFSFileContext org.apache.hadoop.ipc.TestIPC org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem org.apache.hadoop.streaming.TestMultipleArchiveFiles org.apache.hadoop.streaming.TestStreamingBadRecords org.apache.hadoop.streaming.TestStreamingOutputKeyValueTypes org.apache.hadoop.streaming.TestStreamAggregate org.apache.hadoop.streaming.TestStreamReduceNone org.apache.hadoop.streaming.TestUnconsumedInput org.apache.hadoop.streaming.mapreduce.TestStreamXmlRecordReader org.apache.hadoop.streaming.TestGzipInput org.apache.hadoop.streaming.TestStreaming org.apache.hadoop.streaming.TestStreamingFailure org.apache.hadoop.streaming.TestStreamingSeparator org.apache.hadoop.streaming.TestStreamingCounters org.apache.hadoop.streaming.TestFileArgs org.apache.hadoop.streaming.TestStreamDataProtocol org.apache.hadoop.streaming.TestStreamingExitStatus org.apache.hadoop.streaming.TestSymLink org.apache.hadoop.streaming.TestRawBytesStreaming org.apache.hadoop.streaming.TestStreamingCombiner org.apache.hadoop.streaming.TestStreamingStderr org.apache.hadoop.streaming.TestTypedBytesStreaming org.apache.hadoop.streaming.TestStreamingBackground org.apache.hadoop.streaming.TestStreamXmlRecordReader org.apache.hadoop.streaming.TestStreamingKeyValue org.apache.hadoop.streaming.TestStreamXmlMultipleRecords org.apache.hadoop.streaming.TestMultipleCachefiles org.apache.hadoop.streaming.TestStreamingOutputOnlyKeys org.apache.hadoop.yarn.applications.distributedshell.TestDistributedShell org.apache.hadoop.yarn.util.TestFSDownload org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler The test build failed in hadoop-tools/hadoop-rumen hadoop-tools/hadoop-gridmix hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HADOOP-Build/4264//testReport/ Console output: https://builds.apache.org/job/PreCommit-HADOOP-Build/4264//console This message is automatically generated.
          Hide
          trtrmitya Dmitry Sivachenko added a comment -

          I am attaching a patch for this update.

          Show
          trtrmitya Dmitry Sivachenko added a comment - I am attaching a patch for this update.
          Hide
          trtrmitya Dmitry Sivachenko added a comment -

          Well, I am not much familiar with maven build system (this change will require to update some maven stuff too?).
          I can generate diff for Java files if you want (though I doubt it will be of much help because it is trivial addition of "3":
          lang->lang3).

          Of course I understand that it should go to trunk first.
          At least this will mean that this change will ever appear in stable version.

          Show
          trtrmitya Dmitry Sivachenko added a comment - Well, I am not much familiar with maven build system (this change will require to update some maven stuff too?). I can generate diff for Java files if you want (though I doubt it will be of much help because it is trivial addition of "3": lang->lang3). Of course I understand that it should go to trunk first. At least this will mean that this change will ever appear in stable version.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          presumably this is a reference to apache commons-lang.

          2.6 is the last "legacy" release; there is now a commons-lang 3 release. This does look more modern, but an upgrade seems traumatic as it requires every import to be changed.

          There's benefits in doing this from the project's improvements, but there's 100+ imports that would need changing. That's a significant enough change that it would have to go into trunk and then be backported to branch-2 when people were happy. We'd also have to think about retaining the -2.6 jar on our classpath for the entirety of the hadoop 2.x lifetime to avoid breaking downstream projects that depend on it.

          If you can supply a patch for trunk we to do this we can review it

          (As you are clearly trying to get Hadoop working on BSD, you should switch to trunk because that is where fixes will go in. Consider also writing an Uber-JIRA "get Hadoop working on BSD" to which you can make these sub tasks or dependencies. Please also put "FreeBSD" in the environment field")

          Show
          stevel@apache.org Steve Loughran added a comment - presumably this is a reference to apache commons-lang. 2.6 is the last "legacy" release; there is now a commons-lang 3 release. This does look more modern, but an upgrade seems traumatic as it requires every import to be changed . There's benefits in doing this from the project's improvements, but there's 100+ imports that would need changing. That's a significant enough change that it would have to go into trunk and then be backported to branch-2 when people were happy. We'd also have to think about retaining the -2.6 jar on our classpath for the entirety of the hadoop 2.x lifetime to avoid breaking downstream projects that depend on it. If you can supply a patch for trunk we to do this we can review it (As you are clearly trying to get Hadoop working on BSD, you should switch to trunk because that is where fixes will go in. Consider also writing an Uber-JIRA "get Hadoop working on BSD" to which you can make these sub tasks or dependencies. Please also put "FreeBSD" in the environment field")

            People

            • Assignee:
              stevel@apache.org Steve Loughran
              Reporter:
              trtrmitya Dmitry Sivachenko
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:

                Development