Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.1
    • Fix Version/s: 0.23.1
    • Component/s: mrv2
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      NM throws an error on submitting an MR job via oozie on the latest Hadoop 23.
      *Courtesy: Mona Chitnis (ooize)

      1. MR-3696.patch
        5 kB
        John George
      2. MR-3696.patch
        6 kB
        John George
      3. MR-3696.patch
        7 kB
        John George

        Activity

        Hide
        John George added a comment -

        Hadoop 23 installation on a <secure> cluster and on submitting an MR job via Oozie, we see the
        following error in the NM container logs

        FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
        java.lang.NoSuchMethodError:
        org.codehaus.jackson.JsonFactory.enable(Lorg/codehaus/jackson/JsonParser$Feature;)Lorg/codehaus/jackson/JsonFactory;
        at org.apache.avro.Schema.<clinit>(Schema.java:82)
        at org.apache.hadoop.mapreduce.jobhistory.AMStarted.<clinit>(AMStarted.java:9)
        at org.apache.hadoop.mapreduce.jobhistory.AMStartedEvent.<init>(AMStartedEvent.java:36)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.start(MRAppMaster.java:783)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.run(MRAppMaster.java:960)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:956)
        at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:943)

        JsonFactory.class is packaged in jackson-core-asl.jar, and versions 1.2 and above contain the aforementioned enable()
        method. We are packaging Oozie with jar version jackson-core-asl-1.7.1.jar and jackson-mapper-asl-1.7.1.jar. Is there
        some linking taking place to a stale version 1.0.1 of the jackson jar?

        An older JIRA HADOOP-7606, mentions explicit maven dependency for this version in the pom.xml. I tried including a
        similar dependency explicitly for Oozie's POM while building, but no difference.

        Show
        John George added a comment - Hadoop 23 installation on a <secure> cluster and on submitting an MR job via Oozie, we see the following error in the NM container logs FATAL [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster java.lang.NoSuchMethodError: org.codehaus.jackson.JsonFactory.enable(Lorg/codehaus/jackson/JsonParser$Feature;)Lorg/codehaus/jackson/JsonFactory; at org.apache.avro.Schema.<clinit>(Schema.java:82) at org.apache.hadoop.mapreduce.jobhistory.AMStarted.<clinit>(AMStarted.java:9) at org.apache.hadoop.mapreduce.jobhistory.AMStartedEvent.<init>(AMStartedEvent.java:36) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.start(MRAppMaster.java:783) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$1.run(MRAppMaster.java:960) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:956) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:943) JsonFactory.class is packaged in jackson-core-asl.jar, and versions 1.2 and above contain the aforementioned enable() method. We are packaging Oozie with jar version jackson-core-asl-1.7.1.jar and jackson-mapper-asl-1.7.1.jar. Is there some linking taking place to a stale version 1.0.1 of the jackson jar? An older JIRA HADOOP-7606 , mentions explicit maven dependency for this version in the pom.xml. I tried including a similar dependency explicitly for Oozie's POM while building, but no difference.
        Hide
        Mahadev konar added a comment -

        @John,
        Am not sure am getting why this is related to Oozie. On the same setup are you able to run any other jobs? I think this might just be a deployment issue.

        Show
        Mahadev konar added a comment - @John, Am not sure am getting why this is related to Oozie. On the same setup are you able to run any other jobs? I think this might just be a deployment issue.
        Hide
        John George added a comment -

        Yes - I am able to run other jobs. I have a hunch as well that this might just be a deployment/setup issue, but still wanted to file a JIRA just-in-case.

        Show
        John George added a comment - Yes - I am able to run other jobs. I have a hunch as well that this might just be a deployment/setup issue, but still wanted to file a JIRA just-in-case.
        Hide
        Mahadev konar added a comment -

        @John,
        I think I know what the issue might be. Let me run some experiments and post on the jira.

        Show
        Mahadev konar added a comment - @John, I think I know what the issue might be. Let me run some experiments and post on the jira.
        Hide
        John George added a comment -

        The issue is that oozie is including a pig.jar file that picks up an older version of jackson. But what confuses me is that the pig.jar gets picked up before all the hadoop jars.
        Assuming that oozie does not force USER CLASSPATHs to be picked up first, I wonder if it is wrong for App Master to include that before the default hadoop jars.
        The following is what I am seeing in the launch_container.sh script.

        export CLASSPATH="job.jar:$PWD/*:file:/gri

        and

        ln -sf "/grid/1/tmp/mapred-local/filecache/7267871525837532837/pig.jar" "pig.jar"

        which obviously means that pig.jar in $PWD is going to be picked up before jackson-.jar in the hadoop lib directory - which does not seem right.

        Show
        John George added a comment - The issue is that oozie is including a pig.jar file that picks up an older version of jackson. But what confuses me is that the pig.jar gets picked up before all the hadoop jars. Assuming that oozie does not force USER CLASSPATHs to be picked up first, I wonder if it is wrong for App Master to include that before the default hadoop jars. The following is what I am seeing in the launch_container.sh script. export CLASSPATH="job.jar:$PWD/*: file:/gri and ln -sf "/grid/1/tmp/mapred-local/filecache/7267871525837532837/pig.jar" "pig.jar" which obviously means that pig.jar in $PWD is going to be picked up before jackson- .jar in the hadoop lib directory - which does not seem right.
        Hide
        Alejandro Abdelnur added a comment -

        @John, don't know what version of Pig you are using, but 0.9.0 which is avail in the maven repo does not include 3rd party JARs. still i'm seeing that the Pig POM declares as dependency jackson 1.4.2 and those JARs are pulled into Oozie's sharelib. (Oozie trunk speaking)

        Show
        Alejandro Abdelnur added a comment - @John, don't know what version of Pig you are using, but 0.9.0 which is avail in the maven repo does not include 3rd party JARs. still i'm seeing that the Pig POM declares as dependency jackson 1.4.2 and those JARs are pulled into Oozie's sharelib. (Oozie trunk speaking)
        Hide
        John George added a comment -

        So, Pig needs to upgrade its jackson dependency for oozie to run a pig job then I guess. Either way, shouldn't the classpath have hadoop jars before the apps current directory?

        export CLASSPATH="job.jar:$PWD/*:file:/gri

        Show
        John George added a comment - So, Pig needs to upgrade its jackson dependency for oozie to run a pig job then I guess. Either way, shouldn't the classpath have hadoop jars before the apps current directory? export CLASSPATH="job.jar:$PWD/*: file:/gri
        Hide
        Mahadev konar added a comment - - edited

        John,
        In 0.20.* series there is a specific property to add your own jars before the MR framework jars. We'll have to dig into it to see if that works or not. If that works then it might just be using htat flag to put your jars in front of the others jars.

        Show
        Mahadev konar added a comment - - edited John, In 0.20.* series there is a specific property to add your own jars before the MR framework jars. We'll have to dig into it to see if that works or not. If that works then it might just be using htat flag to put your jars in front of the others jars.
        Hide
        John George added a comment -

        @Mahadev -I see that the launch container script has the same order in classpath when I run a wordcount using hadoop script.

        Show
        John George added a comment - @Mahadev -I see that the launch container script has the same order in classpath when I run a wordcount using hadoop script.
        Hide
        Mahadev konar added a comment - - edited

        John,
        Just for reference, MAPREDUCE-1938 added this property to be able to add your jars before others. Seems like in 0.23 we are doing that by default. We should maintain backwards compatibility and make sure that we load users jar later than hadoop jars unless the property is set as in MAPREDUCE-1938.

        Show
        Mahadev konar added a comment - - edited John, Just for reference, MAPREDUCE-1938 added this property to be able to add your jars before others. Seems like in 0.23 we are doing that by default. We should maintain backwards compatibility and make sure that we load users jar later than hadoop jars unless the property is set as in MAPREDUCE-1938 .
        Hide
        Mahadev konar added a comment -

        @John,
        Just to confirm, the property is backwards compatible with 1.0 right?

        Show
        Mahadev konar added a comment - @John, Just to confirm, the property is backwards compatible with 1.0 right?
        Hide
        Mahadev konar added a comment -

        Not sure why hudson didnt run this. Will trigger it manually.

        Show
        Mahadev konar added a comment - Not sure why hudson didnt run this. Will trigger it manually.
        Hide
        John George added a comment -

        @Mahadev - the previous patch was using USER_JOB_CLASSPATH_FIRST as compared to it MAPREDUCE_JOB_USER_CLASSPATH_FIRST in 1.0. Hence will upload a new patch to ensure that it is compatible with 1.0. Behavior wise, afai can tell, it is compatible.

        Show
        John George added a comment - @Mahadev - the previous patch was using USER_JOB_CLASSPATH_FIRST as compared to it MAPREDUCE_JOB_USER_CLASSPATH_FIRST in 1.0. Hence will upload a new patch to ensure that it is compatible with 1.0. Behavior wise, afai can tell, it is compatible.
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12511842/MR-3696.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 3 new or modified tests.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1684//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1684//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12511842/MR-3696.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1684//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1684//console This message is automatically generated.
        Hide
        Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12512019/MR-3696.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 3 new or modified tests.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in .

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1686//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1686//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12512019/MR-3696.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1686//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1686//console This message is automatically generated.
        Hide
        Mahadev konar added a comment -

        @john,
        One more thing I forgot to mention. In 1.0, you'd have to set:

         export HADOOP_USER_CLASSPATH_FIRST=true
        

        for submit/client side to use your HADOOP_CLASS_PATH before frameworks. Does that work here as well? If not we'd have to fix that too before claiming victory on the classpath issue.

        Show
        Mahadev konar added a comment - @john, One more thing I forgot to mention. In 1.0, you'd have to set: export HADOOP_USER_CLASSPATH_FIRST= true for submit/client side to use your HADOOP_CLASS_PATH before frameworks. Does that work here as well? If not we'd have to fix that too before claiming victory on the classpath issue.
        Hide
        John George added a comment -

        Thanks for looking at this Mahadev.
        Attaching a patch with HADOOP_USER_CLASSPATH_FIRST changes as well.

        Show
        John George added a comment - Thanks for looking at this Mahadev. Attaching a patch with HADOOP_USER_CLASSPATH_FIRST changes as well.
        Hide
        Mahadev konar added a comment -

        @John,
        Sorry to keep bringing up new issues on this but I think we need a change for fixing the task classpaths to do the same as well and obey the property (or maybe its already fixed and we just need to make sure it is).

        Show
        Mahadev konar added a comment - @John, Sorry to keep bringing up new issues on this but I think we need a change for fixing the task classpaths to do the same as well and obey the property (or maybe its already fixed and we just need to make sure it is).
        Hide
        John George added a comment -

        Mahadev - verified that mapreduce.job.user.classpath.first gets propagated to both the AppM and the tasks by looking at the launch_container.sh script.

        Show
        John George added a comment - Mahadev - verified that mapreduce.job.user.classpath.first gets propagated to both the AppM and the tasks by looking at the launch_container.sh script.
        Hide
        John George added a comment -

        Mahadev - verified that the classpath on both the AM and tasks containers are the same by looking at the launch_container.sh CLASSPATH after passing in the mapreduce.job.user.classpath.first=true.

        Show
        John George added a comment - Mahadev - verified that the classpath on both the AM and tasks containers are the same by looking at the launch_container.sh CLASSPATH after passing in the mapreduce.job.user.classpath.first=true.
        Hide
        Mahadev konar added a comment -

        Thanks John for testing it out. The patch looks good to me. Ill go ahead and commit it.

        Show
        Mahadev konar added a comment - Thanks John for testing it out. The patch looks good to me. Ill go ahead and commit it.
        Hide
        Mahadev konar added a comment -

        I just committed this. Thanks John!

        Show
        Mahadev konar added a comment - I just committed this. Thanks John!
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-trunk-Commit #1635 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1635/)
        MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239310
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-trunk-Commit #1635 (See https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1635/ ) MAPREDUCE-3696 . MR job via oozie does not work on hadoop 23. (John George via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239310 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Common-0.23-Commit #463 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/463/)
        MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev) - Merging r1239310 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239312
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Show
        Hudson added a comment - Integrated in Hadoop-Common-0.23-Commit #463 (See https://builds.apache.org/job/Hadoop-Common-0.23-Commit/463/ ) MAPREDUCE-3696 . MR job via oozie does not work on hadoop 23. (John George via mahadev) - Merging r1239310 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239312 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk-Commit #1706 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1706/)
        MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239310
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk-Commit #1706 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1706/ ) MAPREDUCE-3696 . MR job via oozie does not work on hadoop 23. (John George via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239310 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Commit #453 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/453/)
        MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev) - Merging r1239310 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239312
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Commit #453 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/453/ ) MAPREDUCE-3696 . MR job via oozie does not work on hadoop 23. (John George via mahadev) - Merging r1239310 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239312 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk-Commit #1651 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1651/)
        MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239310
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #1651 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1651/ ) MAPREDUCE-3696 . MR job via oozie does not work on hadoop 23. (John George via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239310 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Commit #477 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/477/)
        MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev) - Merging r1239310 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239312
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Commit #477 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/477/ ) MAPREDUCE-3696 . MR job via oozie does not work on hadoop 23. (John George via mahadev) - Merging r1239310 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239312 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #944 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/944/)
        MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239310
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #944 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/944/ ) MAPREDUCE-3696 . MR job via oozie does not work on hadoop 23. (John George via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239310 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Hdfs-0.23-Build #157 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/157/)
        MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev) - Merging r1239310 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239312
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Show
        Hudson added a comment - Integrated in Hadoop-Hdfs-0.23-Build #157 (See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/157/ ) MAPREDUCE-3696 . MR job via oozie does not work on hadoop 23. (John George via mahadev) - Merging r1239310 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239312 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-0.23-Build #179 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/179/)
        MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev) - Merging r1239310 from trunk.

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239312
        Files :

        • /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-0.23-Build #179 (See https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/179/ ) MAPREDUCE-3696 . MR job via oozie does not work on hadoop 23. (John George via mahadev) - Merging r1239310 from trunk. mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239312 Files : /hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Hide
        Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #977 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/977/)
        MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev)

        mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239310
        Files :

        • /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh
        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
        Show
        Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #977 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/977/ ) MAPREDUCE-3696 . MR job via oozie does not work on hadoop 23. (John George via mahadev) mahadev : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1239310 Files : /hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/bin/hadoop-config.sh /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java

          People

          • Assignee:
            John George
            Reporter:
            John George
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development