Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5232

log classpath and other key properties on child JVM start

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.4-alpha
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: mrv1, mrv2
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      It would be great if we log vital information such as classpath, etc. upon a mapreduce child JVM start. This would help a great deal in terms of troubleshooting classpath issues, etc. Today it is pretty difficult to debug this unless you preserve the container script.

      Maybe it can log things like classpath, os name/version, java version, etc. at the beginning of the child JVM start.

      1. MAPREDUCE-5232.patch
        8 kB
        Sangjin Lee
      2. MAPREDUCE-5232.patch
        8 kB
        Sangjin Lee
      3. MAPREDUCE-5232.patch
        8 kB
        Sangjin Lee
      4. MAPREDUCE-5232-branch-2.patch
        8 kB
        Sangjin Lee
      5. MAPREDUCE-5232-branch-2.patch
        8 kB
        Sangjin Lee
      6. MAPREDUCE-5232-branch-2.patch
        8 kB
        Sangjin Lee

        Activity

        Hide
        sandyr Sandy Ryza added a comment -

        +1 to this

        Show
        sandyr Sandy Ryza added a comment - +1 to this
        Hide
        sjlee0 Sangjin Lee added a comment -

        Patch for branch-2

        Show
        sjlee0 Sangjin Lee added a comment - Patch for branch-2
        Hide
        sjlee0 Sangjin Lee added a comment -

        Patch for the trunk

        Show
        sjlee0 Sangjin Lee added a comment - Patch for the trunk
        Hide
        sjlee0 Sangjin Lee added a comment -

        I posted the proposed patch. I'm not 100% happy with the config names, and am open to suggestions.

        Show
        sjlee0 Sangjin Lee added a comment - I posted the proposed patch. I'm not 100% happy with the config names, and am open to suggestions.
        Hide
        hadoopqa Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12582546/MAPREDUCE-5232.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 1 new or modified test files.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3608//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3608//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12582546/MAPREDUCE-5232.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3608//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3608//console This message is automatically generated.
        Hide
        lohit Lohit Vijayarenu added a comment -

        Patch looks good. Two minor things I could think of
        1.

            if (conf.getBoolean(MRJobConfig.MAPREDUCE_CHILD_LOG_PROPERTIES_ON_START, false)) {
        

        Default define in .xml is true, while code works on false. Code should probably reflect what is in default.xml

        2. Instead of having 2 separate configs, we can get away with just mapreduce.child.log.properties. If that is set, then we log, if that is empty, then the feature is disable.

        Show
        lohit Lohit Vijayarenu added a comment - Patch looks good. Two minor things I could think of 1. if (conf.getBoolean(MRJobConfig.MAPREDUCE_CHILD_LOG_PROPERTIES_ON_START, false)) { Default define in .xml is true, while code works on false. Code should probably reflect what is in default.xml 2. Instead of having 2 separate configs, we can get away with just mapreduce.child.log.properties. If that is set, then we log, if that is empty, then the feature is disable.
        Hide
        sjlee0 Sangjin Lee added a comment -

        Thanks Lohit Vijayarenu. I agree having a single config may be fine. I'll update the patches.

        Show
        sjlee0 Sangjin Lee added a comment - Thanks Lohit Vijayarenu . I agree having a single config may be fine. I'll update the patches.
        Hide
        sjlee0 Sangjin Lee added a comment -

        Updated the patches.

        Show
        sjlee0 Sangjin Lee added a comment - Updated the patches.
        Hide
        hadoopqa Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12582659/MAPREDUCE-5232-branch-2.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 1 new or modified test files.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3612//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3612//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12582659/MAPREDUCE-5232-branch-2.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3612//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3612//console This message is automatically generated.
        Hide
        lohit Lohit Vijayarenu added a comment -

        +1 Patch looks good to me

        Show
        lohit Lohit Vijayarenu added a comment - +1 Patch looks good to me
        Hide
        vinodkv Vinod Kumar Vavilapalli added a comment -

        Can see the value for this. Some comments on the patch:

        • In MRAppMaster, the logging should be done after job.xml is added as a resource. Otherwise, AppMaster won't pick up this config. Please also test this manually.
        • MRApps: The "***********" marker will look ugly to print after each line. We should remove this.
        • MRJobConfig: MAPREDUCE_CHILD_LOG_PROPERTIES_ON_START isn't just for child. Rename the constant as well as the config name. It can simply be "mapreduce.jvm.system-properties-to-log"
        • Given above, also fix the description in mapred-default.xml
        • Also add a default constant in MRJobConf corresponding to the value in mapred-default.xml
        Show
        vinodkv Vinod Kumar Vavilapalli added a comment - Can see the value for this. Some comments on the patch: In MRAppMaster, the logging should be done after job.xml is added as a resource. Otherwise, AppMaster won't pick up this config. Please also test this manually. MRApps: The "***********" marker will look ugly to print after each line. We should remove this. MRJobConfig: MAPREDUCE_CHILD_LOG_PROPERTIES_ON_START isn't just for child. Rename the constant as well as the config name. It can simply be "mapreduce.jvm.system-properties-to-log" Given above, also fix the description in mapred-default.xml Also add a default constant in MRJobConf corresponding to the value in mapred-default.xml
        Hide
        sjlee0 Sangjin Lee added a comment -

        Vinod Kumar Vavilapalli thanks for the input.

        • My bad on MRAppMaster. I'll correct the patch for this.
        • My reason for adding those lines was to make it look similar to what other nodes were doing: StringUtils.toStartupShutdownString(). Also, these marker lines are not printed after each line, but only once when the JVM starts. Did I miss something?
        • The rest of the feedback sounds reasonable. Thanks!

        I'll incorporate the feedback, and upload new patches.

        Show
        sjlee0 Sangjin Lee added a comment - Vinod Kumar Vavilapalli thanks for the input. My bad on MRAppMaster. I'll correct the patch for this. My reason for adding those lines was to make it look similar to what other nodes were doing: StringUtils.toStartupShutdownString() . Also, these marker lines are not printed after each line, but only once when the JVM starts. Did I miss something? The rest of the feedback sounds reasonable. Thanks! I'll incorporate the feedback, and upload new patches.
        Hide
        vinodkv Vinod Kumar Vavilapalli added a comment -

        My reason for adding those lines was to make it look similar to what other nodes were doing: StringUtils.toStartupShutdownString(). Also, these marker lines are not printed after each line, but only once when the JVM starts. Did I miss something?

        No, I thought you were printing it after every property. Just checked the patch, that isn't the case. So it's fine as it is.

        Show
        vinodkv Vinod Kumar Vavilapalli added a comment - My reason for adding those lines was to make it look similar to what other nodes were doing: StringUtils.toStartupShutdownString(). Also, these marker lines are not printed after each line, but only once when the JVM starts. Did I miss something? No, I thought you were printing it after every property. Just checked the patch, that isn't the case. So it's fine as it is.
        Hide
        sjlee0 Sangjin Lee added a comment -

        Updated the patches. By the way, the build seems broken on branch-2 currently (before this patch).

        [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile (default-testCompile) on project hadoop-mapreduce-client-shuffle: Compilation failure: Compilation failure:
        [ERROR] /Users/sjlee/git/hadoop-common/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/test/java/org/apache/hadoop/mapred/TestShuffleHandler.java:[341,29] cannot find symbol
        [ERROR] symbol : variable POSIX
        [ERROR] location: class org.apache.hadoop.io.nativeio.NativeIO
        [ERROR] /Users/sjlee/git/hadoop-common/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/test/java/org/apache/hadoop/mapred/TestShuffleHandler.java:[357,19] join(java.lang.CharSequence,java.lang.Iterable<?>) in org.apache.hadoop.util.StringUtils cannot be applied to (java.lang.String,java.lang.String[])

        Show
        sjlee0 Sangjin Lee added a comment - Updated the patches. By the way, the build seems broken on branch-2 currently (before this patch). [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:testCompile (default-testCompile) on project hadoop-mapreduce-client-shuffle: Compilation failure: Compilation failure: [ERROR] /Users/sjlee/git/hadoop-common/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/test/java/org/apache/hadoop/mapred/TestShuffleHandler.java: [341,29] cannot find symbol [ERROR] symbol : variable POSIX [ERROR] location: class org.apache.hadoop.io.nativeio.NativeIO [ERROR] /Users/sjlee/git/hadoop-common/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/test/java/org/apache/hadoop/mapred/TestShuffleHandler.java: [357,19] join(java.lang.CharSequence,java.lang.Iterable<?>) in org.apache.hadoop.util.StringUtils cannot be applied to (java.lang.String,java.lang.String[])
        Hide
        sjlee0 Sangjin Lee added a comment -

        Looks like the pre-commit build failed for an unrelated reason: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3620/console

        Is it possible to "re-kick" the pre-commit build?

        Show
        sjlee0 Sangjin Lee added a comment - Looks like the pre-commit build failed for an unrelated reason: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3620/console Is it possible to "re-kick" the pre-commit build?
        Hide
        hadoopqa Hadoop QA added a comment -

        +1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12583077/MAPREDUCE-5232.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 1 new or modified test files.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. The javadoc tool did not generate any warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3637//testReport/
        Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3637//console

        This message is automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12583077/MAPREDUCE-5232.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . The javadoc tool did not generate any warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3637//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3637//console This message is automatically generated.
        Hide
        vinodkv Vinod Kumar Vavilapalli added a comment -

        +1, looks good. Will check it in to trunk now and later to branch when all the noise resolves to something w.r.t branches.

        Show
        vinodkv Vinod Kumar Vavilapalli added a comment - +1, looks good. Will check it in to trunk now and later to branch when all the noise resolves to something w.r.t branches.
        Hide
        sjlee0 Sangjin Lee added a comment -

        Thanks Vinod!

        Show
        sjlee0 Sangjin Lee added a comment - Thanks Vinod!
        Hide
        vinodkv Vinod Kumar Vavilapalli added a comment -

        Committed this to trunk, thanks Sangjin!

        Show
        vinodkv Vinod Kumar Vavilapalli added a comment - Committed this to trunk, thanks Sangjin!
        Hide
        hudson Hudson added a comment -

        Integrated in Hadoop-trunk-Commit #3752 (See https://builds.apache.org/job/Hadoop-trunk-Commit/3752/)
        MAPREDUCE-5232. Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee. (Revision 1482643)

        Result = SUCCESS
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1482643
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/YarnChild.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Show
        hudson Hudson added a comment - Integrated in Hadoop-trunk-Commit #3752 (See https://builds.apache.org/job/Hadoop-trunk-Commit/3752/ ) MAPREDUCE-5232 . Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee. (Revision 1482643) Result = SUCCESS vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1482643 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/YarnChild.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Hide
        hudson Hudson added a comment -

        Integrated in Hadoop-Yarn-trunk #210 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/210/)
        MAPREDUCE-5232. Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee. (Revision 1482643)

        Result = SUCCESS
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1482643
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/YarnChild.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Show
        hudson Hudson added a comment - Integrated in Hadoop-Yarn-trunk #210 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/210/ ) MAPREDUCE-5232 . Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee. (Revision 1482643) Result = SUCCESS vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1482643 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/YarnChild.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Hide
        hudson Hudson added a comment -

        Integrated in Hadoop-Hdfs-trunk #1399 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1399/)
        MAPREDUCE-5232. Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee. (Revision 1482643)

        Result = FAILURE
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1482643
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/YarnChild.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Show
        hudson Hudson added a comment - Integrated in Hadoop-Hdfs-trunk #1399 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1399/ ) MAPREDUCE-5232 . Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee. (Revision 1482643) Result = FAILURE vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1482643 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/YarnChild.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Hide
        hudson Hudson added a comment -

        Integrated in Hadoop-Mapreduce-trunk #1426 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1426/)
        MAPREDUCE-5232. Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee. (Revision 1482643)

        Result = SUCCESS
        vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1482643
        Files :

        • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/YarnChild.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
        • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Show
        hudson Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #1426 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1426/ ) MAPREDUCE-5232 . Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee. (Revision 1482643) Result = SUCCESS vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1482643 Files : /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/YarnChild.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
        Hide
        sjlee0 Sangjin Lee added a comment -

        Vinod Kumar Vavilapalli, I was browsing the branch-2 branch, and found that this was not merged to branch-2 (it is merged to trunk, however). Could you kindly merge this to branch-2 too? Let me know if you need anything from me on this. Thanks!

        Show
        sjlee0 Sangjin Lee added a comment - Vinod Kumar Vavilapalli , I was browsing the branch-2 branch, and found that this was not merged to branch-2 (it is merged to trunk, however). Could you kindly merge this to branch-2 too? Let me know if you need anything from me on this. Thanks!
        Hide
        sjlee0 Sangjin Lee added a comment -

        This isn't still merged to branch-2. Can someone merge this to branch-2? Thanks!

        Show
        sjlee0 Sangjin Lee added a comment - This isn't still merged to branch-2. Can someone merge this to branch-2? Thanks!
        Hide
        jira.shegalov Gera Shegalov added a comment -

        Merge conflicts are minor. I'll push it to branch-2.

        Show
        jira.shegalov Gera Shegalov added a comment - Merge conflicts are minor. I'll push it to branch-2.
        Hide
        sjlee0 Sangjin Lee added a comment -

        Thanks Gera Shegalov!

        Show
        sjlee0 Sangjin Lee added a comment - Thanks Gera Shegalov !

          People

          • Assignee:
            sjlee0 Sangjin Lee
            Reporter:
            sjlee0 Sangjin Lee
          • Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development