Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4052

Windows eclipse cannot submit job from Windows client to Linux/Unix Hadoop cluster.

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.1, 2.2.0
    • Fix Version/s: 2.4.0
    • Component/s: job submission
    • Labels:
      None
    • Environment:

      client on the Windows, the the cluster on the suse

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      when I use the eclipse on the windows to submit the job. and the applicationmaster throw the exception:
      Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaster
      Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.v2.app.MRAppMaster
      at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
      at java.security.AccessController.doPrivileged(Native Method)
      at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
      at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
      Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster. Program will exit.

      The reasion is :
      class Apps addToEnvironment function, use the
      private static final String SYSTEM_PATH_SEPARATOR =
      System.getProperty("path.separator");

      and will result the MRApplicationMaster classpath use the ";" separator.

      I suggest that nodemanger do the replace.

      1. MAPREDUCE-4052.1.patch
        36 kB
        Jian He
      2. MAPREDUCE-4052.2.patch
        34 kB
        Jian He
      3. MAPREDUCE-4052.3.patch
        53 kB
        Jian He
      4. MAPREDUCE-4052.4.patch
        54 kB
        Jian He
      5. MAPREDUCE-4052.5.patch
        58 kB
        Jian He
      6. MAPREDUCE-4052.6.patch
        63 kB
        Jian He
      7. MAPREDUCE-4052.7.patch
        63 kB
        Jian He
      8. MAPREDUCE-4052.8.patch
        64 kB
        Jian He
      9. MAPREDUCE-4052.patch
        2 kB
        xieguiming
      10. MAPREDUCE-4052-0.patch
        16 kB
        xieguiming

        Issue Links

          Activity

          xieguiming created issue -
          xieguiming made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-4052.patch [ 12520107 ]
          Hide
          xieguiming added a comment -

          We will replace the windows path separator. and we can submit the job using windows eclipse client.

          Do like this:
          1,modify

          ContainerLaunch.java
                 // Make a copy of env to iterate & do variable expansion
             for (Entry<String, String> entry : environment.entrySet())    {
                  String value = entry.getValue();
                  entry.setValue(
                    value.replace(
                          ApplicationConstants.LOG_DIR_EXPANSION_VAR,
                          containerLogDir.toUri().getPath())
                      );
                 }
          
          ContainerLaunch.java
                 // Make a copy of env to iterate & do variable expansion
             for (Entry<String, String> entry : environment.entrySet())    {
                  String value = entry.getValue().replace(
                      ApplicationConstants.LOG_DIR_EXPANSION_VAR,
                      containerLogDir.toUri().getPath()).replace(
                      ApplicationConstants.WINDOWS_PATH_SEPERATOR,
                      System.getProperty("path.separator"));
                  entry.setValue(value);
                 }
          

          2,add one constant

          ApplicationConstants.java
           public static final String WINDOWS_PATH_SEPERATOR = ";";
          
          Show
          xieguiming added a comment - We will replace the windows path separator. and we can submit the job using windows eclipse client. Do like this: 1,modify ContainerLaunch.java // Make a copy of env to iterate & do variable expansion for (Entry< String , String > entry : environment.entrySet()) { String value = entry.getValue(); entry.setValue( value.replace( ApplicationConstants.LOG_DIR_EXPANSION_VAR, containerLogDir.toUri().getPath()) ); } ContainerLaunch.java // Make a copy of env to iterate & do variable expansion for (Entry< String , String > entry : environment.entrySet()) { String value = entry.getValue().replace( ApplicationConstants.LOG_DIR_EXPANSION_VAR, containerLogDir.toUri().getPath()).replace( ApplicationConstants.WINDOWS_PATH_SEPERATOR, System .getProperty( "path.separator" )); entry.setValue(value); } 2,add one constant ApplicationConstants.java public static final String WINDOWS_PATH_SEPERATOR = ";" ;
          xieguiming made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12520107/MAPREDUCE-4052.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          -1 tests included. The patch doesn't appear to include any new or modified tests.
          Please justify why no new tests are needed for this patch.
          Also please list what manual steps were performed to verify this patch.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in .

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2108//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2108//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12520107/MAPREDUCE-4052.patch against trunk revision . +1 @author. The patch does not contain any @author tags. -1 tests included. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed unit tests in . +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2108//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2108//console This message is automatically generated.
          Hide
          xieguiming added a comment -

          Is there some other solution?

          Show
          xieguiming added a comment - Is there some other solution?
          xieguiming made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          xieguiming made changes -
          Attachment MAPREDUCE-4052-0.patch [ 12523800 ]
          Hide
          xieguiming added a comment -

          Add one testcase

          public void testReplaceWindowsPathSeparatorCall() throws Exception

          { // replace the windows path separator. }
          Show
          xieguiming added a comment - Add one testcase public void testReplaceWindowsPathSeparatorCall() throws Exception { // replace the windows path separator. }
          xieguiming made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12523800/MAPREDUCE-4052-0.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 1 new or modified test files.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests:
          org.apache.hadoop.yarn.server.TestContainerManagerSecurity

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2296//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2296//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12523800/MAPREDUCE-4052-0.patch against trunk revision . +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 1 new or modified test files. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 eclipse:eclipse. The patch built with eclipse:eclipse. +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed these unit tests: org.apache.hadoop.yarn.server.TestContainerManagerSecurity +1 contrib tests. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2296//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2296//console This message is automatically generated.
          Hide
          xieguiming added a comment -

          -1 core tests. The patch failed these unit tests:
          org.apache.hadoop.yarn.server.TestContainerManagerSecurity

          The faillure of org.apache.hadoop.yarn.server.TestContainerManagerSecurity has not relation with my testcase.

          Show
          xieguiming added a comment - -1 core tests. The patch failed these unit tests: org.apache.hadoop.yarn.server.TestContainerManagerSecurity The faillure of org.apache.hadoop.yarn.server.TestContainerManagerSecurity has not relation with my testcase.
          xieguiming made changes -
          Assignee xieguiming [ xieguiming ]
          Hide
          Pavel Ganelin added a comment -

          It is still an issue with hadoop 2.2.

          The following ugly workaround can be used on the client side without modifying the hadoop jar files:

                  {
                      Field field = Shell.class.getDeclaredField("WINDOWS");
                      field.setAccessible(true);
                      Field modifiersField = Field.class.getDeclaredField("modifiers");
                      modifiersField.setAccessible(true);
                      modifiersField.setInt(field, field.getModifiers() & ~Modifier.FINAL);
                      field.set(null, false);
                  }
                  {
                      Field field = java.io.File.class.getDeclaredField("pathSeparator");
                      field.setAccessible(true);
                      Field modifiersField = Field.class.getDeclaredField("modifiers");
                      modifiersField.setAccessible(true);
                      modifiersField.setInt(field, field.getModifiers() & ~Modifier.FINAL);
                      field.set(null, ":");
                  }
          
          Show
          Pavel Ganelin added a comment - It is still an issue with hadoop 2.2. The following ugly workaround can be used on the client side without modifying the hadoop jar files: { Field field = Shell.class.getDeclaredField( "WINDOWS" ); field.setAccessible( true ); Field modifiersField = Field.class.getDeclaredField( "modifiers" ); modifiersField.setAccessible( true ); modifiersField.setInt(field, field.getModifiers() & ~Modifier.FINAL); field.set( null , false ); } { Field field = java.io.File.class.getDeclaredField( "pathSeparator" ); field.setAccessible( true ); Field modifiersField = Field.class.getDeclaredField( "modifiers" ); modifiersField.setAccessible( true ); modifiersField.setInt(field, field.getModifiers() & ~Modifier.FINAL); field.set( null , ":" ); }
          Chris Nauroth made changes -
          Summary Windows eclpise can not submit the job Windows eclipse cannot submit job from Windows client to Linux/Unix Hadoop cluster.
          Affects Version/s 2.2.0 [ 12325050 ]
          Chris Nauroth made changes -
          Link This issue is duplicated by MAPREDUCE-5655 [ MAPREDUCE-5655 ]
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12523800/MAPREDUCE-4052-0.patch
          against trunk revision .

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4236//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12523800/MAPREDUCE-4052-0.patch against trunk revision . -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4236//console This message is automatically generated.
          Hide
          Attila Pados added a comment -

          I checked the patches here, i was curious about alternative solutions to the similar (or same) problem with 2.2.0.
          However, i missed the point in either the patches or in the problem description, that the java call from the shell script included the right $JAVA_HOME for linux cluster, or it was %JAVA_HOME% as i have experienced on 2.2.0 version?

          (I didn't investigated the case with 0.23.x at all, i have downloaded only the 2.2.0 source and binary, so probably there are more differences between the processes)

          Show
          Attila Pados added a comment - I checked the patches here, i was curious about alternative solutions to the similar (or same) problem with 2.2.0. However, i missed the point in either the patches or in the problem description, that the java call from the shell script included the right $JAVA_HOME for linux cluster, or it was %JAVA_HOME% as i have experienced on 2.2.0 version? (I didn't investigated the case with 0.23.x at all, i have downloaded only the 2.2.0 source and binary, so probably there are more differences between the processes)
          Hide
          Hadoop Developer added a comment -

          Is this patch applied to Hadoop2 GA?
          I am getting same error while executing WordCount on hadoop2.2 on Windows 7 (64 bit).

          Show
          Hadoop Developer added a comment - Is this patch applied to Hadoop2 GA? I am getting same error while executing WordCount on hadoop2.2 on Windows 7 (64 bit).
          Hide
          Attila Pados added a comment -

          Hi,
          as i found, the patch attached to this jira ticket, is not working for 2.2.0, Hadoop2 GA.

          i made another jira issue: https://issues.apache.org/jira/browse/MAPREDUCE-5655
          and also added a patch that fixes it. Please keep in mind, that this is generaly a workaround.

          Attila

          Show
          Attila Pados added a comment - Hi, as i found, the patch attached to this jira ticket, is not working for 2.2.0, Hadoop2 GA. i made another jira issue: https://issues.apache.org/jira/browse/MAPREDUCE-5655 and also added a patch that fixes it. Please keep in mind, that this is generaly a workaround. Attila
          Hide
          Jian He added a comment -

          Hi Xieguiming, are you still working on this? I'd like to take it over.

          Show
          Jian He added a comment - Hi Xieguiming, are you still working on this? I'd like to take it over.
          Jian He made changes -
          Target Version/s 2.4.0 [ 12326141 ]
          Jian He made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Jian He made changes -
          Attachment MAPREDUCE-4052.1.patch [ 12633486 ]
          Jian He made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Jian He added a comment -

          The main problem here is that client is constructing the commands and environments for container launch depending on the client machine OS, but if server(NM) is running a different OS, NM is not able to parse the commands and environments.

          The patch creates two constants in ApplicationConstants for PARAMETER_EXPANSION and CLASS_PATH_SEPARATOR as known that they are different between Windows and Linux. User application is supposed to use these constants to construct their commands and environments when constructing the ContainerLaunchContext. When NM tries to launch the container, it will first replace the constants with the correct characters depending on its own OS. Changed MR and DistributedShell to do so.

          Show
          Jian He added a comment - The main problem here is that client is constructing the commands and environments for container launch depending on the client machine OS, but if server(NM) is running a different OS, NM is not able to parse the commands and environments. The patch creates two constants in ApplicationConstants for PARAMETER_EXPANSION and CLASS_PATH_SEPARATOR as known that they are different between Windows and Linux. User application is supposed to use these constants to construct their commands and environments when constructing the ContainerLaunchContext. When NM tries to launch the container, it will first replace the constants with the correct characters depending on its own OS. Changed MR and DistributedShell to do so.
          Hide
          Chris Nauroth added a comment -

          Hi, Jian He. If I understand correctly, this change would not be backwards-compatible. An upgraded YARN/MR client with this patch would not be able to successfully submit containers to a non-upgraded NodeManager. Is that correct? If so, I just want to check that this is intentional. Thanks!

          Show
          Chris Nauroth added a comment - Hi, Jian He . If I understand correctly, this change would not be backwards-compatible. An upgraded YARN/MR client with this patch would not be able to successfully submit containers to a non-upgraded NodeManager. Is that correct? If so, I just want to check that this is intentional. Thanks!
          Hide
          Jian He added a comment -

          Yes, An upgraded client with this patch is not able to successfully submit to non-upgraded NM. But non-upgraded client is able to successfully submit to upgraded NMs.

          Show
          Jian He added a comment - Yes, An upgraded client with this patch is not able to successfully submit to non-upgraded NM. But non-upgraded client is able to successfully submit to upgraded NMs.
          Hide
          Jian He added a comment -

          btw, Chris Nauroth, is the use case that upgraded-client with non-upgraded NM important ?

          Show
          Jian He added a comment - btw, Chris Nauroth , is the use case that upgraded-client with non-upgraded NM important ?
          Jian He made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Jian He made changes -
          Attachment MAPREDUCE-4052.2.patch [ 12633514 ]
          Jian He made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Jian He made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Jian He made changes -
          Assignee xieguiming [ xieguiming ] Jian He [ jianhe ]
          Jian He made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Chris Nauroth added a comment -

          btw, Chris Nauroth, is the use case that upgraded-client with non-upgraded NM important ?

          I brought this up, because I've been in situations where someone wanted to pick up a client-side bug fix ahead of the cluster's upgrade schedule. It looks to me like this is a gray area in our policies though.

          http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/Compatibility.html#Wire_compatibility

          From the content in that page, we've made a specific commitment that old clients continue to work with new servers. As Jian said, that part is fine with this patch. What is less clear is whether or not we've made a commitment for new clients to work with old servers. Of course, it's best to strive for it, and forward compatibility is one of our motivations in the protobuf messages, but I can't tell from that policy statement if we've made a commitment to it. This is probably worth some wider discussion before changing the patch.

          If we do need to achieve that kind of compatibility, then it's going to be a more challenging patch. I think we'd end up needing to add an optional version number or at least a flag on the Container returned in the AllocateResponse. This would tell the client whether or not the container can accept the new syntax, and then the client could use the old code path as a fallback path for compatibility with old servers that don't set this version number or flag. That would work for containers submitted by an AM. I can't think of a similar solution that would work for the initial AM container though, because it seems to me like the RPC sequence there doesn't have as clear of a way for indicating capabilities inside the container that's going to run the AM before its submission.

          Like I said, please do discuss wider before pursuing this. I'd hate to send you down an unnecessary rathole if the current patch is fine. Thanks, Jian.

          Show
          Chris Nauroth added a comment - btw, Chris Nauroth, is the use case that upgraded-client with non-upgraded NM important ? I brought this up, because I've been in situations where someone wanted to pick up a client-side bug fix ahead of the cluster's upgrade schedule. It looks to me like this is a gray area in our policies though. http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/Compatibility.html#Wire_compatibility From the content in that page, we've made a specific commitment that old clients continue to work with new servers. As Jian said, that part is fine with this patch. What is less clear is whether or not we've made a commitment for new clients to work with old servers. Of course, it's best to strive for it, and forward compatibility is one of our motivations in the protobuf messages, but I can't tell from that policy statement if we've made a commitment to it. This is probably worth some wider discussion before changing the patch. If we do need to achieve that kind of compatibility, then it's going to be a more challenging patch. I think we'd end up needing to add an optional version number or at least a flag on the Container returned in the AllocateResponse . This would tell the client whether or not the container can accept the new syntax, and then the client could use the old code path as a fallback path for compatibility with old servers that don't set this version number or flag. That would work for containers submitted by an AM. I can't think of a similar solution that would work for the initial AM container though, because it seems to me like the RPC sequence there doesn't have as clear of a way for indicating capabilities inside the container that's going to run the AM before its submission. Like I said, please do discuss wider before pursuing this. I'd hate to send you down an unnecessary rathole if the current patch is fine. Thanks, Jian.
          Hide
          Karthik Kambatla (Inactive) added a comment -

          (Haven't looked at the patch at all).

          My interpretation of the Wire-Compatibility policies is that new clients in the same major release should work old servers and vice-versa. If that is not clear, we should probably update the policies to clarify it. Chris Nauroth, Jian He - do any of you want to start a thread in the dev lists to discuss the same?

          Show
          Karthik Kambatla (Inactive) added a comment - (Haven't looked at the patch at all). My interpretation of the Wire-Compatibility policies is that new clients in the same major release should work old servers and vice-versa. If that is not clear, we should probably update the policies to clarify it. Chris Nauroth , Jian He - do any of you want to start a thread in the dev lists to discuss the same?
          Hide
          Chris Nauroth added a comment -

          Thanks, Karthik Kambatla. I can start that thread later today to clarify policy and update the text accordingly.

          For this specific patch, I suppose another other option is to gate use of the new command syntax behind a client-side config flag. Then, clients can turn on the flag only after they know their clusters have been upgraded. That's a compatible solution that avoids protocol impacts entirely, but it pushes some complexity on to the end user to turn on the flag.

          Show
          Chris Nauroth added a comment - Thanks, Karthik Kambatla . I can start that thread later today to clarify policy and update the text accordingly. For this specific patch, I suppose another other option is to gate use of the new command syntax behind a client-side config flag. Then, clients can turn on the flag only after they know their clusters have been upgraded. That's a compatible solution that avoids protocol impacts entirely, but it pushes some complexity on to the end user to turn on the flag.
          Hide
          Vinod Kumar Vavilapalli added a comment -

          For this specific patch, I suppose another other option is to gate use of the new command syntax behind a client-side config flag.

          This makes sense. In a way, the protocol with the NodeManager is already optional - if there are named tags then NM will substitute them, otherwise nothing to do. Let's see if it can be optional in MapReduce too.

          Show
          Vinod Kumar Vavilapalli added a comment - For this specific patch, I suppose another other option is to gate use of the new command syntax behind a client-side config flag. This makes sense. In a way, the protocol with the NodeManager is already optional - if there are named tags then NM will substitute them, otherwise nothing to do. Let's see if it can be optional in MapReduce too.
          Jian He made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Jian He made changes -
          Attachment MAPREDUCE-4052.3.patch [ 12634016 ]
          Jian He made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Jian He added a comment -

          uploaded a patch that makes new command syntax configurable as suggested by Chris

          Show
          Jian He added a comment - uploaded a patch that makes new command syntax configurable as suggested by Chris
          Hide
          Vinod Kumar Vavilapalli added a comment -

          Jian, can you file a YARN counterpart for this JIRA?

          Show
          Vinod Kumar Vavilapalli added a comment - Jian, can you file a YARN counterpart for this JIRA?
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12634016/MAPREDUCE-4052.3.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 4 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager:

          org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4411//testReport/
          Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4411//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4411//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12634016/MAPREDUCE-4052.3.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 4 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. -1 findbugs . The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager: org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4411//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4411//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-yarn-server-nodemanager.html Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4411//console This message is automatically generated.
          Jian He made changes -
          Link This issue is related to YARN-1824 [ YARN-1824 ]
          Jian He made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Jian He made changes -
          Attachment MAPREDUCE-4052.4.patch [ 12634086 ]
          Jian He made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12634086/MAPREDUCE-4052.4.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 5 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4413//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4413//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12634086/MAPREDUCE-4052.4.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 5 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4413//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4413//console This message is automatically generated.
          Hide
          Vinod Kumar Vavilapalli added a comment -

          Patch looks fine overall, some review comments on the MR part of the patch

          • TestMapReduceChildJVM.envVar can be removed.
          • MAPREDUCE_CROSS_PLATFORM_APP_SUBMISSION -> MAPREDUCE_APP_SUBMISSION_CROSS_PLATFORM, "mapreduce.cross-platform.app-submission" -> "mapreduce.app-submission.cross-platform". Similarly the name of the default constant too.
          • The default for the above config should be false for compatibility
          • Given that, fix the description of mapreduce.application.classpath in mapred-default.xml
          • Add the new config in mapred-default.xml
          • Cannot rename MRJobConfig.DEFAULT_MAPREDUCE_APPLICATION_CLASSPATH for compatibility
          • MRJobConfig.DEFAULT_MAPREDUCE_APPLICATION_CLASSPATH_CROSS_ENV and DEFAULT_MAPREDUCE_APPLICATION_CLASSPATH_CLIENT_ENV also to be renamed in line with the YARN constant renames.
          • Fix their javadoc too to refer to cross-platform.
          • There are still some usages of yarn.util.Apps. They are not intended?
          Show
          Vinod Kumar Vavilapalli added a comment - Patch looks fine overall, some review comments on the MR part of the patch TestMapReduceChildJVM.envVar can be removed. MAPREDUCE_CROSS_PLATFORM_APP_SUBMISSION -> MAPREDUCE_APP_SUBMISSION_CROSS_PLATFORM, "mapreduce.cross-platform.app-submission" -> "mapreduce.app-submission.cross-platform". Similarly the name of the default constant too. The default for the above config should be false for compatibility Given that, fix the description of mapreduce.application.classpath in mapred-default.xml Add the new config in mapred-default.xml Cannot rename MRJobConfig.DEFAULT_MAPREDUCE_APPLICATION_CLASSPATH for compatibility MRJobConfig.DEFAULT_MAPREDUCE_APPLICATION_CLASSPATH_CROSS_ENV and DEFAULT_MAPREDUCE_APPLICATION_CLASSPATH_CLIENT_ENV also to be renamed in line with the YARN constant renames. Fix their javadoc too to refer to cross-platform. There are still some usages of yarn.util.Apps. They are not intended?
          Jian He made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Jian He added a comment -

          Thanks Vinod for the review. Fixed the comments.

          There are still some usages of yarn.util.Apps

          Fixed all except one, seems MRJobConfig not able to reference MRApps

          Show
          Jian He added a comment - Thanks Vinod for the review. Fixed the comments. There are still some usages of yarn.util.Apps Fixed all except one, seems MRJobConfig not able to reference MRApps
          Jian He made changes -
          Attachment MAPREDUCE-4052.5.patch [ 12634615 ]
          Jian He made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12634615/MAPREDUCE-4052.5.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 5 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed these unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager:

          org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM
          org.apache.hadoop.mapreduce.v2.util.TestMRApps

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4422//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4422//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12634615/MAPREDUCE-4052.5.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 5 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager: org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM org.apache.hadoop.mapreduce.v2.util.TestMRApps +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4422//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4422//console This message is automatically generated.
          Jian He made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Jian He added a comment -

          The test failure was because the app_submit_crsoo_platform default is flipped to false, updated the tests accordingly.

          Show
          Jian He added a comment - The test failure was because the app_submit_crsoo_platform default is flipped to false, updated the tests accordingly.
          Jian He made changes -
          Attachment MAPREDUCE-4052.6.patch [ 12634640 ]
          Jian He made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12634640/MAPREDUCE-4052.6.patch
          against trunk revision .

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4423//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12634640/MAPREDUCE-4052.6.patch against trunk revision . -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4423//console This message is automatically generated.
          Jian He made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Jian He made changes -
          Attachment MAPREDUCE-4052.7.patch [ 12634647 ]
          Jian He made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12634647/MAPREDUCE-4052.7.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 5 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4424//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4424//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12634647/MAPREDUCE-4052.7.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 5 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4424//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4424//console This message is automatically generated.
          Jian He made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Jian He added a comment -

          New patch did a couple of renames, and added public/unstable for each newly added config.

          Show
          Jian He added a comment - New patch did a couple of renames, and added public/unstable for each newly added config.
          Jian He made changes -
          Attachment MAPREDUCE-4052.8.patch [ 12634855 ]
          Jian He made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12634855/MAPREDUCE-4052.8.patch
          against trunk revision .

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 5 new or modified test files.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 javadoc. There were no new javadoc warning messages.

          +1 eclipse:eclipse. The patch built with eclipse:eclipse.

          +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4430//testReport/
          Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4430//console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12634855/MAPREDUCE-4052.8.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 5 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. +1 core tests . The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager. +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4430//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4430//console This message is automatically generated.
          Hide
          Vinod Kumar Vavilapalli added a comment -

          This looks good to me +1. Checking it in.

          Show
          Vinod Kumar Vavilapalli added a comment - This looks good to me +1. Checking it in.
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Hadoop-trunk-Commit #5336 (See https://builds.apache.org/job/Hadoop-trunk-Commit/5336/)
          YARN-1824. Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He.
          MAPREDUCE-4052. Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1578135)

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/MapReduceChildJVM.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestMapReduceChildJVM.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMiniMRChildTask.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/ssl/TestEncryptedShuffle.java
          • /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/TestContainerLaunch.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Hadoop-trunk-Commit #5336 (See https://builds.apache.org/job/Hadoop-trunk-Commit/5336/ ) YARN-1824 . Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He. MAPREDUCE-4052 . Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1578135 ) /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/MapReduceChildJVM.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestMapReduceChildJVM.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMiniMRChildTask.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/ssl/TestEncryptedShuffle.java /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/TestContainerLaunch.java
          Hide
          Vinod Kumar Vavilapalli added a comment -

          The trunk patch had minor issues on branch-2/2.4. Fixed them myself, compiled code on branch-2 and ran TestMRApps.

          Committed this to trunk, branch-2 and branch-2.4. Thanks Jian!

          Show
          Vinod Kumar Vavilapalli added a comment - The trunk patch had minor issues on branch-2/2.4. Fixed them myself, compiled code on branch-2 and ran TestMRApps. Committed this to trunk, branch-2 and branch-2.4. Thanks Jian!
          Vinod Kumar Vavilapalli made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.4.0 [ 12326141 ]
          Resolution Fixed [ 1 ]
          Hide
          Hudson added a comment -

          FAILURE: Integrated in Hadoop-Yarn-trunk #512 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/512/)
          YARN-1824. Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He.
          MAPREDUCE-4052. Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1578135)

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/MapReduceChildJVM.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestMapReduceChildJVM.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMiniMRChildTask.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/ssl/TestEncryptedShuffle.java
          • /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/TestContainerLaunch.java
          Show
          Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #512 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/512/ ) YARN-1824 . Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He. MAPREDUCE-4052 . Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1578135 ) /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/MapReduceChildJVM.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestMapReduceChildJVM.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMiniMRChildTask.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/ssl/TestEncryptedShuffle.java /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/TestContainerLaunch.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Hdfs-trunk #1704 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1704/)
          YARN-1824. Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He.
          MAPREDUCE-4052. Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1578135)

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/MapReduceChildJVM.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestMapReduceChildJVM.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMiniMRChildTask.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/ssl/TestEncryptedShuffle.java
          • /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/TestContainerLaunch.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk #1704 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1704/ ) YARN-1824 . Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He. MAPREDUCE-4052 . Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1578135 ) /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/MapReduceChildJVM.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestMapReduceChildJVM.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMiniMRChildTask.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/ssl/TestEncryptedShuffle.java /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/TestContainerLaunch.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1729 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1729/)
          YARN-1824. Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He.
          MAPREDUCE-4052. Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1578135)

          • /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/MapReduceChildJVM.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestMapReduceChildJVM.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMiniMRChildTask.java
          • /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/ssl/TestEncryptedShuffle.java
          • /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
          • /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/TestContainerLaunch.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1729 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1729/ ) YARN-1824 . Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He. MAPREDUCE-4052 . Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1578135 ) /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/MapReduceChildJVM.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TaskAttemptImpl.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/test/java/org/apache/hadoop/mapreduce/v2/app/job/impl/TestMapReduceChildJVM.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/main/java/org/apache/hadoop/mapreduce/v2/util/MRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-common/src/test/java/org/apache/hadoop/mapreduce/v2/util/TestMRApps.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRJobConfig.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/YARNRunner.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapred/TestMiniMRChildTask.java /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/test/java/org/apache/hadoop/mapreduce/security/ssl/TestEncryptedShuffle.java /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/ApplicationConstants.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/Client.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/util/Apps.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java /hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/TestContainerLaunch.java
          Vinod Kumar Vavilapalli made changes -
          Link This issue duplicates YARN-1298 [ YARN-1298 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Hide
          Donggeun Lee added a comment -

          i also have been trouble due to this issue, however, i found reasons about error

          when you used cross-platform configuration, you should check "hadoop-env.sh" included export JAVA_HOME="your java installation directory within this" and
          conf.set("mapreduce.app-submission.cross-platform", "true"); in your remote driver file. and then i will works.

          Show
          Donggeun Lee added a comment - i also have been trouble due to this issue, however, i found reasons about error when you used cross-platform configuration, you should check "hadoop-env.sh" included export JAVA_HOME="your java installation directory within this" and conf.set("mapreduce.app-submission.cross-platform", "true"); in your remote driver file. and then i will works.
          Hide
          Jay added a comment -

          I am still having the same issue after upgrading to hadoop2.4 from 2.2. I assume 2.4 has this fix in it. I am running hadoop on local windows box. Trying to use spring client from Eclipse to run the wordcount example. My cluster is configured correctly as I can run wordcount from the hdfs command line. I get in to issue when I try to run a mapreduce job from Eclipse on Windows. I have modified mapred--site.xml to use the proeprty mapreduce.app-submission.cross-platform to be true. I also removed yarn.application.classpath entry from my yarn-site.xml. I tried adding it back fro Windows. All scenarios seem to not work. Is there a documentation on what needs to take place to make it work. Will appreciate any help.
          jsaraiya( &container_1407515618489_0002_01_000001╤╣ ♠stderr ♦1440java.lang.NoClassDefFoundError: org/apache/hadoop/service/CompositeService
          at java.lang.ClassLoader.defineClass1(Native Method)
          at java.lang.ClassLoader.defineClassCond(ClassLoader.java:632)
          at java.lang.ClassLoader.defineClass(ClassLoader.java:616)
          at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
          at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
          at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
          at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
          at java.security.AccessController.doPrivileged(Native Method)
          at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
          at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
          at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
          at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
          Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.service.CompositeService
          at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
          at java.security.AccessController.doPrivileged(Native Method)
          at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
          at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
          at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
          at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
          ... 12 more
          Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster. Program will exit.
          Exception in thread "main" ♠stdout ☺0( &container_1407515618489_0002_02_000001╤╣ ♠stderr ♦1440java.lang.NoClassDefFoundError: org/apache/hadoop/service/CompositeService
          at java.lang.ClassLoader.defineClass1(Native Method)
          at java.lang.ClassLoader.defineClassCond(ClassLoader.java:632)
          at java.lang.ClassLoader.defineClass(ClassLoader.java:616)
          at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
          at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
          at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
          at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
          at java.security.AccessController.doPrivileged(Native Method)
          at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
          at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
          at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
          at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
          Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.service.CompositeService
          at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
          at java.security.AccessController.doPrivileged(Native Method)
          at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
          at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
          at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
          at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
          ... 12 more
          Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster. Program will exit.

          Show
          Jay added a comment - I am still having the same issue after upgrading to hadoop2.4 from 2.2. I assume 2.4 has this fix in it. I am running hadoop on local windows box. Trying to use spring client from Eclipse to run the wordcount example. My cluster is configured correctly as I can run wordcount from the hdfs command line. I get in to issue when I try to run a mapreduce job from Eclipse on Windows. I have modified mapred--site.xml to use the proeprty mapreduce.app-submission.cross-platform to be true. I also removed yarn.application.classpath entry from my yarn-site.xml. I tried adding it back fro Windows. All scenarios seem to not work. Is there a documentation on what needs to take place to make it work. Will appreciate any help. jsaraiya( &container_1407515618489_0002_01_000001╤╣ ♠stderr ♦1440java.lang.NoClassDefFoundError: org/apache/hadoop/service/CompositeService at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:632) at java.lang.ClassLoader.defineClass(ClassLoader.java:616) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at java.net.URLClassLoader.access$000(URLClassLoader.java:58) at java.net.URLClassLoader$1.run(URLClassLoader.java:197) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:307) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.service.CompositeService at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:307) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) ... 12 more Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster. Program will exit. Exception in thread "main" ♠stdout ☺0( &container_1407515618489_0002_02_000001╤╣ ♠stderr ♦1440java.lang.NoClassDefFoundError: org/apache/hadoop/service/CompositeService at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClassCond(ClassLoader.java:632) at java.lang.ClassLoader.defineClass(ClassLoader.java:616) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) at java.net.URLClassLoader.access$000(URLClassLoader.java:58) at java.net.URLClassLoader$1.run(URLClassLoader.java:197) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:307) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.service.CompositeService at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:307) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:248) ... 12 more Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster. Program will exit.
          Hide
          Siddhartha Azad added a comment -

          I am using CDH5 while submitting from Windows to Linux. The job gets submitted and starts running. There are split files created (during the map phase I believe) but then there is an error and the client exits. If submitted from linux to linux the job runs fine. Is this patch available in the CDH5 version or does it need to be explicitly applied?

          Stack trace: ExitCodeException exitCode=1:
          at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
          at org.apache.hadoop.util.Shell.run(Shell.java:455)
          at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
          at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:196)
          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:299)
          at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81)
          at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
          at java.util.concurrent.FutureTask.run(FutureTask.java:138)
          at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
          at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
          at java.lang.Thread.run(Thread.java:619)

          Show
          Siddhartha Azad added a comment - I am using CDH5 while submitting from Windows to Linux. The job gets submitted and starts running. There are split files created (during the map phase I believe) but then there is an error and the client exits. If submitted from linux to linux the job runs fine. Is this patch available in the CDH5 version or does it need to be explicitly applied? Stack trace: ExitCodeException exitCode=1: at org.apache.hadoop.util.Shell.runCommand(Shell.java:538) at org.apache.hadoop.util.Shell.run(Shell.java:455) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:196) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:299) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:81) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:619)
          Hide
          Siddhartha Azad added a comment -

          Any luck? I am using CDH5 and having the same issue submitting from Windows.

          Show
          Siddhartha Azad added a comment - Any luck? I am using CDH5 and having the same issue submitting from Windows.
          Hide
          bc Wong added a comment -

          Which minor version are you using? This patch is included in CDH 5.2. You should file a jira on issues.cloudera.org for CDH specific problems.

          Show
          bc Wong added a comment - Which minor version are you using? This patch is included in CDH 5.2. You should file a jira on issues.cloudera.org for CDH specific problems.
          Hide
          bc Wong added a comment -

          Which minor version are you using? This patch is included in CDH 5.2. You should file a jira on issues.cloudera.org for CDH specific problems.

          Show
          bc Wong added a comment - Which minor version are you using? This patch is included in CDH 5.2. You should file a jira on issues.cloudera.org for CDH specific problems.
          Hide
          Siddhartha Azad added a comment -

          I am using CDH 5.2.0 jars. The job gets submitted to linux from windows but doesn't complete. Same job works fine from Linux. I have the following property settings in mapred-site.xml:

          <property>
          <name>mapreduce.app-submission.cross-platform</name>
          <value>true</value>
          </property>

          Show
          Siddhartha Azad added a comment - I am using CDH 5.2.0 jars. The job gets submitted to linux from windows but doesn't complete. Same job works fine from Linux. I have the following property settings in mapred-site.xml: <property> <name>mapreduce.app-submission.cross-platform</name> <value>true</value> </property>
          Hide
          bc Wong added a comment -
          Show
          bc Wong added a comment - Filed https://issues.cloudera.org/browse/DISTRO-689
          Hide
          bc Wong added a comment -
          Show
          bc Wong added a comment - Filed https://issues.cloudera.org/browse/DISTRO-689
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Patch Available Patch Available Open Open
          717d 9h 28m 10 Jian He 14/Mar/14 22:32
          Open Open Patch Available Patch Available
          5d 8h 3m 11 Jian He 14/Mar/14 22:33
          Patch Available Patch Available Resolved Resolved
          1d 20h 42m 1 Vinod Kumar Vavilapalli 16/Mar/14 19:15
          Resolved Resolved Closed Closed
          24d 17h 57m 1 Arun C Murthy 10/Apr/14 14:12

            People

            • Assignee:
              Jian He
              Reporter:
              xieguiming
            • Votes:
              3 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development