[MAPREDUCE-4052] Windows eclipse cannot submit job from Windows client to Linux/Unix Hadoop cluster.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.23.1, 2.2.0
• Fix Version/s: 2.4.0
• Component/s: job submission

Environment

client on the Windows, the the cluster on the suse

• Target Version/s: 2.4.0
• Hadoop Flags: Reviewed
• Assignee: Jian He
• Reporter: xieguiming
• Created: 22/Mar/12 05:01
• Updated: 05/Feb/15 05:17
• Resolved: 16/Mar/14 19:15

Description

when I use the eclipse on the windows to submit the job. and the applicationmaster throw the exception:
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaster
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.v2.app.MRAppMaster
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster. Program will exit.

The reasion is :
class Apps addToEnvironment function, use the
private static final String SYSTEM_PATH_SEPARATOR =
System.getProperty("path.separator");

and will result the MRApplicationMaster classpath use the ";" separator.

I suggest that nodemanger do the replace.

Issue Links

• duplicates: YARN-1298 Unable to remotely submit job from Windows client to Linux server
• is duplicated by: MAPREDUCE-5655 Remote job submit from windows to a linux hadoop cluster fails due to wrong classpath
• is related to: YARN-1824 Make Windows client work with Linux/Unix cluster