Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4052

Windows eclipse cannot submit job from Windows client to Linux/Unix Hadoop cluster.

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.1, 2.2.0
    • Fix Version/s: 2.4.0
    • Component/s: job submission
    • Labels:
      None
    • Environment:

      client on the Windows, the the cluster on the suse

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      when I use the eclipse on the windows to submit the job. and the applicationmaster throw the exception:
      Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaster
      Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.v2.app.MRAppMaster
      at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
      at java.security.AccessController.doPrivileged(Native Method)
      at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
      at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
      Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster. Program will exit.

      The reasion is :
      class Apps addToEnvironment function, use the
      private static final String SYSTEM_PATH_SEPARATOR =
      System.getProperty("path.separator");

      and will result the MRApplicationMaster classpath use the ";" separator.

      I suggest that nodemanger do the replace.

      1. MAPREDUCE-4052.patch
        2 kB
        xieguiming
      2. MAPREDUCE-4052-0.patch
        16 kB
        xieguiming
      3. MAPREDUCE-4052.1.patch
        36 kB
        Jian He
      4. MAPREDUCE-4052.2.patch
        34 kB
        Jian He
      5. MAPREDUCE-4052.3.patch
        53 kB
        Jian He
      6. MAPREDUCE-4052.4.patch
        54 kB
        Jian He
      7. MAPREDUCE-4052.5.patch
        58 kB
        Jian He
      8. MAPREDUCE-4052.6.patch
        63 kB
        Jian He
      9. MAPREDUCE-4052.7.patch
        63 kB
        Jian He
      10. MAPREDUCE-4052.8.patch
        64 kB
        Jian He

        Issue Links

          Activity

            People

            • Assignee:
              Jian He
              Reporter:
              xieguiming
            • Votes:
              3 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development