Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4052

Windows eclipse cannot submit job from Windows client to Linux/Unix Hadoop cluster.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.1, 2.2.0
    • Fix Version/s: 2.4.0
    • Component/s: job submission
    • Labels:
      None
    • Environment:

      client on the Windows, the the cluster on the suse

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      when I use the eclipse on the windows to submit the job. and the applicationmaster throw the exception:
      Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaster
      Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.v2.app.MRAppMaster
      at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
      at java.security.AccessController.doPrivileged(Native Method)
      at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
      at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
      Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster. Program will exit.

      The reasion is :
      class Apps addToEnvironment function, use the
      private static final String SYSTEM_PATH_SEPARATOR =
      System.getProperty("path.separator");

      and will result the MRApplicationMaster classpath use the ";" separator.

      I suggest that nodemanger do the replace.

        Attachments

        1. MAPREDUCE-4052-0.patch
          16 kB
          xieguiming
        2. MAPREDUCE-4052.patch
          2 kB
          xieguiming
        3. MAPREDUCE-4052.8.patch
          64 kB
          Jian He
        4. MAPREDUCE-4052.7.patch
          63 kB
          Jian He
        5. MAPREDUCE-4052.6.patch
          63 kB
          Jian He
        6. MAPREDUCE-4052.5.patch
          58 kB
          Jian He
        7. MAPREDUCE-4052.4.patch
          54 kB
          Jian He
        8. MAPREDUCE-4052.3.patch
          53 kB
          Jian He
        9. MAPREDUCE-4052.2.patch
          34 kB
          Jian He
        10. MAPREDUCE-4052.1.patch
          36 kB
          Jian He

          Issue Links

            Activity

              People

              • Assignee:
                jianhe Jian He
                Reporter:
                xieguiming xieguiming
              • Votes:
                3 Vote for this issue
                Watchers:
                19 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: