Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4052

Windows eclipse cannot submit job from Windows client to Linux/Unix Hadoop cluster.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.1, 2.2.0
    • 2.4.0
    • job submission
    • None
    • client on the Windows, the the cluster on the suse

    • Reviewed

    Description

      when I use the eclipse on the windows to submit the job. and the applicationmaster throw the exception:
      Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/v2/app/MRAppMaster
      Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.v2.app.MRAppMaster
      at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
      at java.security.AccessController.doPrivileged(Native Method)
      at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
      at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
      at java.lang.ClassLoader.loadClass(ClassLoader.java:248)
      Could not find the main class: org.apache.hadoop.mapreduce.v2.app.MRAppMaster. Program will exit.

      The reasion is :
      class Apps addToEnvironment function, use the
      private static final String SYSTEM_PATH_SEPARATOR =
      System.getProperty("path.separator");

      and will result the MRApplicationMaster classpath use the ";" separator.

      I suggest that nodemanger do the replace.

      Attachments

        1. MAPREDUCE-4052.1.patch
          36 kB
          Jian He
        2. MAPREDUCE-4052.2.patch
          34 kB
          Jian He
        3. MAPREDUCE-4052.3.patch
          53 kB
          Jian He
        4. MAPREDUCE-4052.4.patch
          54 kB
          Jian He
        5. MAPREDUCE-4052.5.patch
          58 kB
          Jian He
        6. MAPREDUCE-4052.6.patch
          63 kB
          Jian He
        7. MAPREDUCE-4052.7.patch
          63 kB
          Jian He
        8. MAPREDUCE-4052.8.patch
          64 kB
          Jian He
        9. MAPREDUCE-4052.patch
          2 kB
          xieguiming
        10. MAPREDUCE-4052-0.patch
          16 kB
          xieguiming

        Issue Links

          Activity

            People

              jianhe Jian He
              xieguiming xieguiming
              Votes:
              3 Vote for this issue
              Watchers:
              17 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: