Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15139 [Umbrella] Improvements and fixes for Hadoop shaded client work
  3. HADOOP-15137

ClassNotFoundException: org.apache.hadoop.yarn.server.api.DistributedSchedulingAMProtocol when using hadoop-client-minicluster

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.2.0, 3.1.1
    • None
    • None
    • classpath isolation

    Description

      I'd like to use hadoop-client-minicluster for hadoop downstream project, but I encounter the following exception when starting hadoop minicluster. And I check the hadoop-client-minicluster, it indeed does not have this class. Is this something that is missing when packaging the published jar ?

      java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/server/api/DistributedSchedulingAMProtocol
      
      	at java.lang.ClassLoader.defineClass1(Native Method)
      	at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
      	at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
      	at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
      	at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
      	at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
      	at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
      	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
      	at org.apache.hadoop.yarn.server.MiniYARNCluster.createResourceManager(MiniYARNCluster.java:851)
      	at org.apache.hadoop.yarn.server.MiniYARNCluster.serviceInit(MiniYARNCluster.java:285)
      	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
      

      Attachments

        1. YARN-7673.00.patch
          4 kB
          Bharat Viswanadham
        2. HADOOP-15137.01.patch
          7 kB
          Bharat Viswanadham
        3. HADOOP-15137.02.patch
          6 kB
          Bharat Viswanadham

        Issue Links

          Activity

            People

              bharat Bharat Viswanadham
              zjffdu Jeff Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: