Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15139 [Umbrella] Improvements and fixes for Hadoop shaded client work
  3. HADOOP-15137

ClassNotFoundException: org.apache.hadoop.yarn.server.api.DistributedSchedulingAMProtocol when using hadoop-client-minicluster

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.2.0, 3.1.1
    • Component/s: None
    • Labels:
      None
    • Tags:
      classpath isolation

      Description

      I'd like to use hadoop-client-minicluster for hadoop downstream project, but I encounter the following exception when starting hadoop minicluster. And I check the hadoop-client-minicluster, it indeed does not have this class. Is this something that is missing when packaging the published jar ?

      java.lang.NoClassDefFoundError: org/apache/hadoop/yarn/server/api/DistributedSchedulingAMProtocol
      
      	at java.lang.ClassLoader.defineClass1(Native Method)
      	at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
      	at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
      	at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
      	at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
      	at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
      	at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
      	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
      	at org.apache.hadoop.yarn.server.MiniYARNCluster.createResourceManager(MiniYARNCluster.java:851)
      	at org.apache.hadoop.yarn.server.MiniYARNCluster.serviceInit(MiniYARNCluster.java:285)
      	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
      

        Attachments

        1. YARN-7673.00.patch
          4 kB
          Bharat Viswanadham
        2. HADOOP-15137.02.patch
          6 kB
          Bharat Viswanadham
        3. HADOOP-15137.01.patch
          7 kB
          Bharat Viswanadham

          Issue Links

            Activity

              People

              • Assignee:
                bharatviswa Bharat Viswanadham
                Reporter:
                zjffdu Jeff Zhang
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: