Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2396

oozie compile with hadoop 2.7.1 failed

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Won't Fix
    • 4.2.0
    • None
    • None
    • None
    • Patch

    Description

      I take advantage of oozie 4.2.0 with hadoop 2.7.1. I have faced some error.

      1. oozie server start failed

      Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/io/Charsets
      	at org.apache.hadoop.security.Credentials.<clinit>(Credentials.java:222)
      	at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:334)
      	at org.apache.oozie.service.HadoopAccessorService.createJobConf(HadoopAccessorService.java:297)
      	at org.apache.oozie.tools.OozieSharelibCLI.run(OozieSharelibCLI.java:158)
      	at org.apache.oozie.tools.OozieSharelibCLI.main(OozieSharelibCLI.java:57)
      Caused by: java.lang.ClassNotFoundException: org.apache.commons.io.Charsets
      	at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
      	at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
      	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
      	... 5 more
      

      2. Using curator-client-2.7.1.jar occured below error

      REASON: java.lang.NoSuchMethodError: com.google.common.collect.Sets.newConcurrentHashSet()Ljava/util/Set;
      
      Stacktrace:
      -----------------------------------------------------------------
      java.lang.NoSuchMethodError: com.google.common.collect.Sets.newConcurrentHashSet()Ljava/util/Set;
              at org.apache.curator.framework.recipes.locks.ChildReaper.<init>(ChildReaper.java:51)
              at org.apache.oozie.service.ZKLocksService.init(ZKLocksService.java:71)
              at org.apache.oozie.service.Services.setServiceInternal(Services.java:386)
              at org.apache.oozie.service.Services.setService(Services.java:372)
      

      3. conflict jsp-api-2.0.jar in oozie.war and tomcat's

      I have changed pom.xml.
      I just only tested with hadoop 2.7.1. I does not ensure with another hadoop version.

      Thank you.

      Attachments

        1. OOZIE-2396.002.patch
          2 kB
          KWON BYUNGCHANG
        2. OOZIE-2396.patch
          2 kB
          KWON BYUNGCHANG

        Activity

          People

            Unassigned Unassigned
            magnum KWON BYUNGCHANG
            Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: