Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-3032

Flink does not start on Hadoop 2.7.1 (HDP), due to class conflict

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.10.0, 1.0.0
    • Fix Version/s: 0.10.1, 1.0.0
    • Component/s: Build System
    • Labels:
      None

      Description

      Steps to reproduce:

      • Build flink mvn clean install -DskipTests -Dhadoop.version=2.7.1.2.3.2.0-2950 -Pvendor-repos
      • Start it on a HDP 2.3.2 Hadoop as a yarn-session
      • Watch it fail with
      6:18:56,459 INFO  org.apache.flink.runtime.filecache.FileCache                  - User file cache uses directory /hadoop/yarn/local/usercache/flink/appcache
      /application_1447687546708_0005/flink-dist-cache-f4710796-598c-4778-992c-5df000faffae
      16:18:56,561 ERROR akka.actor.OneForOneStrategy                                  - exception during creation
      akka.actor.ActorInitializationException: exception during creation
              at akka.actor.ActorInitializationException$.apply(Actor.scala:164)
              at akka.actor.ActorCell.create(ActorCell.scala:596)
              at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:456)
              at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
              at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:279)
              at akka.dispatch.Mailbox.run(Mailbox.scala:220)
              at akka.dispatch.Mailbox.exec(Mailbox.scala:231)
              at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
              at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
              at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
              at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
              at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
      Caused by: java.lang.reflect.InvocationTargetException
              at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
              at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
              at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
              at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
              at akka.util.Reflect$.instantiate(Reflect.scala:66)
              at akka.actor.ArgsReflectConstructor.produce(Props.scala:352)
              at akka.actor.Props.newActor(Props.scala:252)
              at akka.actor.ActorCell.newActor(ActorCell.scala:552)
              at akka.actor.ActorCell.create(ActorCell.scala:578)
              ... 10 more
      Caused by: java.lang.NoSuchMethodError: com.fasterxml.jackson.core.JsonFactory.requiresPropertyOrdering()Z
              at com.fasterxml.jackson.databind.ObjectMapper.<init>(ObjectMapper.java:458)
              at com.fasterxml.jackson.databind.ObjectMapper.<init>(ObjectMapper.java:379)
              at org.apache.flink.runtime.taskmanager.TaskManager.<init>(TaskManager.scala:153)
              at org.apache.flink.yarn.YarnTaskManager.<init>(YarnTaskManager.scala:32)
              ... 19 more
      16:18:56,564 ERROR org.apache.flink.runtime.taskmanager.TaskManager              - Actor akka://flink/user/taskmanager#-1189186354 terminated, stopping process...
      
      

        Attachments

          Activity

            People

            • Assignee:
              rmetzger Robert Metzger
              Reporter:
              rmetzger Robert Metzger
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: