[FLINK-3032] Flink does not start on Hadoop 2.7.1 (HDP), due to class conflict

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.10.0, 1.0.0
• Fix Version/s: 0.10.1, 1.0.0
• Component/s: Build System
• Assignee: Robert Metzger
• Reporter: Robert Metzger
• Created: 17/Nov/15 16:47
• Updated: 19/Nov/15 21:00
• Resolved: 19/Nov/15 21:00

Description

Steps to reproduce:

• Build flink mvn clean install -DskipTests -Dhadoop.version=2.7.1.2.3.2.0-2950 -Pvendor-repos
• Start it on a HDP 2.3.2 Hadoop as a yarn-session
• Watch it fail with

6:18:56,459 INFO  org.apache.flink.runtime.filecache.FileCache                  - User file cache uses directory /hadoop/yarn/local/usercache/flink/appcache
/application_1447687546708_0005/flink-dist-cache-f4710796-598c-4778-992c-5df000faffae
16:18:56,561 ERROR akka.actor.OneForOneStrategy                                  - exception during creation
akka.actor.ActorInitializationException: exception during creation
        at akka.actor.ActorInitializationException$.apply(Actor.scala:164)
        at akka.actor.ActorCell.create(ActorCell.scala:596)
        at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:456)
        at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
        at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:279)
        at akka.dispatch.Mailbox.run(Mailbox.scala:220)
        at akka.dispatch.Mailbox.exec(Mailbox.scala:231)
        at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.pollAndExecAll(ForkJoinPool.java:1253)
        at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1346)
        at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
        at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
Caused by: java.lang.reflect.InvocationTargetException
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at akka.util.Reflect$.instantiate(Reflect.scala:66)
        at akka.actor.ArgsReflectConstructor.produce(Props.scala:352)
        at akka.actor.Props.newActor(Props.scala:252)
        at akka.actor.ActorCell.newActor(ActorCell.scala:552)
        at akka.actor.ActorCell.create(ActorCell.scala:578)
        ... 10 more
Caused by: java.lang.NoSuchMethodError: com.fasterxml.jackson.core.JsonFactory.requiresPropertyOrdering()Z
        at com.fasterxml.jackson.databind.ObjectMapper.<init>(ObjectMapper.java:458)
        at com.fasterxml.jackson.databind.ObjectMapper.<init>(ObjectMapper.java:379)
        at org.apache.flink.runtime.taskmanager.TaskManager.<init>(TaskManager.scala:153)
        at org.apache.flink.yarn.YarnTaskManager.<init>(YarnTaskManager.scala:32)
        ... 19 more
16:18:56,564 ERROR org.apache.flink.runtime.taskmanager.TaskManager              - Actor akka://flink/user/taskmanager#-1189186354 terminated, stopping process...