[HADOOP-15389] Hadoop contains both Jackson 2.9.4 and 2.7.8 jars

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Invalid
• Affects Version/s: 3.1.0, 3.2.0
• Assignee: Unassigned
• Reporter: Dmitry Chuyko
• Created: 16/Apr/18 15:03
• Updated: 16/Apr/18 15:22
• Resolved: 16/Apr/18 15:22

Description

I build hadoop-3.2.0-SNAPSHOT distribution from scratch. Resulting package has following in hadoop-3.2.0-SNAPSHOT/share/hadoop/hdfs/lib/:

jackson-annotations-2.7.8.jar
jackson-annotations-2.9.4.jar
jackson-core-2.7.8.jar
jackson-core-2.9.4.jar
jackson-databind-2.7.8.jar
jackson-databind-2.9.4.jar

As a result DataNode does not start with following error:

java.lang.NoSuchFieldError: ACCEPT_CASE_INSENSITIVE_PROPERTIES
at com.fasterxml.jackson.databind.deser.BeanDeserializerBase.createContextual(BeanDeserializerBase.java:747)
at com.fasterxml.jackson.databind.DeserializationContext.handleSecondaryContextualization(DeserializationContext.java:682)
at com.fasterxml.jackson.databind.DeserializationContext.findRootValueDeserializer(DeserializationContext.java:482)
at com.fasterxml.jackson.databind.ObjectReader._prefetchRootDeserializer(ObjectReader.java:1938)
at com.fasterxml.jackson.databind.ObjectReader.<init>(ObjectReader.java:189)
at com.fasterxml.jackson.databind.ObjectMapper._newReader(ObjectMapper.java:658)
at com.fasterxml.jackson.databind.ObjectMapper.readerFor(ObjectMapper.java:3517)
at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImpl.<clinit>(FsVolumeImpl.java:109)
at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsVolumeImplBuilder.build(FsVolumeImplBuilder.java:76)
at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.addVolume(FsDatasetImpl.java:426)
at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetImpl.<init>(FsDatasetImpl.java:316)
at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetFactory.newInstance(FsDatasetFactory.java:34)
at org.apache.hadoop.hdfs.server.datanode.fsdataset.impl.FsDatasetFactory.newInstance(FsDatasetFactory.java:30)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:1719)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:1665)
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:390)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:280)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:816)
at java.lang.Thread.run(Thread.java:748)

Issue Links

• is caused by: HADOOP-15299 Bump Hadoop's Jackson 2 dependency 2.9.x