[HBASE-22394] HdfsFileStatus incompatibility when used with Hadoop 3.1.x

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Bug
• Affects Version/s: 2.1.4
• Component/s: regionserver
• Assignee: Unassigned
• Reporter: Raymond Lau
• Created: 10/May/19 17:15
• Updated: 19/Oct/21 14:35
• Resolved: 19/Oct/21 14:35

Description

Hbase 2.1.4 works fine with Hadoop 3.0.3 but when I attempted to upgrade to Hadoop 3.1.2, I get the following error in the region server:

2019-05-10 12:49:10,303 ERROR HRegionServer - ***** ABORTING region server [REDACTED],16020,1557506923574: Unhandled: Found interface org.apache.hadoop.hdfs.protocol.HdfsFileStatus, but class was expected *****
java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.hdfs.protocol.HdfsFileStatus, but class was expected
at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.createOutput(FanOutOneBlockAsyncDFSOutputHelper.java:768)
at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$400(FanOutOneBlockAsyncDFSOutputHelper.java:118)
at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$16.doCall(FanOutOneBlockAsyncDFSOutputHelper.java:848)

Hadoop 3.1.1+ is listed as compatible with Hbase 2.1.x at https://hbase.apache.org/book.html#basic.prerequisites.

Issue Links

• blocks: HIVE-20359 Update protobuf version in pom.xml
• blocks: HIVE-22447 Update HBase Version to GA
• causes: PHOENIX-5993 HBase 2.2.5 public maven artifacts are incompatible with Hadoop 3
• is duplicated by: HBASE-24154 HdfsFileStatus incompatibility when used with Hadoop 3.1.3 and Hbase version 2.2.4
• relates to: HIVE-24473 Make Hive buildable with HBase 2.x GA versions