[HBASE-22151] hbase-backup should specify hadoop-hdfs-client version for Hadoop 3

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Affects Version/s: 2.0.0
• Component/s: backup&restore

Environment

Hadoop 3.2.0

• Assignee: Wei-Chiu Chuang
• Reporter: Wei-Chiu Chuang
• Created: 02/Apr/19 23:44
• Updated: 06/Apr/19 16:37
• Resolved: 03/Apr/19 02:36

Description

mvn test -P runAllTests -fn -Dhadoop.profile=3.0 -Dhadoop-three.version=3.2.0 -Dtest=TestIncrementalBackupWithBulkLoad

 

Despite hadoop 3 version is specified, the test always use hadoop-hdfs-client 3.0.3, and will fail on Hadoop 3.2.0 because it can't find a new class.

 

Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 709.323 s <<< FAILURE! - in org.apache.hadoop.hbase.backup.TestIncrementalBackupWithBulkLoad
TestIncBackupDeleteTable(org.apache.hadoop.hbase.backup.TestIncrementalBackupWithBulkLoad) Time elapsed: 1.907 s <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/protocol/HdfsConstants$StoragePolicySatisfierMode
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.protocol.HdfsConstants$StoragePolicySatisfierMode