[OOZIE-3621] Make TestECPolicyDisabler work with Hadoop 3

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Chia-Ping Tsai
• Created: 11/May/21 09:13
• Updated: 01/Jul/22 12:27

Description

TestECPolicyDisabler is not compatible with hadoop 3. The following error messages are produced by command `mvn clean install -DskipTests -Dhadoop.version=3.1.0 -Dhadoop.majorversion=3 -Phadoop-3`

[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] /home/chia7712/oozie/tools/src/test/java/org/apache/oozie/tools/TestECPolicyDisabler.java:[50,71] getErasureCodingPolicy(org.apache.hadoop.fs.Path) in org.apache.oozie.tools.TestECPolicyDisabler.MockDistributedFileSystem cannot override getErasureCodingPolicy(org.apache.hadoop.fs.Path) in org.apache.hadoop.hdfs.DistributedFileSystem
return type org.apache.hadoop.hdfs.protocol.SystemErasureCodingPolicies.ReplicationPolicy is not compatible with org.apache.hadoop.hdfs.protocol.ErasureCodingPolicy

The root cause is the method `getErasureCodingPolicy` was introduced in hadoop 3 and the method signature is different to mock fs of TestECPolicyDisabler. Fortunately, all we want to test is the static method 'ECPolicyDisabler#check' so we can add a new argument to make it be able to check another method.

Issue Links

• is duplicated by: OOZIE-3665 Build Failed Oozie 5.2.1 with Hadoop 3.3.3
• is related to: OOZIE-2973 Make sure Oozie works with Hadoop 3
• links to: Pull Request