[HDFS-15659] Set dfs.namenode.redundancy.considerLoad to false in MiniDFSCluster

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.4.0, 2.10.2, 3.2.3, 3.3.2
• Component/s: test
• Labels: pull-request-available
• Hadoop Flags: Reviewed
• Assignee: Ahmed Hussein
• Reporter: Akira Ajisaka
• Created: 28/Oct/20 07:30
• Updated: 25/Jun/21 18:09
• Resolved: 25/Jun/21 18:09

Description

dfs.namenode.redundancy.considerLoad is true by default and it is causing many test failures. Let's disable it in MiniDFSCluster.

Originally reported by weichiu: https://github.com/apache/hadoop/pull/2410#pullrequestreview-516144442

i've certain seen this option causing test failures in the past.
Maybe we should turn it off by default in MiniDDFSCluster, and only enable it for specific tests.

Issue Links

• supercedes: HDFS-9776 TestHAAppend#testMultipleAppendsDuringCatchupTailing is flaky
• supercedes: HDFS-15461 TestDFSClientRetries#testGetFileChecksum fails intermittently
• links to: GitHub Pull Request #2443